Commit Graph

Select branches

Hide Pull Requests

codex/fix-issue-with-mediacrawler-functionality

codex/replace-argparse-with-typer-for-cli

docs/add-bloome-sponsor

docs/readme-formatting-sync

feature/config-refactor-20251018

feature/connect-existing-browser

feature/excel-export-and-tests

feature/test_new_rule_01

fix/proxy-20251125

fix/xhs-sign-20251127

main

#10

#112

#124

#136

#137

#142

#157

#177

#18

#182

#183

#184

#201

#202

#206

#209

#212

#213

#214

#216

#217

#223

#224

#226

#228

#228

#229

#234

#238

#24

#242

#243

#250

#251

#252

#253

#254

#255

#265

#273

#276

#278

#280

#281

#290

#292

#293

#294

#295

#298

#299

#300

#301

#303

#306

#307

#309

#314

#316

#318

#319

#32

#323

#325

#327

#328

#329

#330

#331

#332

#333

#336

#337

#343

#345

#346

#347

#348

#350

#353

#357

#360

#361

#370

#371

#374

#375

#376

#377

#378

#379

#380

#384

#385

#386

#387

#388

#389

#396

#399

#4

#40

#400

#401

#404

#405

#411

#413

#422

#425

#427

#433

#461

#462

#463

#477

#479

#506

#509

#513

#516

#519

#521

#528

#536

#538

#542

#547

#559

#572

#590

#592

#596

#599

#603

#607

#608

#616

#619

#621

#634

#635

#636

#637

#638

#639

#64

#641

#642

#649

#650

#652

#654

#655

#657

#658

#664

#674

#676

#680

#681

#684

#686

#687

#690

#699

#700

#704

#707

#716

#717

#718

#723

#726

#728

#729

#73

#738

#739

#74

#741

#743

#761

#764

#768

#772

#773

#780

#782

#783

#784

#785

#786

#787

#788

#789

#793

#802

#805

#807

#809

#814

#815

#816

#817

#82

#821

#824

#825

#827

#828

#829

#831

#838

#839

#845

#845

#847

#849

#849

#850

#854

#854

#864

#864

#867

#877

#877

#878

#878

#880

#880

#882

#883

#884

#886

#887

#887

#888

#889

#889

#89

#894

#898

#898

#899

#900

#901

#903

#905

#905

#909

#911

#911

#912

#912

#913

#917

#918

#918

#920

#921

#921

#923

#923

#925

#930

#931

#931

#932

#932

#933

#933

#934

#935

#935

#937

#937

#938

#94

#940

#940

#944

#944

#947

#947

#948

#948

#950

#952

#952

#957

#958

#96

#961

#961

#962

#962

#963

#963

#964

#964

#967

#967

#968

#968

#969

#969

#970

#970

#971

#971

#972

#972

#973

#973

#974

#974

#975

#975

#976

#976

#977

#977

#978

#978

#979

#979

Mono Color

• 87eb8aa6a7 fix: #230 Relakkes 2024-04-13 20:18:04 +08:00
• c26270146f fix: 修复ip代理池设计bug Relakkes 2024-04-13 18:04:33 +08:00
• e367129b5f fix: 修复pr#229的小bug Relakkes 2024-04-13 13:48:29 +08:00
• a341dc2aff Merge pull request #229 from Tianci-King/main 程序员阿江-Relakkes 2024-04-13 13:37:35 +08:00
• da949f0c7a Merge pull request #226 from leantli/feat/sub_comments 程序员阿江-Relakkes 2024-04-13 01:17:55 +08:00
• 6cabece01a chore: remove redundant line breaks leantli 2024-04-12 18:18:01 +08:00
• ad01dfba95 feat: 轻量化支持爬取小红书二级评论 leantli 2024-04-12 17:32:20 +08:00
• 1115b0d90c feat(core): 新增控制爬虫 参数起始页面的页数start_page;perf(argparse): 向命令行解析器添加程序参数起始页面页数和关键字 Tianci-King 2024-04-12 00:52:47 +08:00
• 81a9946afd feat: 支持爬取小红书二级评论 leantli 2024-04-11 17:16:13 +08:00
• bba9841c26 Merge pull request #223 from Ermeng98/main 程序员阿江-Relakkes 2024-04-11 00:11:04 +08:00
• 9cd6efb916 使用isort对引用进行格式化排序 修改微博获取图片默认配置关闭 Er_Meng 2024-04-10 09:54:28 +08:00
• 52c720591f Merge branch 'NanmiCoder:main' into main Ermeng 2024-04-10 09:51:14 +08:00
• cab91474ad Merge pull request #224 from Klu5ure/main 程序员阿江-Relakkes 2024-04-09 23:14:14 +08:00
• 488acd04df fix: #222 Relakkes 2024-04-09 23:10:51 +08:00
• 4ed5d4d73e docs: 恢复文档中误删的字 Klu5ure 2024-04-09 23:00:13 +08:00
• 16413c3074 新增对微博博客内照片获取的支持 文件存放路径data/weibo/images Er_Meng 2024-04-09 17:21:52 +08:00
• 5c409c6f0c docs: 群二维码失效，更新 Relakkes 2024-04-08 23:41:53 +08:00
• 8f02da73ad fix: #219 docs: update README.md Relakkes 2024-04-08 00:18:25 +08:00
• b54f168c6b Merge pull request #217 from Klu5ure/main 程序员阿江-Relakkes 2024-04-07 23:11:19 +08:00
• fd7c597305 docs: 修改错别字 Your Name 2024-04-07 22:09:05 +08:00
• d392747fe7 fix: 移除orm的所有内容 Relakkes 2024-04-06 23:51:03 +08:00
• 1627ae4344 Merge pull request #216 from NanmiCoder/feature/refactor_db 程序员阿江-Relakkes 2024-04-06 22:21:30 +08:00
• f9cbeb2b14 chore: 移除tortise-orm依赖 Relakkes 2024-04-06 22:14:03 +08:00
• 0c8484c334 feat: db数据存储重构完成 Relakkes 2024-04-06 22:11:10 +08:00
• de4a437dd7 style: rename image name Relakkes 2024-04-06 12:23:55 +08:00
• 27f3461e31 docs: update README.md Relakkes 2024-04-06 10:57:42 +08:00
• dde3c0429e refactor: IP代理池重构 Relakkes 2024-04-05 10:44:05 +08:00
• d0c578c2bf Merge pull request #213 from Styunlen/patch-1 程序员阿江-Relakkes 2024-04-06 00:51:36 +08:00
• 40daa8d6f3 chore: fix wrong log output when weibo crawler finished Styunlen 2024-04-06 00:41:05 +08:00
• 5495d76fdb Merge pull request #212 from chunpat/fixbug_qrcode_show 程序员阿江-Relakkes 2024-04-05 22:02:06 +08:00
• 6422500e32 Remove duplication Qrcode Show chunpat 2024-04-05 21:24:06 +08:00
• 87e3d0848a Merge pull request #209 from xbsheng/chore/text 程序员阿江-Relakkes 2024-04-04 18:11:42 +08:00
• 2d24cf0f44 chore: 修改错别字 xbsheng 2024-04-04 17:32:23 +08:00
• 6160428909 Merge pull request #202 from zhihuiio/patch-1 程序员阿江-Relakkes 2024-04-04 13:12:50 +08:00
• 208978b88f Merge pull request #206 from leantli/fix/max_notes_count 程序员阿江-Relakkes 2024-04-04 00:46:42 +08:00
• 68a60faa7f chore: 简化判断方式 leantli 2024-04-04 00:11:22 +08:00
• 3de57459c1 docs: 增加交流2群二维码 Relakkes 2024-04-03 13:40:38 +08:00
• 85382ac7ed docs:更新许可证协议，不允许商用。 Relakkes 2024-04-03 12:34:34 +08:00
• 133f978477 fix: 修复爬取视频/帖子最大数设置值较低导致不爬取的问题 leantli 2024-04-03 12:18:23 +08:00
• e4836847cd docs: update README.md Relakkes 2024-04-01 22:08:26 +08:00
• 085702820a Update requirements.txt zhihuiio 2024-04-01 20:28:50 +08:00
• 285ab7abe6 Update README.md 程序员阿江-Relakkes 2024-04-01 12:54:53 +08:00
• bb732ed2ff docs: 增加MediaCrawler视频课程链接 Relakkes 2024-03-31 23:51:37 +08:00
• 6d8c8fb22e feat: add mysql table Relakkes 2024-03-31 15:02:52 +08:00
• 807af1abed Merge pull request #201 from Schofi/main 程序员阿江-Relakkes 2024-03-31 14:40:11 +08:00
• e950e0d6e3 feat: add abstract api client to all platform Relakkes 2024-03-30 21:27:25 +08:00
• 67ec49498a refactor: rename xhs to xiaohongshu Relakkes 2024-03-30 21:17:33 +08:00
• 81317482f8 Update README.md Schofi 2024-03-30 18:29:41 +08:00
• aa257aab51 docs: update README.md Relakkes 2024-03-30 14:14:10 +08:00
• aca1924bd7 Merge pull request #183 from BaoZhuhan/fix-markdown relakkes 2024-03-19 23:13:34 +08:00
• 1389ad0f81 Merge branch 'fix-markdown' of github.com:BaoZhuhan/MediaCrawler into fix-markdown BaoZhuhan 2024-03-19 22:59:33 +08:00
• 4c20b02273 fix : 修复”常见问题.md“语法问题 BaoZhuhan 2024-03-19 22:54:21 +08:00
• 96caede849 Merge pull request #182 from BaoZhuhan/fix-markdown relakkes 2024-03-19 22:51:45 +08:00
• d4c8d8dd08 fix : 修复”常见问题.md“ BaoZhuhan 2024-03-19 22:50:28 +08:00
• 1e6470b162 fix ：修复了“常见问题.md” BaoZhuhan 2024-03-19 22:48:39 +08:00
• 13596fc1e4 fix: 修复了“常见问题.md"的语法问题。 BaoZhuhan 2024-03-19 22:37:15 +08:00
• 4ea9700db0 docs: 增加赞助名单 Relakkes 2024-03-19 21:50:25 +08:00
• 3a318faee1 Update README.md relakkes 2024-03-19 13:27:58 +08:00
• 5f5147a236 docs: 添加捐赠者名单 Relakkes 2024-03-18 22:55:40 +08:00
• 8e8f5d41e4 docs: 添加捐赠者名单 Relakkes 2024-03-18 22:03:45 +08:00
• ea66839d72 Update README.md relakkes 2024-03-18 13:40:36 +08:00
• 67443737f5 docs: 添加捐赠者名单 Relakkes 2024-03-17 22:16:58 +08:00
• 96309dcfee fix: 小红书创作者功能数据获取优化 Relakkes 2024-03-17 14:50:10 +08:00
• 78a9bf9f38 docs: 添加捐赠者名单 Relakkes 2024-03-17 01:05:10 +08:00
• 569202af78 feat: update user-agent list Relakkes 2024-03-17 01:03:56 +08:00
• 59cd9f67a0 feat: 支持评论模式是否开启爬取选项 Relakkes 2024-03-16 11:52:42 +08:00
• 2d12ecb930 docs: 增加捐赠名单 Relakkes 2024-03-14 22:06:18 +08:00
• b48e4d297d docs: 将python3命令修改为python Relakkes 2024-03-12 23:09:45 +08:00
• 9e2d1396b8 docs: 增加视频入门教程链接 Relakkes 2024-03-10 03:49:58 +08:00
• 9ca0a2b717 docs: update README.md Relakkes 2024-03-09 15:37:51 +08:00
• 41fee4ff4f feat：小红书支持获取评论中的图片链接 #145 Relakkes 2024-03-07 22:30:44 +08:00
• 861019022a docs: 增加捐赠者名单 Relakkes 2024-03-05 22:45:32 +08:00
• 7606c1d993 docs: 增加捐赠者名单 Relakkes 2024-03-05 00:03:51 +08:00
• 149b6bcdc8 fix: 修复抖音关键词搜索为中文的情况下，有bug Relakkes 2024-03-03 19:36:36 +08:00
• 7002061d70 Merge pull request #142 from jayeeliu/main relakkes 2024-03-02 23:30:31 +08:00
• 2b1ad18e18 Revert "feat: add aerich for migrate db" jayeeliu@gmail.com 2024-03-02 23:05:34 +08:00
• 5f7cd715db feat: add aerich for migrate db jayeeliu@gmail.com 2024-03-02 15:58:35 +08:00
• 9a5460ccca Merge branch 'NanmiCoder:main' into main jayeeliu 2024-03-02 01:51:02 +08:00
• 61ba8c5cc7 feat: 小红书支持通过博主ID采集笔记和评论，小红书type=search时支持配置按哪种排序方式获取笔记数据，小红书笔记增加视频地址和标签字段 jayeeliu@gmail.com 2024-03-02 01:49:42 +08:00
• 384c8f9f7e fix: issue #140 Relakkes 2024-02-26 23:47:02 +08:00
• 67d2b7cff8 Merge pull request #136 from jayeeliu/main relakkes 2024-02-22 21:32:19 +08:00
• c09f9fef68 fix: 增加db.close()，解决抓取命令执行完不退出的问题 ccgo 2024-02-22 00:11:41 +08:00
• 4f5f83d3fa feat: 增加sqlite配置示例 ccgo 2024-02-22 00:07:40 +08:00
• 03ca445221 docs: update README.md Relakkes 2024-02-18 13:06:12 +08:00
• 192e72588d fix: #123 Relakkes 2024-01-26 23:42:26 +08:00
• f1d3bc6e28 Merge pull request #124 from aa65535/patch-1 relakkes 2024-01-25 14:33:09 +08:00
• 79c0f3bd68 修复小红书评论重复插入 Jian Chang 2024-01-25 13:01:04 +08:00
• eb89a6ada8 docs: 添加赞赏者信息 relakkes 2024-01-21 16:42:37 +08:00
• e940a41033 refactor: 移除评论中指定数量和过滤特定关键词的逻辑 Relakkes 2024-01-17 23:02:05 +08:00
• e0f9a487e4 refactor: 代码优化 Relakkes 2024-01-16 00:40:07 +08:00
• e490123fcd Merge pull request #112 from NanmiCoder/feature/stored_in_json relakkes 2024-01-14 22:45:00 +08:00
• 4dfa0d3fbf feat: 数据保存支持JSON格式 Relakkes 2024-01-14 22:40:01 +08:00
• 894dabcf63 refactor: 数据存储重构，分离不同类型的存储实现 Relakkes 2024-01-14 22:06:31 +08:00
• e31aebbdfb fix: 修复代理Bug Relakkes 2024-01-13 15:50:02 +08:00
• 0240de7324 docs: 添加捐赠信息 Relakkes 2024-01-10 23:59:14 +08:00
• f85bd0c2b9 docs: 添加捐赠信息 Relakkes 2024-01-07 18:33:08 +08:00
• 4de14ad6a8 fix: 修复微博PC端登录后COOKIE在手机端无法使用的bug Relakkes 2024-01-06 19:18:07 +08:00
• fe073801f8 feat: 小红书增加获取图片地址的方法 Relakkes 2024-01-04 00:11:05 +08:00
• 80ecc53cd3 fix: #107 Relakkes 2024-01-03 23:08:30 +08:00
• 38d6f10bf0 feat: 微博二维码登录done Relakkes 2023-12-30 18:54:21 +08:00