Commit Graph

Select branches

Hide Pull Requests

codex/fix-issue-with-mediacrawler-functionality

codex/replace-argparse-with-typer-for-cli

docs/add-bloome-sponsor

docs/readme-formatting-sync

feature/config-refactor-20251018

feature/connect-existing-browser

feature/excel-export-and-tests

feature/test_new_rule_01

fix/proxy-20251125

fix/xhs-sign-20251127

main

#10

#112

#124

#136

#137

#142

#157

#177

#18

#182

#183

#184

#201

#202

#206

#209

#212

#213

#214

#216

#217

#223

#224

#226

#228

#228

#229

#234

#238

#24

#242

#243

#250

#251

#252

#253

#254

#255

#265

#273

#276

#278

#280

#281

#290

#292

#293

#294

#295

#298

#299

#300

#301

#303

#306

#307

#309

#314

#316

#318

#319

#32

#323

#325

#327

#328

#329

#330

#331

#332

#333

#336

#337

#343

#345

#346

#347

#348

#350

#353

#357

#360

#361

#370

#371

#374

#375

#376

#377

#378

#379

#380

#384

#385

#386

#387

#388

#389

#396

#399

#4

#40

#400

#401

#404

#405

#411

#413

#422

#425

#427

#433

#461

#462

#463

#477

#479

#506

#509

#513

#516

#519

#521

#528

#536

#538

#542

#547

#559

#572

#590

#592

#596

#599

#603

#607

#608

#616

#619

#621

#634

#635

#636

#637

#638

#639

#64

#641

#642

#649

#650

#652

#654

#655

#657

#658

#664

#674

#676

#680

#681

#684

#686

#687

#690

#699

#700

#704

#707

#716

#717

#718

#723

#726

#728

#729

#73

#738

#739

#74

#741

#743

#761

#764

#768

#772

#773

#780

#782

#783

#784

#785

#786

#787

#788

#789

#793

#802

#805

#807

#809

#814

#815

#816

#817

#82

#821

#824

#825

#827

#828

#829

#831

#838

#839

#845

#845

#847

#849

#849

#850

#854

#854

#864

#864

#867

#877

#877

#878

#878

#880

#880

#882

#883

#884

#886

#887

#887

#888

#889

#889

#89

#894

#898

#898

#899

#900

#901

#903

#905

#905

#909

#911

#911

#912

#912

#913

#917

#918

#918

#920

#921

#921

#923

#923

#925

#930

#931

#931

#932

#932

#933

#933

#934

#935

#935

#937

#937

#938

#94

#940

#940

#944

#944

#947

#947

#948

#948

#950

#952

#952

#957

#958

#96

#961

#961

#962

#962

#963

#963

#964

#964

#967

#967

#968

#968

#969

#969

#970

#970

#971

#971

#972

#972

#973

#973

#974

#974

#975

#975

#976

#976

#977

#977

#978

#978

#979

#979

Mono Color

• eb03a4f68d Update playwright version to support Ubuntu 24.04 Lei Cao 2025-07-05 21:17:52 +00:00
• 3cb0e2f91f Merge pull request #637 from Mirza-Samad-Ahmed-Baig/fix/bilibili-creator-videos 程序员阿江(Relakkes) 2025-07-05 00:13:49 +08:00
• 7edf3bcc15 refactor(bilibili): process creator videos in batches mirza-samad-ahmed-baig 2025-07-04 21:04:10 +05:00
• 66a68fbb13 docs: update multi language badges size 程序员阿江(Relakkes) 2025-07-04 14:15:03 +08:00
• 8dcc540797 Merge pull request #635 from Root-FTW/main 程序员阿江(Relakkes) 2025-07-04 13:54:31 +08:00
• 4a110abebb feat: Add language navigation links to all README files Root-FTW 2025-07-03 17:14:41 -07:00
• 3b7726365c feat: Add localized README files in English and Spanish Root-FTW 2025-07-03 17:09:08 -07:00
• 848df2b491 feat: other platfrom support the cdp mode 程序员阿江(Relakkes) 2025-07-03 17:13:32 +08:00
• c892c3324c chore: update uv lock file use aliyun pypi 程序员阿江(Relakkes) 2025-07-03 16:07:07 +08:00
• 452aafeec8 chore: update uv depends source 程序员阿江(Relakkes) 2025-07-03 15:27:39 +08:00
• 89359aa259 docs: update README.md 程序员阿江(Relakkes) 2025-07-02 01:20:44 +08:00
• 0514758cff docs: 更新uv安装文档 程序员阿江(Relakkes) 2025-06-29 00:07:13 +08:00
• e83b2422d9 feat: 支持playwright通过cdp协议连接本地chrome浏览器 docs: 增加uv来管理python依赖的文档 程序员阿江(Relakkes) 2025-06-25 23:22:39 +08:00
• fbc9788d54 docs: update README.md 程序员阿江(Relakkes) 2025-06-24 17:44:43 +08:00
• 71210e3f38 chore: delete unnecessary file Relakkes 2025-06-20 16:26:02 +08:00
• fc45b22963 fix: vitepress path problem Relakkes 2025-06-20 16:10:44 +08:00
• 22ec34dca3 docs: add list of sponsors Relakkes 2025-06-20 16:04:04 +08:00
• fd33813f8f feat: add like_count field to bilibi for issue #623 Relakkes 2025-06-20 15:50:38 +08:00
• 31bcdb191f docs: update README.md Relakkes 2025-06-16 13:58:09 +08:00
• d55d8b1efa feat: Douyin supports obtaining video links and cover images. for issue #620 Relakkes 2025-06-14 23:59:08 +08:00
• ed1dc7916a docs: update README.md Relakkes 2025-06-08 15:56:02 +08:00
• 6323e2d45b Merge pull request #616 from chimeElm/main 程序员阿江(Relakkes) 2025-06-07 14:43:37 +08:00
• 26a845581e Update client.py chimeElm 2025-06-07 02:41:09 +08:00
• 23c8f8f87b docs: add english license Relakkes 2025-06-01 23:20:11 +08:00
• 1e7b950d3e Revert "chore: remove sponor" Relakkes 2025-05-26 22:35:18 +08:00
• 242c06c345 chore: remove sponor Relakkes 2025-05-25 11:54:38 +08:00
• ff41faeb00 Merge pull request #608 from Bowenwin/bili_expand 程序员阿江(Relakkes) 2025-05-22 23:14:58 +08:00
• 66843f216a finish_all_for_expand_bili Bowenwin 2025-05-22 22:26:30 +08:00
• 59619fff0a finish_all Bowenwin 2025-05-22 22:06:06 +08:00
• 44e3d370ff fix_words Bowenwin 2025-05-22 20:31:48 +08:00
• 7ed6621933 Merge pull request #603 from Bowenwin/fix_words 程序员阿江(Relakkes) 2025-05-19 23:16:12 +08:00
• 703a6e84cb fix_words Bowenwin 2025-05-19 20:07:20 +08:00
• 144b8bec6a fix_words Bowenwin 2025-05-19 20:04:00 +08:00
• a356358c21 get_fans_and_get_followings Bowenwin 2025-05-19 19:57:36 +08:00
• 654260cbce docs: update README.md Relakkes 2025-05-13 18:42:58 +08:00
• 79a9824f6a fix: modify dy schema Relakkes 2025-04-30 16:47:13 +08:00
• 67d31bf42a fix: dy update fp params Relakkes 2025-04-30 13:26:22 +08:00
• 2a41b684ad Merge pull request #590 from 2513502304/main 程序员阿江(Relakkes) 2025-04-20 14:14:55 +08:00
• af5a393a7a Update core.py，删除了其它代码贡献者所添加的try-catch语句，该段try-catch语句将会影响其代码的最终逻辑并令其失效，使其仅能爬取当天一天数据而无法跳转到下一天（原先的逻辑就是try-catch捕获异常从而进入下一天，不要再向该语句中添加捕获异常操作或者finally语句！） 翟持江 2025-04-19 04:34:24 +08:00
• b675547aab Update __init__.py，为bilibili的视频信息、up主信息、评论信息添加额外字段 翟持江 2025-04-19 02:29:22 +08:00
• ec97001451 Update tables.sql 翟持江 2025-04-19 02:22:22 +08:00
• 9935a07279 Add files via upload 翟持江 2025-04-19 02:18:52 +08:00
• cb2ae6cbab docs: add sponsor Relakkes 2025-04-16 16:49:49 +08:00
• 0d715a9f32 fix: bili qrcode login fix Relakkes 2025-04-08 21:11:40 +08:00
• 660fd18a95 fix: dy login fix Relakkes 2025-04-08 20:58:04 +08:00
• afbd4ec1bf Merge pull request #572 from crpa33/main 程序员阿江(Relakkes) 2025-04-02 13:34:41 +08:00
• 274d64aefc 处理xhs意外的评论信息为空的情况 crpa33 2025-04-02 11:59:27 +08:00
• a39b571d27 输出到日志-处理视频搜索页任务列表构造的错误 crpa33 2025-04-02 11:57:28 +08:00
• 413d91a520 输出到日志-author被封禁或存在错误 crpa33 2025-04-02 11:52:36 +08:00
• eaf14721f8 输出到日志-NoneType导致的推导式错误 crpa33 2025-04-02 11:48:36 +08:00
• 2c4af2337e douyin搜索页为空跳下一关键词 crpa33 2025-03-27 23:32:21 +08:00
• 3c72fc48b0 保护author为None但未被识别的情况 crpa33 2025-03-27 23:22:47 +08:00
• 6b6e2b8ba0 修复NoneType导致的推导式错误 crpa33 2025-03-27 23:18:01 +08:00
• dfddfa7fdc docs: update README.md Relakkes 2025-03-23 20:35:11 +08:00
• daaea7155b feat: add uv tool to manage project Relakkes 2025-03-23 18:13:13 +08:00
• 8030d2a02f docs: removed sponsor Relakkes 2025-03-13 15:07:54 +08:00
• 061d1c15e2 feat: kuaishou search params update Relakkes 2025-03-11 23:42:34 +08:00
• f2cf864c27 fix: zhihu article url error #564 Relakkes 2025-03-03 18:18:41 +08:00
• b43d6b7b91 chore: update config Relakkes 2025-02-12 10:58:48 +08:00
• 66a7ab1db8 refactor: bibi default to get without time data Relakkes 2025-02-12 10:58:15 +08:00
• 678ce1bfac fix: bilibili bugfix Relakkes 2025-02-10 17:13:37 +08:00
• 457205efd8 docs: add sponsor Relakkes 2025-02-08 15:28:18 +08:00
• 38f2b36bf5 Merge pull request #542 from 2513502304/main 程序员阿江(Relakkes) 2025-01-20 19:30:10 +08:00
• 0364b23b5b Update core.py，为爬取类型为detail和creator的任务，添加了和search任务一样的，用于转存up主信息的bilibili_store.update_up_info的函数调用 翟持江 2025-01-19 19:55:18 +08:00
• 4b63ea68ec Merge pull request #538 from 2513502304/main 程序员阿江(Relakkes) 2025-01-17 19:43:57 +08:00
• 2d93ec5a82 Update core.py，更改了错误的缩进 翟持江 2025-01-15 18:33:12 +08:00
• 8741952cb5 Update requirements.txt，添加了pandas模块，datetime为Python标准库模块无需添加 翟持江 2025-01-15 18:27:40 +08:00
• d2ecd3b11d Update client.py，将search_video_by_keyword中post_data错误的请求参数进行更新 翟持江 2025-01-15 18:21:03 +08:00
• f2b41b573b Update core.py，以实现按照 START_DAY 至 END_DAY ，每一天进行筛选，这样能够突破 1000 条视频的限制，最大程度爬取该关键词下的所有视频 翟持江 2025-01-15 18:18:36 +08:00
• bf87821d4b 为 base_config.py 添加了是否开启按每一天进行爬取的选项 翟持江 2025-01-15 18:06:16 +08:00
• 30d0e733d5 feat: douyin adds comment images Relakkes 2025-01-15 14:49:55 +08:00
• a8e796e690 Merge pull request #536 from 2513502304/main 程序员阿江(Relakkes) 2025-01-13 13:58:15 +08:00
• 0118621a79 将微博评论爬取函数get_note_all_comments的max_id_type便为可变请求参数 翟持江 2025-01-10 19:20:01 +08:00
• 17b40b8bb4 Delete client.py 翟持江 2025-01-10 19:13:03 +08:00
• 8967d3721c 将微博评论爬取函数get_note_all_comments的max_id_type便为可变请求参数 翟持江 2025-01-10 19:08:57 +08:00
• 5d3e12169e fix: move dirctory Relakkes 2025-01-10 16:53:20 +08:00
• b89a8e5dda docs: add github issue template Relakkes 2025-01-10 16:51:30 +08:00
• 792d3bbc34 docs: update README.md Relakkes 2025-01-05 19:02:10 +08:00
• 5f7c8aea5b docs: 添加11-12月份捐赠者名单 Relakkes 2025-01-02 20:37:28 +08:00
• fbbead814a fix: 贴吧创作者bug修复 Relakkes 2025-01-02 20:29:05 +08:00
• 7ce1273386 Merge pull request #528 from HuiGitH/hui/fix-xhs-gender 程序员阿江(Relakkes) 2024-12-28 21:01:58 +08:00
• d929ad16ae fix xhs get gender HuiLong 2024-12-28 20:24:37 +08:00
• 79bf9fc05d chore: add xhs field comment for issue #526 Relakkes 2024-12-26 18:28:23 +08:00
• 29ab6feded fix: 修复数据库密码中有特殊符号导致db连接不上的bug Relakkes 2024-12-26 18:13:13 +08:00
• ea5223c708 feat: 知乎支持详情模式 Relakkes 2024-12-26 17:36:33 +08:00
• dc9116e098 Merge pull request #513 from liudongkai/feature_xhs 程序员阿江(Relakkes) 2024-12-06 13:01:16 +08:00
• 33e7ef016d feat: xhs 非代理模式下增加随机等待间隔, db存储模式下增加存储xsec_token字段 liudongkai 2024-12-05 21:10:31 +08:00
• 9c7e1d499b Merge pull request #509 from leantli/feat/xhs_comments_upgrade 程序员阿江(Relakkes) 2024-12-03 18:34:56 +08:00
• e830ada574 feat: xhs comments add xsec_token leantli 2024-12-03 18:25:21 +08:00
• 6001fc8a52 Merge pull request #506 from JianxunRao/main 程序员阿江(Relakkes) 2024-11-29 11:07:58 +08:00
• f9eedc59b1 fix：微博根据creator爬取note时，爬取评论失败。原因是解析的参数key有误 Trojx 2024-11-29 10:47:40 +08:00
• 453ea642fb docs: update README.md Relakkes 2024-11-29 10:40:52 +08:00
• ca9b47ef63 fix: xhs 帖子详情优化 Relakkes 2024-11-27 09:41:24 +08:00
• 43dffeb2d1 feat: xhs帖子详情获取优化 Relakkes 2024-11-26 13:37:53 +08:00
• de32d06815 docs: update README.md Relakkes 2024-11-19 12:58:28 +08:00
• 935a928f90 docs: update README.md Relakkes 2024-11-17 07:00:55 +08:00
• 8ab4c67443 feat: 抖音支持评论点赞数量 #495 Relakkes 2024-11-16 00:37:48 +08:00
• c12a63acb2 fix: weibo creator duplicate bug Relakkes 2024-11-13 22:28:54 +08:00
• f9e7d56d4f chore: remove sponsor Relakkes 2024-11-08 22:27:03 +08:00
• 3db2edd479 fix: weibo创作者bugfix Relakkes 2024-11-06 16:00:41 +08:00