fork/MediaCrawler
1
0
Fork 0
mirror of https://github.com/NanmiCoder/MediaCrawler.git synced 2026-10-08 06:58:11 +08:00
Code Issues Packages Projects Releases Wiki Activity
455 Commits 11 Branches 0 Tags
dfddfa7fdcd5b96c083f623a86619e08dd59d7c7
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Relakkes dfddfa7fdc docs: update README.md
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled
2025-03-23 20:35:11 +08:00
Relakkes daaea7155b feat: add uv tool to manage project 2025-03-23 18:13:13 +08:00
Relakkes 8030d2a02f docs: removed sponsor
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled
2025-03-13 15:07:54 +08:00
Relakkes 061d1c15e2 feat: kuaishou search params update
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled
2025-03-11 23:42:34 +08:00
Relakkes f2cf864c27 fix: zhihu article url error #564
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled
2025-03-03 18:18:41 +08:00
Relakkes b43d6b7b91 chore: update config
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled
2025-02-12 10:58:48 +08:00
Relakkes 66a7ab1db8 refactor: bibi default to get without time data 2025-02-12 10:58:15 +08:00
Relakkes 678ce1bfac fix: bilibili bugfix
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled
2025-02-10 17:13:37 +08:00
Relakkes 457205efd8 docs: add sponsor
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled
2025-02-08 15:28:18 +08:00
程序员阿江(Relakkes) 38f2b36bf5 Merge pull request #542 from 2513502304/main
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled 
Update core.py，为爬取类型为`detail`和`creator`的任务，添加了和`search`任务一样的，用于转存up主信息的`bilibili_store.update_up_info`的函数调用
 2025-01-20 19:30:10 +08:00
程序员阿江(Relakkes) 4b63ea68ec Merge pull request #538 from 2513502304/main 
feat: bilibli support date range filter
 2025-01-17 19:43:57 +08:00
Relakkes 30d0e733d5 feat: douyin adds comment images
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled
2025-01-15 14:50:05 +08:00
程序员阿江(Relakkes) a8e796e690 Merge pull request #536 from 2513502304/main
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled 
将微博评论爬取函数`get_note_all_comments`的`max_id_type`便为可变请求参数
 2025-01-13 13:58:15 +08:00
Relakkes 5d3e12169e fix: move dirctory
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled
2025-01-10 16:53:20 +08:00
Relakkes b89a8e5dda docs: add github issue template 2025-01-10 16:51:30 +08:00
Relakkes 792d3bbc34 docs: update README.md
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled
2025-01-05 19:02:10 +08:00
Relakkes 5f7c8aea5b docs: 添加11-12月份捐赠者名单
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled
2025-01-02 20:37:28 +08:00
Relakkes fbbead814a fix: 贴吧创作者bug修复 2025-01-02 20:29:05 +08:00
程序员阿江(Relakkes) 7ce1273386 Merge pull request #528 from HuiGitH/hui/fix-xhs-gender
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled 
fix xhs gender
 2024-12-28 21:01:58 +08:00
Relakkes 79bf9fc05d chore: add xhs field comment for issue #526
Deploy VitePress site to Pages / build (push) Has been cancelled
Deploy VitePress site to Pages / Deploy (push) Has been cancelled
2024-12-26 18:28:23 +08:00
Relakkes 29ab6feded fix: 修复数据库密码中有特殊符号导致db连接不上的bug 2024-12-26 18:13:13 +08:00
Relakkes ea5223c708 feat: 知乎支持详情模式
Deploy VitePress site to Pages / build (push) Waiting to run
Deploy VitePress site to Pages / Deploy (push) Blocked by required conditions
2024-12-26 17:36:33 +08:00
程序员阿江(Relakkes) dc9116e098 Merge pull request #513 from liudongkai/feature_xhs 
feat: xhs 非代理模式下增加随机等待间隔, db存储模式下增加存储xsec_token字段
 2024-12-06 13:01:16 +08:00
程序员阿江(Relakkes) 9c7e1d499b Merge pull request #509 from leantli/feat/xhs_comments_upgrade 
feat: xhs comments add xsec_token
 2024-12-03 18:34:56 +08:00
程序员阿江(Relakkes) 6001fc8a52 Merge pull request #506 from JianxunRao/main 
fix：微博根据creator爬取note时，爬取评论失败。原因是解析的参数key有误
 2024-11-29 11:07:58 +08:00
Relakkes 453ea642fb docs: update README.md 2024-11-29 10:40:52 +08:00
Relakkes ca9b47ef63 fix: xhs 帖子详情优化 2024-11-27 09:41:24 +08:00
Relakkes 43dffeb2d1 feat: xhs帖子详情获取优化 2024-11-26 13:37:53 +08:00
Relakkes de32d06815 docs: update README.md 2024-11-19 12:58:28 +08:00
Relakkes 935a928f90 docs: update README.md 2024-11-17 07:00:55 +08:00
Relakkes 8ab4c67443 feat: 抖音支持评论点赞数量 #495 2024-11-16 00:37:48 +08:00
Relakkes c12a63acb2 fix: weibo creator duplicate bug 2024-11-13 22:28:54 +08:00
Relakkes f9e7d56d4f chore: remove sponsor 2024-11-08 22:27:03 +08:00
Relakkes 3db2edd479 fix: weibo创作者bugfix 2024-11-06 16:01:07 +08:00
程序员阿江(Relakkes) 3567193a98 Merge pull request #479 from lyx0727/main 
fix: xhs出现验证码时报错，增加用户手动验证
 2024-11-01 23:09:01 +08:00
Relakkes ef4eba121c fix: 兼容windows编码问题 2024-10-28 15:26:49 +08:00
Relakkes 9bf6ea3650 docs: update README.md 2024-10-24 18:18:53 +08:00
Relakkes 6a96c00b4b chore: config update & xinqqiu img update 2024-10-24 15:35:34 +08:00
程序员阿江(Relakkes) 5a27ad089c Merge pull request #462 from FloRainRJY/xiaohongshu_comment_number_restrict 
All_platform_comments_restrict
 2024-10-24 15:31:13 +08:00
程序员阿江(Relakkes) 0cd01fbf8c Merge pull request #463 from liugangdao/main 
fix:翻页时search id不变
 2024-10-24 15:13:05 +08:00
程序员阿江(Relakkes) fa2bcc4181 Merge pull request #461 from FloRainRJY/xiaohongshu_comment_number_restrict 
feat: xhs增加最大评论数量限制
 2024-10-23 13:35:10 +08:00
Relakkes 0bb9298d26 docs: 添加捐赠名单 2024-10-21 21:17:28 +08:00
Relakkes dc11d39185 docs: update README.md 2024-10-20 01:05:57 +08:00
Relakkes 03e393949a fix: xhs帖子详情问题更新 2024-10-20 00:59:08 +08:00
Relakkes 9fe3e47b0f chore: 增加代码学习声明，严格禁止非法、禁止商业、不当用途 2024-10-20 00:43:25 +08:00
程序员阿江-Relakkes ac8537c296 Update LICENSE 2024-10-18 03:27:00 +08:00
Relakkes aa0f920369 feat: B站搜索接口增加发布日期筛选 2024-10-17 15:11:25 +08:00
Relakkes fa1932e105 docs: 添加14群交流二维码 2024-10-17 14:54:06 +08:00
Relakkes 96508fb050 docs: 知乎支持创作者主页数据 2024-10-16 21:03:06 +08:00
Relakkes da8f1c62b8 feat: 知乎支持创作者主页数据爬取(回答、文章、视频) 2024-10-16 21:02:27 +08:00
Relakkes af9d2d8e84 docs: update Sponsor 2024-10-10 11:28:37 +08:00
Relakkes 9046074909 docs: update README.md 2024-09-28 12:48:43 +08:00
Relakkes 7b5b099636 feat: update douyin abogus params 2024-09-27 14:58:10 +08:00
Relakkes 17e70ac2c1 chore: update ads wrong text 2024-09-26 15:41:32 +08:00
Relakkes 340926bcd3 chore: add vitepress doc custom theme 2024-09-26 15:38:18 +08:00
Relakkes 4e10e65216 docs: 增加捐赠名单 2024-09-25 10:42:00 +08:00
Relakkes 0fac56ce50 docs: add google analytics 2024-09-20 19:18:48 +08:00
Relakkes 52fe281f2f docs: update README.md 2024-09-20 15:57:06 +08:00
Relakkes c6a0960f54 docs: 在线文档添加捐赠者名单 && 添加新增捐赠者 2024-09-19 17:25:41 +08:00
Relakkes fa4238e794 docs: fix vitepress config 2024-09-19 17:06:50 +08:00
Relakkes 6bc55a8124 docs: fix image format error 2024-09-19 17:03:55 +08:00
Relakkes d256337b6a docs: 在线文档support & 知识付费栏目汇聚 2024-09-19 16:54:19 +08:00
Relakkes f8881dba74 docs: add Sponsors 2024-09-18 15:45:01 +08:00
Relakkes 21e0d8f393 fix: 修复知乎搜索关键词bug，相关的issue #435 2024-09-13 16:01:34 +08:00
程序员阿江-Relakkes b1966478ba Merge pull request #433 from NageNalock/dicey_dev 
fix: lost pyexecjs dependecy in requirements.txt
 2024-09-08 19:59:50 +08:00
Relakkes e091827a77 feat: 知乎支持（关键词、评论） 2024-09-08 00:02:18 +08:00
Relakkes b7e57da0d2 feat: 知乎支持（关键词、评论） 2024-09-08 00:00:04 +08:00
Relakkes 131b5697d5 docs: update README.md 2024-09-06 16:29:12 +08:00
Relakkes 8ababf0018 docs: update README.md 2024-09-05 23:12:49 +08:00
Relakkes 2c273ec9f8 docs: update README.md 2024-09-05 23:12:49 +08:00
程序员阿江-Relakkes fd60e0f4a6 Merge pull request #427 from seek4/main 
fix: json内容保存格式优化，支持缩进
 2024-09-04 11:27:18 +08:00
Relakkes dad20baade docs: remove sponsors 2024-09-03 10:04:34 +08:00
Relakkes 6dd3420743 fix: #423 2024-09-02 22:57:28 +08:00
Relakkes d6fb255bdf fix: xhs note detail error 2024-09-02 21:45:12 +08:00
程序员阿江-Relakkes 00b12ce482 Update README.md 2024-08-28 18:06:11 +08:00
Relakkes 4e429341e9 docs: update README.md 2024-08-28 17:54:35 +08:00
Relakkes Yang da12df7113 docs: update README.md 2024-08-24 11:06:11 +08:00
Relakkes Yang acb29add28 feat: 百度贴吧支持创作者主页帖子爬取 2024-08-24 11:03:23 +08:00
Relakkes 8adb593ba6 temp commit 2024-08-24 09:12:03 +08:00
Relakkes 65699aa1cb feat: xhs支持获取评论的点赞数量 2024-08-24 06:07:33 +08:00
Relakkes ab7d8142af feat: weibo支持指定创作者主页 2024-08-24 05:52:11 +08:00
Relakkes 61f023edac docs: update README.md 2024-08-23 17:11:16 +08:00
Relakkes c70bd9e071 feat: 增加搜索词来源渠道 2024-08-23 08:29:24 +08:00
Relakkes d3c5111985 docs: 添加捐赠者名单 2024-08-21 19:59:35 +08:00
Relakkes 9107a8a091 docs: update README.md 2024-08-20 17:28:12 +08:00
Relakkes 04cbe549af fix: 修复抖音关键词搜索bug 2024-08-20 03:09:42 +08:00
Relakkes 2ab14920a3 docs: update README.md 2024-08-19 18:38:52 +08:00
Relakkes d39f862f85 docs: update README.md 2024-08-17 22:47:21 +08:00
Relakkes ab3e8dcc9c docs: update README.md 2024-08-13 06:44:42 +08:00
Relakkes 01ea4cd543 fix: 解决IpInfoModel循环导入依赖问题 2024-08-12 00:14:50 +08:00
Relakkes c8dd40d547 docs: update README.md 2024-08-11 23:54:36 +08:00
Relakkes e318b4c648 docs: update README.md 2024-08-11 23:48:19 +08:00
Relakkes f371675d47 fix: xhs指定笔记ID获取方式增加解析html方式，原来的由于xsec_token导致失效 2024-08-11 22:37:10 +08:00
Relakkes ec47c230a9 feat: jieba日志调整为warning级别 2024-08-09 18:12:15 +08:00
Relakkes a599916d31 fix: add parsel package 2024-08-08 18:21:33 +08:00
Relakkes e7c6c57aa6 fix: kuaishou store not implement store_creator 2024-08-08 16:36:33 +08:00
程序员阿江-Relakkes a10cdcf474 Merge pull request #374 from NanmiCoder/feature/baidu_tieba_20240805 
feat: MediaCrawler支持百度贴吧
 2024-08-08 14:24:58 +08:00
Relakkes 62ac454639 Merge branch 'main' into feature/baidu_tieba_20240805 2024-08-08 14:21:59 +08:00
Relakkes 3f42368c02 feat: 百度贴吧done 2024-08-08 14:19:32 +08:00
Relakkes df0f5c1113 feat: 百度贴吧子评论done 2024-08-07 04:13:15 +08:00