17 Commits

Include renames

Author	SHA1	Message	Date
程序员阿江(Relakkes)	0c5f281212	fix: 避免复用浏览器时跨域 Cookie 过长导致请求失败 ... 连接已有 Chrome 会把整个浏览器上下文的 cookie 带入平台 client。 除 xhs 外，多数平台仍直接读取全量 cookies，导致请求头过长并放大跨域污染。 本次将各平台的 cookie 读取统一收口到平台域名，并补上基础回归测试。 Constraint: 必须继续复用用户真实浏览器里的平台登录态 Rejected: 仅修复 xhs | 其他平台在连接已有浏览器时仍会携带超长 Cookie Confidence: high Scope-risk: moderate Reversibility: clean Directive: 后续新增平台或调整 update_cookies 和 create client 流程时，只按平台域名读取 cookies Tested: uv run pytest test/test_utils.py; python3 -m compileall tools/crawler_util.py media_platform/douyin/core.py media_platform/douyin/client.py media_platform/kuaishou/core.py media_platform/kuaishou/client.py media_platform/bilibili/core.py media_platform/bilibili/client.py media_platform/zhihu/core.py media_platform/zhihu/client.py media_platform/tieba/core.py media_platform/tieba/client.py media_platform/xhs/core.py media_platform/xhs/client.py media_platform/weibo/core.py media_platform/weibo/client.py test/test_utils.py Not-tested: 各平台在真实 CDP 浏览器连接下的端到端抓取流程	2026-04-21 13:49:37 +08:00
程序员阿江(Relakkes)andClaude Opus 4.5	157ddfb21b	i18n: translate all Chinese comments, docstrings, and logger messages to English ... Comprehensive translation of Chinese text to English across the entire codebase: - api/: FastAPI server documentation and logger messages - cache/: Cache abstraction layer comments and docstrings - database/: Database models and MongoDB store documentation - media_platform/: All platform crawlers (Bilibili, Douyin, Kuaishou, Tieba, Weibo, Xiaohongshu, Zhihu) - model/: Data model documentation - proxy/: Proxy pool and provider documentation - store/: Data storage layer comments - tools/: Utility functions and browser automation - test/: Test file documentation Preserved: Chinese disclaimer header (lines 10-18) for legal compliance 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2025-12-26 23:27:19 +08:00
程序员阿江(Relakkes)	6eef02d08c	feat: ip proxy expired check	2025-11-25 12:39:10 +08:00
程序员阿江(Relakkes)	ff8c92daad	chore: add copyright to every file	2025-11-18 12:24:02 +08:00
yt210	ef6948b305	新增存储到mongoDB	2025-11-06 10:40:30 +08:00
程序员阿江(Relakkes)	03e384bbe2	refactor: cdp模式下移除stealth注入	2025-10-19 15:32:03 +08:00
程序员阿江(Relakkes)	2bce3593f7	feat: support time deplay for all platform	2025-09-02 16:43:09 +08:00
未来可欺	0b81240aed	升级 httpx 版本至 0.28.1，并修改关键字参数 proxies 至 proxy	2025-07-31 22:48:02 +08:00
korruz	07a6e387ea	refactor: move format_proxy_info to utils and update crawler classes to use it	2025-07-29 14:16:24 +08:00
程序员阿江(Relakkes)	13b00f7a36	refactor: config update	2025-07-18 23:26:52 +08:00
gaoxiaobei	b913db64bb	refactor(config): move platform-specific configs to separate files ... - Remove platform-specific configurations from base_config.py - Create separate config files for each platform in their respective directories - Update import statements in core files to use new platform-specific config modules - Clean up unused and deprecated configuration options	2025-07-18 17:27:37 +08:00
程序员阿江(Relakkes)	848df2b491	feat: other platfrom support the cdp mode	2025-07-03 17:13:32 +08:00
Relakkes	ea5223c708	feat: 知乎支持详情模式	2024-12-26 17:36:33 +08:00
Relakkes	9fe3e47b0f	chore: 增加代码学习声明，严格禁止非法、禁止商业、不当用途	2024-10-20 00:43:25 +08:00
Relakkes	da8f1c62b8	feat: 知乎支持创作者主页数据爬取(回答、文章、视频)	2024-10-16 21:02:27 +08:00
Relakkes	21e0d8f393	fix: 修复知乎搜索关键词bug，相关的issue #435	2024-09-13 16:01:34 +08:00
Relakkes	b7e57da0d2	feat: 知乎支持（关键词、评论）	2024-09-08 00:00:04 +08:00