zzzz0zzzz / py-spider-for-wechat Goto Github PK

1. 可以增加一个feature: 按照时间段下载公众号上的文章？作者觉得呢？
2. 可以增加一个feature: 多个公众号同时抓取

ps: 作者的代码写的清晰简洁易懂，不过ui部分暂时还没细看，正好在帮朋友做这个公众号抓取的事情，作者的代码真是雪中送炭啊！感谢感谢！

🥰💞

https://github.com/Zzzz0zzzZ/py-spider-for-wechat/blob/dadd15caa56de74ea034deb1edbee147a129cacf/utils/getAllUrls.py#LL30C15-L30C15

请求间隔 2s 测试不会触发风控么, 我自己测试会报错

err_msg: "freq control", ret: 200013

0%| | 0/1 [00:02<?, ?it/s]
Traceback (most recent call last):
File "C:\D\brandnew\sys\各种杂务\公众号排查\py-spider-for-wechat-master\main.py", line 64, in run
run_getAllUrls(
File "C:\D\brandnew\sys\各种杂务\公众号排查\py-spider-for-wechat-master\utils\getAllUrls.py", line 83, in run_getAllUrls
title, link, update_time = getAllUrl(page_num=page_num, start_page=page_start, fad=fad, tok=tok, headers=headers)
File "C:\D\brandnew\sys\各种杂务\公众号排查\py-spider-for-wechat-master\utils\getAllUrls.py", line 34, in getAllUrl
for i in dic['app_msg_list']: # 遍历dic['app_msg_list']中所有内容
KeyError: 'app_msg_list'