Comments (9)
Makiras
commented on September 20, 2024
1
快递鸟有一个看上去很成熟的Python lib了，如果让用户自行部署的话，每天3000的API量，每5min查询一次能支撑10单。（而且写起来应该也比较方便？）
from expressbot.
BennyThink
commented on September 20, 2024
@Makiras
看起来这个库还不错，不知道获取快递鸟的API Key是否会比较麻烦，如果比较简单的话，可以看看更换为它，当然有个PR更好了
from expressbot.
Makiras
commented on September 20, 2024
我正在用selenium尝试做m.kuaidi100.com的页面模拟爬取，速度可能比较慢，但是支持顺丰
不过因为996所以可能还需要半个月（如果需要的话）到那时候再提PR
不过这样就要求有Firefox前置用于headless模式的爬取..
from expressbot.
BennyThink
commented on September 20, 2024
Excellent! @Makiras
from expressbot.
Makiras
commented on September 20, 2024
@BennyThink 爬取工具，不过因为是模拟爬取所以开启时可能比较耗资源，目前我的测试中还没碰到需要验证码的地方，最近比较忙所以PR就咕咕咕了。能爬顺丰，大佬有时间适配一下吧。
from expressbot.
BennyThink
commented on September 20, 2024
用selenium的话，那其实很重量级了，还要有webdriver，比如phantomjs或者headless Chrome…
Makiras <[email protected]>于2019年8月23日 周五下午7:54写道：
@BennyThink <https://github.com/BennyThink> 爬取工具
<https://github.com/Makiras/selenium_kuaidi100>
，不过因为是模拟爬取所以开启时可能比较耗资源，目前我的测试中还没碰到需要验证码的地方
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#8>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/ADLABACLYUBTWCNQXJRCTJLQF7FXPANCNFSM4HFXESNQ>
.
--
-Talk is always cheaper than code.
from expressbot.
Makiras
commented on September 20, 2024
我是用firefox的headless实现的，峰值内存占用能控制在100m，cpu会在初始化浏览器时跑满，但请求页面没啥太大变化。似乎也不是太重量？
（其实是需要一个firefox + driver(6m)）
如果是每个人部署在各自的机子上似乎也不是不能接受？毕竟浏览器只在查询的时候占用资源，其他时候都是关闭状态
from expressbot.
BennyThink
commented on September 20, 2024
100M内存很珍贵了😂🤓
Makiras <[email protected]>于2019年8月24日 周六上午2:27写道：
我是用firefox的headless实现的，峰值内存占用能控制在100m，cpu会在初始化浏览器时跑满，但请求页面没啥太大变化。似乎也不是太重量？
（其实是需要一个firefox + driver(6m)）
如果是每个人部署在各自的机子上似乎也不是不能接受？毕竟浏览器只在查询的时候占用资源，其他时候都是关闭状态
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#8>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/ADLABAAFPOSQBHXRMX2A773QGATXRANCNFSM4HFXESNQ>
.
--
-Talk is always cheaper than code.
from expressbot.
Makiras
commented on September 20, 2024
(:з」∠)，我再试试用execujs做下，因为做的反爬比较恼人orz
from expressbot.
Related Issues (6)
- 关于被加密的视频文件 HOT 10
- ubuntu 16.04使用脚本无法安装 HOT 11
- 请问可否支持docker？ HOT 2
- 希望能增加对圆通快递搜索的支持
- 快递100接口请求限制问题 HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from expressbot.