Comments (5)
You're right, adding a 5 sec sleep will be slow.
It's a good idea for adding a condition to check weather next page is contact support and if it found support page it sleep for 5 sec.
from stardox.
Can you share the Repository address and output data (if possible) ?
from stardox.
I fixed this problem, I found when I visit the website frequently, and 40th page prompts 'Contact Support', so it cannot find the 'Next' page(src/stardox.py line 134).
I add the code on line 130:
time.sleep(5)
and it fixed.
BTW, the Repository address: https://github.com/milvus-io/milvus
Welcome to star it.
from stardox.
I checked your commit shiyu22@1b7bea8 .
Don't you think that adding a 5 sec sleep every time will make it slow.
If you are sure that contact page appears only after 40 ( or after multiples of 40) then adding a condition and doing time.sleep() after 40 is a good option rather sleeping for every next.
Else i add a condition to check weather next page is contact support and if it found support page it sleep for 5 sec.
What do you say ?
from stardox.
Great..!!
Thanks for coming up with the issue. I will push a commit very soon.
from stardox.
Related Issues (20)
- getting numbers wrong HOT 3
- bypassing Github limitations HOT 9
- Restructuring stardox code
- Re-writing command line arguments code. HOT 2
- Use PEP-8 code formatting HOT 3
- cannot get the first stargazer's info HOT 1
- Fetch stargazer's bio and location along with other details HOT 2
- Search profile information using username HOT 6
- adding more attempts for Entering correct infomation HOT 8
- Use a vitual environment for the application HOT 2
- Restructuring to add new arguments HOT 1
- Details of the contributors of a repository HOT 1
- Replace Example images with example images with new logo HOT 6
- Fix Typos and Minor Grammar Issues in README HOT 1
- Logging all the errors in a file
- Using only 'owner/repo-name' format instead of entire link HOT 1
- BeautifulSoup name error HOT 1
- list index out of range HOT 3
- Export Limit to 1201 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from stardox.