Comments (5)
Hi @Kittyuzu1207 , I think i solved this issue by updating the
get_followers
andget_following
functions toget_users_followers
andget_users_following
that can crawl following and followers for many users without the need to log in each time. You can check the example notebook.
Hi, thank you for this update! I had the same idea so I have already modified the source code so that I only need to log in once and get following of many users. It's nice of you to make this public. : )
from scweet.
Also, it sometimes mention"error with: xxx", still can get nothing.
from scweet.
Hi, thank you.
Actually I've never tried to scrape the followers of that much users before. I think the problem here i duo to the account you are using. I think Twitter have banned your account and you cant get access to user followers/following anymore. I'm working on a better method to scrape these kind of information (the accurate wait parameter to use ... ).
I guess one solution might be to create a new function that scrapes followers for many users. The main reason why Twitter may ban your account is logging in several times.
from scweet.
Hi, thank you.
Actually I've never tried to scrape the followers of that much users before. I think the problem here i duo to the account you are using. I think Twitter have banned your account and you cant get access to user followers/following anymore. I'm working on a better method to scrape these kind of information (the accurate wait parameter to use ... ).I guess one solution might be to create a new function that scrapes followers for many users. The main reason why Twitter may ban your account is logging in several times.
Hi, thank you for reply. When logging in the webpage of Twitter, the account works normally. I may register another account and retry it.
from scweet.
Hi @Kittyuzu1207 , I think i solved this issue by updating the get_followers
and get_following
functions to get_users_followers
and get_users_following
that can crawl following and followers for many users without the need to log in each time. You can check the example notebook.
from scweet.
Related Issues (20)
- env_path not a keyword argument for Scrape
- Option to pass custom driver when using with docker
- Get data from others tabs of twitter user account
- no such element HOT 2
- Your current API plan does not include access to this endpoint HOT 1
- 0 results from get_users_followers()
- Solved: attempted relative import with no known parent package
- Scrape not working? HOT 16
- is scweet able to scrape tweets by username?
- Scrape can't get anything HOT 8
- Scraper doesn't return any results
- getting empty data HOT 4
- No module named '__main__.utils'; '__main__' is not a package
- connect twetter
- How can I get the real reply of the tweet content?
- :Can not find chromedriver for currently installed chrome version. HOT 1
- WebDriver.__init__() got an unexpected keyword argument 'executable_path' HOT 3
- about limit of get_users_followers HOT 1
- Cant login into the account HOT 1
- disconnected: unable to connect to renderer
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from scweet.