Requires python3 and beautifulsoup4, selenium, webdriver-manager libraries.
pip install beautifulsoup4
pip install selenium
pip install webdriver-managerClone the repository.
git clone https://github.com/M0nero/scrapper.git
cd scrapperProvide proper path to the file where data will be saved. You need to edit test.py file. In my case it is:
sys.path.insert(0, '/Users/gorda/Desktop/PyProjects/scrapper/src')# after installing the project and changing path
cd scrapper\test
python test.pythe grab method has two arguments: cryptocurrency and the number of last news
sc = Scrapper()
sc.grab("bitcoin", 2)the grab method returns a list of dictionaries with the following keys: title, paragraph, source and time
[{'title': 'Why Bitcoin, Ethereum and Dogecoin Surged This Week', 'paragraph': 'Major coins increased in value this week. ', 'source': 'Decrypt', 'time': 'an hour ago'}, {'title': 'Why This Executive Predicted Bitcoin Will Be Legal Tender In 5 Countries By 2022', 'paragraph': 'Bitcoinist has followed closely the rollout of The Bitcoin Law in El Salvador. Via the National Congress, this country gave BTC the status of legal tender, the implications of this action are still under scrutiny but point toward a new phase of adoption for the crypto industry. R...', 'source': 'Bitcoinist.com', 'time': 'an hour ago'}]
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent