all-news-project / server Goto Github PK

Add scraping component class via requests using BeautifulSoup library,
The goal is to have also the web driver and requests scraping - parent class for both needed that each of them are inheritance it.

Branch name: 1.0.0-250523_create_base_for_scraper_integration

Switch to the branch: 1.0.0-070323-add-models-code and go the file: nlp_models/temp,
Extract the code in the file to .py files and order it in class with two methods, add tests

1. Move logger, db_driver to server_utils
2. Separate db_river/db_objects to server_utils

Branch name: 1.0.0-190523-add-first-api-code

Open a new branch from 1.0.0, called it in the format: 1.0.0-DDMMYY-text...

• for example, if today is 23/01/2023 and I'm adding the logger code, my branch name will be: 1.0.0-230123-adding-logger-code

Implement in mongodb_utils.py the methods:

1. delete_many
2. update_one
3. update_many
4. count
5. exists
6. get_many

• look at the interface to understand what the methods do or ask me if you need
• look how I have implemented the other methods and try to keep it in the same code formats

after done, open a merge request into 1.7.0 and assign me