njuskalo.hr scraper that alerts when new ads matching given filters appear

pip3 install -r requirements.txt
python3 setup.py install

$ njuskalo-notifier --help

usage: njuskalo-notifier [-h] [-c CONFIG]

optional arguments:
  -h, --help            show this help message and exit
  -c CONFIG, --config CONFIG
                        path to config file

Specify in config_example.ini URLs you want to parse, email settings, pipelines...

To disable email notifications simply comment out line sniffer_scraper.pipeline.EmailPipeline = 400 By default SQLite database ads_dump.db is created with all parsed information.

njuskalo-notifier -c config_example.ini

Scheduled run can be achieved using bash command cron.

Run crontab -e and add something like:

# m h  dom mon dow   command
0 9,19 * * * /usr/local/bin/njuskalo-notifier -c path-config/config_example.ini >> log_output_dir/njuskalo.log 2>&1

Not tested on Windows - possible additional dependencies required. Should work using WSL (Windows Subsystem for Linux)