Created a CrawlSpider to extract products from https://venroy.com.au/
To run a crawler run this command from the root directory of the project:
scrapy crawl venroy_crawler
Creates a csv file with crawled data. Includes following fields:
- product_name
- colour (if multiple - splitted by ;)
- price
- image_urls (splitted by ;)
- description
To change a number of crawled products, set CLOSESPIDER_ITEMCOUNT from settings.py to another value.