This package is meant to ease crawling video sources: from retrieving relevant metadata, scraping links given your keywords, to downloading for your input datasets.
This project is tested on Ubuntu 18.04 and run with Python 3.6.9. Preferably use a virtualenv Instructions to install and use virtualenv here.
git clone https://github.com/juannat95/video-crawler.git
virtualenv env
source env/bin/activate
pip install -r requirements.txt
python scrape_youtube_meta.py --input ./sample/youtube_list.csv --output ./sample
- Retrieve basic metadata: Title
- Retrieve more advanced metadata (part I): Views, Likes, Dislikes
- Retrieve more advanced metatada (part II): Hashtags, Description
- Scrape video links based on user's own keywords
- Download and manipulate videos if given links
Please open an issue for support.