Final project for INF558
For NYTIMES crawler, NYTIME Article Search API is helpful for crawling articles. Node.js code is implemented to save data. npm will be needed for running code.
$ npm install
$ node nytimes_crawl.js
- For some country name with a comma, e.g. Korea, South, I added nationality name fo allCountryNames.txt manually. (All these countries will be printed out after country_aggregate.py is executed.)
- NLTK: Bird, Steven, Edward Loper and Ewan Klein (2009), Natural Language Processing with Python. O’Reilly Media Inc.
- Country Name
- Nationality Name