A multi-threaded Pakistan Weather crawler written in JavaScript learn more at : https://lablnet.com/project/weather

The sole purpose of this project is to extract weather data from the Weather Channel and store it in a database for further analysis.

• Node.js 18.x or above

1. Clone the repository
2. Install dependencies using npm install or pnpm install
3. Copy .env.example to .env and update the values
4. Run the crawler using node main.js weather.com
   • The first argument is the website to crawl
   • You can add more crawlers; check the main.js file for more information

There is still a lot of work to be done, so feel free to contribute by opening a PR.

Contribution Guidelines

• MIT

• Web

• The script has been rewritten in Node.js to fix issues and update the structure. The Python version is available in the python_script folder but is no longer maintained.
• Python