Real State Spider is a Python-based web scraper and crawler designed to extract data from multiple real estate websites in Brazil. It provides users with structured data (e.g., CSV files) for analysis, research, and other purposes.
The tool is perfect for real estate developers, investors, and analysts who want to stay up-to-date with the latest market trends and explore new investment opportunities. With its powerful features, the Real State Spider can extract data from various websites, saving you time and effort while delivering accurate and comprehensive results.
- Extracts data from multiple real estate websites in Brazil
- Stores data in a structured format (e.g., CSV files) for analysis or research purposes
To run Real State Spider, you need to install the following dependencies:
- Python 3.9
- bs4 0.0.1
- requests 2.28.2
- selenium 4.8.2
- logging 0.4.9.6
If you're interested in contributing to the development of Real State Spider, you'll need to install these dependencies:
- pytest 7.2.2
- coverage 7.2.2
- pytest-cov 4.0.0
- autopep8 2.0.2
1 - Clone the repository
git clone https://github.com/jguilhermemv/brazilian-real-state-scraper.git
2 - Install the required dependencies using Poetry a Python package and dependency manager
poetry install
python main.py
José Guilherme - https://www.linkedin.com/in/jguilhermemv/
Real State Spider is licensed under the MIT License.