Web scraper that can help find the best flat! With a webscraper and a small front end to display the data.

So far the web scraper values are hardcoded to my preferences and only looking for Vuokraovi. A Finnish website. # VUOKRAOVI IS NOT OK WITH SCRAPING OUTSIDE OF PERSONNAL USE

I will switch to facebook groups since those can be scrapped.

I want to find good apartment in Helsinki area. And never liked the website I visited. And they expect me to know if an area is good or not.

Built with

• Puppeteer - Headless chrome to scrape the data
• Gatsby - As a simple front end
• Mapbox
• Grommet - React UI toolkit

And sklearn folium numpy pandas plotly matplotlib seaborn

A modern UI with relevant search.

COMING SOON Recommendation and good deals by making sense of the data

Web scraper:

npm install

Launch it

node app.js

Front:

Go to front folder

npm install

Add the result of your scraping in /data with the name data.json then launch

npm run develop

** Filter **

Run filter.js to remove useless or faulty properties.

I unfortunately lost my last version :(

So redo those :

• get the construction year with the scrapper
• add a time estimate for scrapping
• save the state before it fails. Web scraping is quite flaky so remember where you were when it failed so you start again from this point.
• better filter js and/or do the filtering in Python
• translate post code to ranking with https://pdfs.semanticscholar.org/2f08/25ddb17cf5ae4c47cbe1a4d33e64988830ae.pdf
• get the model back to 75 of accuracy
• list of most important features

Then next features could be:

• better interpretability
• store the model in an API