Git Product home page Git Product logo

pulsepoint-data-analytics's Introduction

PulsePoint Data Analytics

Made with Jupyter Binder Open in Visual Studio Code Kaggle nbviewer Open in HTML

Summary

In this project I performed data cleaning & preprocessing, feature extraction, extensive geospatial and time series analysis of the Pulsepoint Emergency Data as well as apply some clustering and dimensionality reduction techniques.

Please check Project Wiki for an in depth overview

Dataset

PulsePoint offers a web client at web.pulsepoint.org that allows users to view the same data that appears in PulsePoint Respond with a browser.

The dataset was collected via web scraping using python libraries (selenium, postgreSQL). The logs were collected from 2021-05-02 to 2021-12-31.

NB: As per the copyright policy held by https://web.pulsepoint.org see more - https://www.pulsepoint.org/eula "The PulsePoint app and its data are available to users for their own personal use and cannot be redistributed", Hence I am not intending to publish the dataset

With this data, it is possible to assess the impact of local emergencies over the period as well as the regions where they were concentrated.

The project answers questions which could be inferred from this dataset, such as:

Location-based:

  • What are the major incidents in terms of numbers?
  • What are the major states and cities in terms of the number of incidents?
  • Which regions have the highest number of incidents?

Time-based:

  • Which dates have a higher number of incidents occurred?
  • Which days of the week have a higher number of incidents occurred?
  • Which time of the day has a higher number of incidents occurred?

Analysis:

  • Find geolocations of the major locations
  • Visualize major locations taking the number of incidents that occurred at those regions into account
  • Cluster cities based on the time, duration, and the number of incidents that occurred at those places

This project also serves as my assignment for the course -

Also, you can view this notebook on kaggle -

Preview -




Built With

tqdm==4.62.3
wordcloud==1.5.0
geopy==1.17.0
plotly==4.4.1
folium==0.8.3
geopandas==0.10.2
pdpipe==0.0.70
yellowbrick==1.3.post1
scikit-learn==0.22.2.post1

pulsepoint-data-analytics's People

Contributors

ahmedshahriar avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

Forkers

tanjimanasreen

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.