Git Product home page Git Product logo

disaster-response-pipeline's Introduction

Disaster Response Pipeline Project

demo.mp4

Table of contents:

  1. Installation
  2. Project Description
  3. File Descriptions
  4. Instructions
  5. Licensing, Authors, and Acknowledgements

Installation

run pip install -r requirements.txt to install all required libs.

The code should run with no issues using Python versions 3.*.

Project Description

This projects aims to build a model for an API that classifies disaster messages, so that they can be sent to the appropriate disaster relief agency.

When a disaster happens is when the agencies are flooded with messages and it's also when they have the least capacity to deal with it.

The goal is to speed up the process of recognizing important messages and redirecting them correctly.

This project is composed of the following steps:

  1. Take real data from tweets and text messages sent during real life disaster events;
  2. Prepare this data with an ETL Pipeline;
  3. Build a Machine Learning Pipeline to classify new messages on future disaster events so that the messages can be sent to the appropriate disaster relief agency.

This project includes a web app where an emergency worker can input a new message and get classification results in several categories.

File Descriptions

Below are additional details about the project structure:

  • /app : contains the Flask webapp files.

  • /data : contains both .csv files used on the ETL pipeline as well as the process_data.py script that holds all the ETL pipeline and the .db result from the ETL pipeline.

  • /models : contains the train_classifier.py script that holds the ML pipeline as well as the model pickle file.

  • /notebooks contains Jupyter Notebooks that were used to build both pipeline scripts.

Instructions

  1. Run the following commands in the project's root directory to set up your database and model.

    • To run ETL pipeline that cleans data and stores in database

      python data/process_data.py data/disaster_messages.csv data/disaster_categories.csv data/disastermanegement.db

    • To run ML pipeline that trains classifier and saves

      python models/train_classifier.py data/disastermanagement.db models/message_lr_classifier.pkl

  2. Go to app directory: cd app

  3. Run the web app: python run.py

  4. Go to http://localhost:3003/

Licensing, Authors, and Acknowledgements

Licensing

MIT license

Authors

Marina Villaschi

Acknowledgements:

Appen (formally Figure 8) for providing the pre-labeled data.

Udacity and all staff involved for the great guidance and quality course material provided during the Data Science Nanodegree Program.

disaster-response-pipeline's People

Contributors

marinavillaschi avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.