Git Product home page Git Product logo

gksingh17 / immigration-sentiment-analysis Goto Github PK

View Code? Open in Web Editor NEW
2.0 0.0 0.0 91.25 MB

Multi-module project to perform sentiment analysis on Irish Immigration using ML and NLP techniques.

License: MIT License

JavaScript 4.17% Python 1.45% PureBasic 1.37% HTML 0.03% Jupyter Notebook 92.90% Dockerfile 0.08%
cnn docker flask goemotions kafka lstm machine-learning nlp python reactjs github-actions d3js material-ui

immigration-sentiment-analysis's Introduction

Irish Immigration Sentiment Analysis

In today's digital age, where platforms like YouTube serve as both entertainment hubs and windows into public sentiment, our project delves into the intricacies of immigration in Ireland. Using cutting-edge NLP models, we dissect sentiments from YouTube comments in near real-time, offering nuanced insights beyond the positive vs. negative spectrum. By annotating Irish-specific immigration videos, our approach equips policymakers and analysts with a deeper understanding of evolving narratives, demonstrating its potential in addressing complex societal challenges in our ever-evolving digital landscape.

Installation

Running Backend Services Using Docker in VSCode (Windows User)

Requirements:

  1. Install WSL extension in VSCode and then open the project in wsl mode(Short cut : CTRL+SHIFT+P) img.png

  2. Verify the docker is using wsl and is enabled in settings img_1.png

Commands:

Open the terminal for root folder (Irish-Immigrations-Study-with-ML) in VSCode and type the following commands

  1. docker-compose build
  2. docker-compose up

Sending Requests:

  1. Sample postman Request for Data Service: img_2.png

Url : http://localhost:8001/comments

Sample Request JSON: { "url": "https://www.youtube.com/watch?v=bsWZF7g2R-Q", "commentcount": 10, "jobid": "4b0ceaf1-704c-465e-bb6a-93e7d1bf8aow", "modelid": 1 } 2. Preprocessing Service:

img_3.png

Url : http://localhost:8002/api/preprocess

Sample Request JSON: { "jobID": "4b0ceaf1-704c-465e-bb6a-93e7d1bf8aow", "model_id": 1 }

  1. NLP Service:

img_4.png

Url: http://localhost:8003/api/callmodel

Sample Request JSON: { "jobID": "4b0ceaf1-704c-465e-bb6a-93e7d1bf8aow", "model_id": 1 }

Running Backend Services Without Docker (Windows User):

Note: Changes Done in this section are for local testing and should not be merged with main branch.

Stop all the containers if running because they are all mapped to their respective ports in the localhost. Then before running the services locally please change the container name to localhost in the URLs used in code to call the other services.

For example the YTComment.py the hostname in post call to preprocessing_script must be changed. e.g. preprocess_url = 'http://localhost:5002/api/preprocess' . Perform these changes in urls used for calls in other services as well.

Usage

usage_1.jpeg usage_2.jpeg usage_3.png

Tests

Configuration

To check the existing configuration used for running test cases go through main.yml file in .Github/workflows

Test Requirements

Please mention the requirements to execute your testcases in requirements-test.txt file

immigration-sentiment-analysis's People

Contributors

aditya696 avatar babyjosemon avatar gksingh17 avatar kagdegrishma avatar prateek-dash avatar vincentwang1024 avatar

Stargazers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.