Git Product home page Git Product logo

stackoverflow-tag-prediction's Introduction

Stack Overflow: Tag Prediction

This ipython notebook is developed to predict as many tags as possible for questions posted on StackOverflow by applying differnt machine learning algorithm. A step by step analysis has been done on the data provided in the Kaggle. Based on the data provided, the machine learning model predicts the tags like(C#, Java etc) for each question.

Data Source:https://www.kaggle.com/c/facebook-recruiting-iii-keyword-extraction

Data Dictionary

  • Title,
  • Body,
  • Tags

With the provided data, we will first clean the data to get data in required format followed by exploratory data analysis.

Featurizing is one of the most important steps for building machine learning model. We will use TF-IDF to convert text into vector.

Since the dimension of input vector is high, we will be using linear multilevel classification algorithm to predict the tags. We will be applying different multilevel classification model having optimized hyperparameter.

  • Logistic Regression with GridSearch
  • XgBoost classifier with Random search

For testing the result we will use

  • Micro f1 scoore
  • Macro f1 scoore
  • Hamming loss

Objective: redict the Tag based on the text present in question posted using different classification technique with high precision and recall.

This project is developed with the help of videos and basic code provided by appliedaicourse.com.

stackoverflow-tag-prediction's People

Contributors

nitinakash1989 avatar

Watchers

James Cloos avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.