Git Product home page Git Product logo

weibo's Introduction

SentimentAnalysisofWeibo

I used the sentiment dictionary to predict the sentiment of post scraped from weibo.cn, here we will have the following contents.

Contents:

a weibo scraper:

It can scrape the posts from weibo.cn. It will give you as many posts as possible that is related to the kwyword during the period(from starttime to end time)

a slapdash sentiment analysis:

  • i. It uses jieba to tokenize each posts, and can draw a very simple word cloud.
  • ii. It can do a simple sentiment analysis(but not rigorous) based on the sentiment dictionaries

About Tokenization:

I used the stopwords from Harbin Institute of Technology(HIT) and I also collect some other stopwords lists.

About sentiment analysis:

  • i. I don't have time to build a modle using the data, so I used the sentiment dictionary from BosonNLP sentiment scores, it is generated from weibo and news release, so I think it could be applicable.
  • ii. Due to the limited time, and I really wish to end this temporately for my two coming deadlines, I choose to suppose that the negative words and adverbs before a sentiment word is to modify the sentiment word, and the sentiment od the sentence is the summed up scores of each sentimentwords mutiply the modifying negative words and adverbs before them.
Note: this analysis is very slapdash, and I only upload these codes to record my learning process of python. And if this property in any ways invades your rights, please contact me.**

weibo's People

Contributors

iamacz avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.