giorgosera / pythia Goto Github PK

Python 13.43% C 61.98% C++ 20.89% Makefile 0.24% CSS 2.53% JavaScript 0.92%

pythia's Introduction

For more info contact [email protected]

pythia's People

Contributors

Stargazers

Watchers

Forkers

erogol malab aurora1625 kiran9k blade091shenwei fyhe8082 agasani chrisemoulton nihaofuyue0617 tyler-po

pythia's Issues

Improve the algorithm for sentiment.

Currently we use Alchemy. Too slow and RUBBISH. Perhaps use ur own trained classifiers with nltk

Implement centroid based summarizer

Problem with jpeg support in PIL

How to fix:

Uninstall PIL
sudo apt-get install libjpeg-dev libpng-dev zlib1g-dev liblcms1-dev python-dev
$ cd jpeg-8c
$ ./configure --enable-shared
$ make
$ make instal
lnstall PIL again

More info:
http://ygamretuta.me/2011/05/27/install-pil-in-ubuntu-natty-python27-virtualen/

EDIT:
A MUCH BETTER APPROACH IS
1/ Call 'pip install -I pil --no-install' to download and unpack the PIL source into your build directory;
2/ Get into your build directory and edit setup.py;
3/ Find the line that says 'add_directory(library_dirs, "/usr/lib")' (line 214 here);
4/ Add the line 'add_directory(library_dirs, "/usr/lib/i386-linux-gnu")' afterwards;
5/ Call 'pip install -I pil --no-download' to finish the installation.

Implement user classification

Visualize topic growth

Implement evaluation framework

Consider adding porter stemming to improve clustering

Next session

--> I added a threshld value in online clustering. Find out what the best value is
--> Add tests for online clustering. Suspicion of documents getting lost.
-->

Implement breadth first search to find all followers

See book example

Document experiments

What's next with visualizations

First of all after implementing LexRank we would be able to show either the top tweets or a text summary of what happened. Put this summary either on the left hand side of the timeline or right below.

Then we have to create the main timeline with the most important events. Coding this will be challenging but you are awesome so don't worry! And you have D3.js by your side.

Then prettify the timeline (shades and stuff)