ltflores / csc-869-mlog Goto Github PK
View Code? Open in Web Editor NEWAutomatically exported from code.google.com/p/csc-869-mlog
Automatically exported from code.google.com/p/csc-869-mlog
Change SentenceBasedTextDirectoryLoader and TextDirectoryLoader to ignore .svn
directory and contained files
Original issue reported on code.google.com by markus.neubrand
on 5 Apr 2011 at 11:50
Play around with different settings of the StringToWordVector:
- Different tokenizer
- Different stemmer
- Different stopword list or no stopword list
- Different min. word freq.
- Different num. of words to keep
- Different pruning
...
Document how each of those things influence the results.
Original issue reported on code.google.com by markus.neubrand
on 5 Apr 2011 at 11:58
Best would be to have some normal people => anybody personally knows people who
knows twitter and would be willing to share if they are rep./democrat?
Other possibility: Check out organizations whose members are strongly
affiliated with either republican or democrat (e.g. NRA, ...)
Original issue reported on code.google.com by markus.neubrand
on 6 Apr 2011 at 12:03
Implement different weighing schemes and try out the ones implemented in
StringToWordVector. E.g.:
- In-party-frequency / Total-frequency
- Higher/Lower weight of special attributes like #hashtag or @user
...
Original issue reported on code.google.com by markus.neubrand
on 6 Apr 2011 at 12:00
Exclude attributes added by the SentenceBasedTextDirectoryLoader.java like
democrats_03152011/JamesMcDermott or republicans_03152011/MarioDiaz-Balart from
the classification. Optionally just disable the generation of them as they're
not used at the moment anyways
Original issue reported on code.google.com by markus.neubrand
on 5 Apr 2011 at 11:53
As Lorenzo already did with J48 add new classifier to the app (SVM, kNN, ...)
and document the results
Original issue reported on code.google.com by markus.neubrand
on 5 Apr 2011 at 11:59
From Orens email:
one quick question, in the 10-fold cross validation, did we make sure
that there are no shared people between two sections? i mean, if we
just divide into 10 sections according to tweets, then we may have
tweet1 and tweet2 of the same congressmanA in two different sections.
in this case, we may get a good result in the cross validation simply
because the classifier can find similarity between tweets of
congressmanA (e.g. if tweet1 is in the verification section, and
tweet2 is in one of the 9 training sections, it may simply learn that
tweet1 and tweet2 are similar in language and we'll get a good
misleading score...).
This needs to be fixed by custom code to distribute.
Original issue reported on code.google.com by markus.neubrand
on 5 Apr 2011 at 11:55
Some classifier have an unacceptable runtime on the whole data set for fast
development (e.g. J48 = 12h on Lorenzos machine) => Implement a command-line
argument which cuts down the input size to speed up development
Original issue reported on code.google.com by markus.neubrand
on 6 Apr 2011 at 12:04
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.