singhj / locality-sensitive-hashing Goto Github PK

A write up for the proposed architecture is now documented on the README page, for discussion when we meet today.

See you at Diesel in Somerville at 7:00 this evening.

Updated presentation by Teresa and J at Boston Data-con

read_tweepy.lsh_report() shows similarity by referring to the number of common buckets. A more accurate way would be to use Jaccard similarity instead.

Hi, I am a little bit confused about the project license. In the homepage http://openlsh.datathinks.org/, it says that this project applies MIT license, but in the license file, it says Apache License V2. Which one is correct? Is it possible to adapt the core lsh code to other language and reference your work?

Thanks!

Some of the LSH parameters are embedded in the Matrix constructor. They should be factored into settings.py.

The current implementation of FIFOQueue is based on in-memory structures. Since App Engine can spin up multiple server instances, those server instances will not share the memory and you have to give up on the asynchronous features.

We'll need to create a FIFOQueue version based on Task Queues. Another alternative is the Pipeline API but Task Queues seems simpler and more portable.

Hi,
I want to port the index and query module to C++. Could you please tell where can I find these two module in your code base?

Thanks

Hi,

I have never worked with python. My objective is to make your code work with excel or csv file, as I have some collected twitter messages to be clustered. I have encountered two problems:

1. when i tried to run the example data, there is no output anywhere, the command line finished execution. Then nothing happened. Where can I see the output?
2. I don't know what exactly is the desired data source should look like, from code it looks like some html file. So how exactly can I parse a xlsx file with two columns: twitter id, twitter text?

Thanks!