Git Product home page Git Product logo

twitter_collector's Introduction

Twitter Collector

Ruby + Datamapper based utility for collection of Twitter Friend and/or Follower data. Leverages a Token Pool (which requires additional work to gather tokens) and is controlled by Rake. Obeys rate limits. Utilizes the Ruby Twitter gem

In addition to data collection you can also create Node and Edge files for Graph Analysis via software such as Gephi.

Setup

In the Twitter Developers Portal you need to create an app and get the credentials required to run read only application.

Create a secrets.rb file and fill it with the following content which you received via the Twitter Developer Portal

APP_NAME = 'AnyThingYouWantAlsoDBName'
DATA_FILE = './data/accounts.txt'
CONSUMER_KEY = '3.141592653589793238462643'
CONSUMER_SECRET = '3.141592653589793238462643'

SAMPLE_TOKEN = '3.141592653589793238462643'
SAMPLE_SECRET = '3.141592653589793238462643'

Basic Usage

bundle exec rake bootstrap 			# Create db
bundle exec rake load_data 			# load a file of twitter handles to collect data on
bundle exec rake fetch_friends 		# fetch friend data of predefined twitter handles
bundle exec rake fetch_followers 	# fetch follower data of predefined twitter handles
bundle exec rake export_data 		# write out Node and Edge files

LICENSE

Copyright (c) 2010 MJFreshyfresh and distributed under the MIT license.

twitter_collector's People

Contributors

mjfreshyfresh avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.