Git Product home page Git Product logo

scrapetwitter's Introduction

Scrape Tweets by Searching Keywords using Snspcrape

This is a simple Tweet Search App built with python + snscrape module + Streamlit.

Streamlit App

I got tired of searching tweets using Twitter search and decided to build out a standalone app that I can query for keywords/phrases/hashtags/usernames...e.t.c. and subsequently download the data into a csv file for further custom analysis

FYI: This is roughly put together but does the job for what I needed.

The DataFrame UI community package by aggrid

Usage

  • The app is deployed on Streamlit here.
If you would like to customize it for your development purposes follow these steps(these are windows commands):
  • Clone this repo to your folder of choice:
  git clone https://github.com/tonykipkemboi/scrapeTwitter.git
  • Change directory into the folder:
cd scrapeTwitter
  • Create a python virtual environment:
python -m venv env
  • Activate virtual environment:
.\env\Script\activate
  • Install dependecies which are in the requirements.txt file:
python -m pip install -r requirements.txt
  • Now you are ready top run the program in your localhost:
cd app
streamlit run driver.py
  • The app will open in your browser. Feel free to play with the code and as you save changes, the app will update in real-time.

What Next?

  • Maybe make it a bit robust by adding unit tests and refactoring some of the code.
  • Add a page for querying tweets by user.
  • Create a dashboard after doing some analysis on mined tweets.

You can dm me on Twitter for collaboration or just holla!

scrapetwitter's People

Contributors

tonykipkemboi avatar

Stargazers

 avatar  avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.