Git Product home page Git Product logo

scrape-twitter-json-to-html-table's Introduction

Scrape Twitter JSON to HTML Table


This script shows how to scrape your tweets by date or year using the opensource project Twint and turn it into a beautiful HTML table. No API key is required..


Twint: https://github.com/twintproject/twint

json2html: https://github.com/softvar/json2html


Video Usage Instructions on Awesome Dev Notes YouTube: https://youtu.be/042-QIhC5ms


Twitter Badge androiddevnotes GitHub badge


twint awesomedevnotes - androiddevnotes youtube thumbnail


filter.py: To filter out the JSON nodes. You can modify the script to remove the JSON data that is not required or add the ones you need.

jsonhtml.py: To convert the JSON data to HTML table. You don't need to modify this script to work.


Installing Twint

Make sure you have python and pip installed.

pip3 install --user --upgrade git+https://github.com/twintproject/twint.git@origin/master#egg=twint

Run Twint

Parameters are explained in the video or go to wiki

twint -u androiddevnotes --since 2020-05-20 --until 2021-03-01 -o twint_androiddevnotes.json --json

The output will be JSON data.

Watch the Video to see how to turn the above scraped Twitter JSON data to HTML table.

The video shows the usage of filter.py and jsonhtml.py


💻 Find us on

scrape-twitter-json-to-html-table's People

Contributors

androiddevnotes avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.