bjin02 / si507-finalproject Goto Github PK

• Get Tumblr Post data from Tumblr websites via OAuth authentication, process the data to grab the required fields to generate the Post/Info data class instances.
• Store the raw data into files and setup a local file based caching system and it can support cache data expire.

• Implement the unit test class with unittest.TestCase which should have good test coverage of the project
  Test as much as possible to provide good code quality

• Setup the git repo and pushed the code, readme files to it

• Initial README file

• Initial python files like: SI507F17_finalproject.py and the SI507F17_finalproject_tests.py file finalproject.py will cover the data models, cache system, website data scraping system and the database connection utilization system. tests.py will cover all required unit tests.

• A requirements.txt file from your virtual environment

• Any .py or other file templates that we have to fill in. e.g. secret_data.py for the webiste API call credentials, .csv files for local caching etc.

You've reflected all the requirements and showing which visualization system you are interested in, but all other details about the project are missing, which makes it impossible to give feedback!

• Learn and use the library Plotly, which has a pretty clear Python API to create nice charts and graphs. https://plot.ly/python/
• Onboard the Plotly Dashboard API to visualize the Tumblr Post data in result of a dashboard that reflects the numbers of Posts in Bloggers, comparison of different Posts/Blogger Info.

• Implement the Info, Post data class to model the data
  The class should include a repr method that can descripe the Post/Info data
  And a contains method to check if the Post data contains some words in Summary
• Use this class definition for database models in your program
  Process the raw data to model the Post data into instances of the classes
• Connect to the database and get Info and Post database tables data
  Set up Info and Post database tables in a database, and store the data instances in them.

Database table data with these columns in each:

Info

id
followed
likes
total_posts	title
url
ask_page_title
name

Post

id
date
summary
format
short_url
can_like
can_reply
type
info_id

• Post table has the external key to the Info table. We can make JOIN query to these tables

• Setup the DB connection code to Connect, Insert, Update and Query the tables