Git Product home page Git Product logo

timothycarambat / senate-stock-watcher-data Goto Github PK

View Code? Open in Web Editor NEW
46.0 4.0 6.0 6.25 MB

Data repository of JSON files that are filed by US Senators on efdsearch.senate.gov where they must report their stock trades. This is the same data as on senatestockwatcher.com

Home Page: https://senatestockwatcher.com/

Python 100.00%
senate united-states senators investing insider-trading investment-analysis stock stock-market-data open-datasets us-data

senate-stock-watcher-data's Introduction

Senate Stock Watcher - Data Storage

https://senatestockwatcher.com

What is this?

Senate Stock Watcher is a web application that shows metrics and analytics for tickers, senators, and filings that are reported by US Senators, both current and present.

The data that is collected is originally sourced from The Ethical Financial Disclosure Office of the US Senate. We retain this data in a much more readable and concise format.

All files are available as YAML as well. data/transaction_report_for_MM_DD_YYY.json => data/transaction_report_for_MM_DD_YYY.json.yaml

All files with the exception of the following have the bioguide id available:

  • aggregate/all_ticker_transactions.*
  • aggregate/all_transactions.*

Structure

data/ - Contains the daily summaries as they are reported with a file naming convention of transaction_report_for_MM_DD_YYY.json. The structure is as follows:

[
//list of objects. Each object is a senator who filed that day - they can appear more than once if they filed twice that day.
  {
    "first_name": "John D",
    "last_name": "Fremont",
    "office": "Fremont, John D. (Senator)",
    "ptr_link": "https://efdsearch.senate.gov/search/view/ptr/xxx-xxxx-xxxxxxxx-xxxx/",
    "date_recieved": "01/03/2019",
    "transactions": [ // array of objects. each object is a transaction (or trade)
      {
        "transaction_date": "12/16/2016",
        "owner": "Spouse",
        "ticker": "--", // -- means the ticker is unknown. Otherwise is NASDAQ ticker
        "asset_description": "Sample Sam Corp",
        "asset_type": "Stock",
        "type": "Purchase",
        "amount": "$1,001 - $15,000", // dollar range reported
        "comment": "I bought this stock because I liked the name!"
      }, {...}]},
      {...}, //next senator
      {...} //last senator

aggregate/ - Files that are the above data but pre-compiled into more concise formats. Data available is all_transactions.json - Merged JSON of all transactions done to date. Includes senator name in transaction with PTR link. all_daily_summaries.json - Merged JSON of all the daily summaries. all_ticker_transactions.json - All transactions grouped by their ticker. All '--' tickers are together. all_transactions_for_senators.json - All Transactions grouped by the senator who executed them.

Comments:

This repo will be updated on continually as more reports are filed. Senators that scan in their PDF will show as a trader for that day but have transactions: [] in their record. These gaps are being backfilled and automatically updated in collaboration with https://github.com/jeremiak/us-senate-financial-disclosure-data/

senate-stock-watcher-data's People

Contributors

timothycarambat avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

senate-stock-watcher-data's Issues

Automate transcription?

Are there any plans to automate some of the transcription with Apache Tika or tabula or some OCR tool?

Helping out

Hey Tim!

I was wondering if you had a roadmap open or if you were open to or need contributors for this project

opensecrets.org data

Opensecrets.org also provides senate stock trading records. How is your data different from theirs? Thanks.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.