- Queries the Github API for various bits of telemetry
- Dispatches workload to SQS to divide the work up
- Remaps the relevant data to a series of non vendor specific data model
- Writes to dynamodb for later analysis
Querying this data is done by something else (that doesn't exist yet), this just carries out ETL