biglocalnews Goto Github PK

.github

Data, tools and collaborations that empower journalists to better cover their community. A project at Stanford University.

aw-legistar-scraper-selenium

A Legistar scraper for Agenda Watch using Selenium

aw-scripts

Misc scripts and other code bits that haven't graduated to their own repos.

bln-etl

Utilities for BLN data gathering pipelines.

bln-python-client

Python client for the biglocalnews.org API

bln-web-scraping-tutorial

bylines

Stories, guides and other articles by the Big Local News team and its partners

california-wildfires

Big Local News: investigation into the costs of wildfires across the U.S. with a focus on California

civic-scraper

Tools for downloading agendas, minutes and other documents produced by local government

clean-scraper

Scraper library and CLI tool to harvest police bodycam footage and other files as part of the Community Law Enforcement Accountability Project (CLEAN)

court-scraper

Scrapers for U.S. county court sites.

covid-world-scraper

scrapers for the pitch map

covid19-tweets

Big Local News project on Tweets from local government agencies about COVID-19

datasette

An open source multi-tool for exploring and publishing data

datasette.biglocalnews.org

A Datasette instance that allows users to explore public and private files hosted by biglocalnews.org

gcp-storage-emulator

Local emulator for Google Cloud Storage

legistar-scraper-demo

Quick-and-dirty demo of a non-Selenium approach to scraping Legistar.

local-election-results-etl

Extract, transform and load election results posted online by local U.S. election officials

prefect-flow-template

A template repository with all the fundamentals needed to develop and deploy a Python data-processing routine for Prefect pipelines.

reporting-tool

scraping-workshop

Tutorial on web scraping with Python and PDFs

squarelet

MuckRock User Service

tile-tools

Tools for working with Mapbox (and similar) tiles.

upload-files

Upload comma-delimited files to biglocalnews.org in your GitHub Action

usc-crime-reports-scraper

A GitHub Action workflow for automating the collection of crime and fire logs posted by the University of Southern California's Department of Public Safety.

usps

US Addresses Sampler

warn-california-analysis

An exploration and analysis of the WARN Notices data for California

warn-github-flow

GitHub Action workflow for automating a WARN Act notice ETL pipeline

warn-scraper

Command-line interface for downloading WARN Act notices of qualified plant closings and mass layoffs from state government websites

warn-transformer

Consolidate, enrich and republish the data gathered by warn-scraper