The openelections-data-ga from openelections

Special Election 02/04/2020 - Tift County is not certified yet - Need to revisit

See commit #235

Fix data that the automated data test process is flagging as bad

While checking in some 2021 race results, I see the new data test process is failing on many files. Once I get the 2020 & 2021 race results loaded up, I'll start fixing the failing data test files. Looks to be a lot of them. I mainly want to get all the files from 2000 - 2012 fixed as these years have been validated. Then I'll move onto >= 2013. Reach out if you have any questions or want to help. Thanks

Convert 2007 Election Results

Use the openelections.net Metadata API to extract the URL's for all election results in 2007.

http://openelections.net/api/v1/election/?format=json&limit=0&state__postal=GA&start_date__year=2007

Create individual CSV files for each special, primary & general election date (which may involve multiple races) using the file name conventions. The CSV files should have the following headers: county, office, district, party, candidate, votes. For offices, follow our naming conventions. See the completed years for an example of what your output needs to be.

Some of these election files have overall results on the first page (with full candidate names) and county-specific results on interior pages, so we'll need both for our CSVs - the first page for candidate names and the interior ones for county-specific vote totals.

January 5, 2021 runoff race results

These results #251 are missing the below (4) counties. I have sent a notice to the Georgia Secretary of State regarding these.

Camden
Chattooga
Grady
Greene

Once these are available I will update these results.

Missing party data in 2016 precinct results files

In the 2016 Fulton County general precinct file, and from what I can tell in all the other county precinct files as well, the "party" filed is missing data for a lot of the races, and for other races the formatting is inconsistent. Some races list the party a "D" & "R" while others as "Dem" & "Rep", with some having a stray "(" before the name.

Convert 2005 Election Results

Use the openelections.net Metadata API to extract the URL's for all election results in 2005.

http://openelections.net/api/v1/election/?format=json&limit=0&state__postal=GA&start_date__year=2005

Create individual CSV files for each special, primary & general election date (which may involve multiple races) using the file name conventions. The CSV files should have the following headers: county, office, district, party, candidate, votes. For offices, follow our naming conventions. See the completed years for an example of what your output needs to be.

Some of these election files have overall results on the first page (with full candidate names) and county-specific results on interior pages, so we'll need both for our CSVs - the first page for candidate names and the interior ones for county-specific vote totals.

Uniform format of csv files for older election results?

I have noticed that older years' data have multiple format, especially those special elections.

For example, in http://sos.ga.gov/elections/election_results/2002_0212/ we have candidates grouped by counties. In another election http://sos.ga.gov/elections/election_results/2001_1106/ , we have candidates grouped by districts and followed by their percentage. I would like to know if we can construct a unique format that defines the number of variables for those special elections. For those variables not shown in the election results just left them as blank.

Any suggestion is welcome!

Convert 2010 general election county results

The county-level results files are broken out by race, which means you can either do each race as a separate file (for example, 20101102__ga__general__senate.csv) or tackle all of the races and combine them into a single file (or handle all statewide officers or all U.S. House races). You can copy and paste into a spreadsheet, then re-arrange to fit our practice of one candidate result per county on each line. For each eace, you'll need to get the candidates' first names.

Convert 2003 Election Results

Use the openelections.net Metadata API to extract the URL's for all election results in 2003.

http://openelections.net/api/v1/election/?format=json&limit=0&state__postal=GA&start_date__year=2003

Create individual CSV files for each special, primary & general election date (which may involve multiple races) using the file name conventions. The CSV files should have the following headers: county, office, district, party, candidate, votes. For offices, follow our naming conventions. See the completed years for an example of what your output needs to be.

Some of these election files have overall results on the first page (with full candidate names) and county-specific results on interior pages, so we'll need both for our CSVs - the first page for candidate names and the interior ones for county-specific vote totals.

2008 data needs some cleanup and reshaping.

2012 Presidential Primary results

Parse from html here: http://sos.ga.gov/elections/election_results/2012_0306/

Convert 2008 Election Results

Use the openelections.net Metadata API to extract the URL's for all election results in 2008.

http://openelections.net/api/v1/election/?format=json&limit=0&state__postal=GA&start_date__year=2008

Create individual CSV files for each special, primary & general election date (which may involve multiple races) using the file name conventions. The CSV files should have the following headers: county, office, district, party, candidate, votes. For offices, follow our naming conventions. See the completed years for an example of what your output needs to be.

Some of these election files have overall results on the first page (with full candidate names) and county-specific results on interior pages, so we'll need both for our CSVs - the first page for candidate names and the interior ones for county-specific vote totals.

2014 results

Nov. 4 general precinct
July 22 primary runoff precinct
May 20 primary precinct
Feb. 4 special election runoff precinct
Jan. 7 special election precinct

Adapt county_parser for 2000-2009 elections

I've started a county parser that, when given a race-specific URL like this one from 2010, an office, district and filename, will scrape results and output a CSV file. The process still involves too much manual work, and it hasn't been applied to 2009 and earlier elections, but should work with a few tweaks.

A couple of changes would be useful:

having the script grab full candidate names instead of just last names
handling all race-specific URLs and then outputting a single CSV for that election (currently I cat the CSV files together).
deriving the race-specific URLs somehow (maybe starting with an array of dicts that contain office, district and url?)

Convert 2004 Election Results

Use the openelections.net Metadata API to extract the URL's for all election results in 2004.

http://openelections.net/api/v1/election/?format=json&limit=0&state__postal=GA&start_date__year=2004

Create individual CSV files for each special, primary & general election date (which may involve multiple races) using the file name conventions. The CSV files should have the following headers: county, office, district, party, candidate, votes. For offices, follow our naming conventions. See the completed years for an example of what your output needs to be.

Some of these election files have overall results on the first page (with full candidate names) and county-specific results on interior pages, so we'll need both for our CSVs - the first page for candidate names and the interior ones for county-specific vote totals.

Review all years, standardize and fill in missing data.

As we get close to having Georgia complete we need to roll back through all of the years and verify we have all the available data loaded. I know we are missing some of the more recent elections.

Please work on the issue related to office name and party standardization while you review this data.

If you start working on a year please leave a commit below. Thanks

Convert 2016 presidential primary results by congressional district

Ga. secretary of state has produced two PDFs that can be converted into CSVs:

2002 Special election results

These are county-level files, using these headers. Convert the data in the following urls, using the file names provided:

20021022__ga__special__general.csv
20020226__ga__special__general.csv
20020212__ga__special__general.csv
20020212__ga__special__general__runoff.csv - House 16 only
20020122__ga__special__general.csv - House 16 only

Convert 2002 Election Results

Use the openelections.net Metadata API to extract the URL's for all election results in 2002.

http://openelections.net/api/v1/election/?format=json&limit=0&state__postal=GA&start_date__year=2002

Create individual CSV files for each special, primary & general election date (which may involve multiple races) using the file name conventions. The CSV files should have the following headers: county, office, district, party, candidate, votes. For offices, follow our naming conventions. See the completed years for an example of what your output needs to be.

Some of these election files have overall results on the first page (with full candidate names) and county-specific results on interior pages, so we'll need both for our CSVs - the first page for candidate names and the interior ones for county-specific vote totals.

2018 precinct results

We've updated our Clarify library to support new-style Clarity election sites like Georgia uses. If you build and install the latest source version of Clarify, you should be able to generate precinct files. Here's an example using West Virginia: https://github.com/openelections/openelections-data-wv/blob/master/scripts/clarity_parser.py

Missing 2018/20181204gageneral.csv file

For the 2018 general election, there appears to be a missing csv file for all of the county-level election results merged together. I'm using this data for a research project and any help in generating this file would be greatly appreciated.

Convert 2012 county-level special election results

Using the following files:

Create individual CSV files for each special election date (which may involve multiple races) using the file name conventions. The CSV files should have the following headers: county, office, district, party, candidate, votes. For offices, follow our naming conventions.

These special election files have overall results on the first page (with full candidate names) and county-specific results on interior pages, so we'll need both for our CSVs - the first page for candidate names and the interior ones for county-specific vote totals.

2016 results

using clarify:

Primary President - 20200609 - Banner states "Unofficial Results..."

The website has this statement on the main page "Unofficial Results – Totals may not include all Absentee or Provisional Ballots" but at the county level it shows all counties certified. I'll create an issue and check back later and refresh once the main page banner goes away. See #238 for more details.

Convert 2001 Election Results

Use the openelections.net Metadata API to extract the URL's for all election results in 2001.

http://openelections.net/api/v1/election/?format=json&limit=0&state__postal=GA&start_date__year=2001

Create individual CSV files for each special, primary & general election date (which may involve multiple races) using the file name conventions. The CSV files should have the following headers: county, office, district, party, candidate, votes. For offices, follow our naming conventions. See the completed years for an example of what your output needs to be.

Some of these election files have overall results on the first page (with full candidate names) and county-specific results on interior pages, so we'll need both for our CSVs - the first page for candidate names and the interior ones for county-specific vote totals.

Convert 2011 county-level special election results

Using the following files:

Create individual CSV files for each special election date (which may involve multiple races) using the file name conventions. The CSV files should have the following headers: county, office, district, party, candidate, votes. For offices, follow our naming conventions.

These special election files have overall results on the first page (with full candidate names) and county-specific results on interior pages, so we'll need both for our CSVs - the first page for candidate names and the interior ones for county-specific vote totals.

Convert 2006 Election Results

Use the openelections.net Metadata API to extract the URL's for all election results in 2006.

http://openelections.net/api/v1/election/?format=json&limit=0&state__postal=GA&start_date__year=2006

Create individual CSV files for each special, primary & general election date (which may involve multiple races) using the file name conventions. The CSV files should have the following headers: county, office, district, party, candidate, votes. For offices, follow our naming conventions. See the completed years for an example of what your output needs to be.

Some of these election files have overall results on the first page (with full candidate names) and county-specific results on interior pages, so we'll need both for our CSVs - the first page for candidate names and the interior ones for county-specific vote totals.

Standardize office names

Hey @ATLJoeReed, I'd like to make some standardizations of office names, particularly U.S. House and U.S. Senate. That would impact lots of files - does that work for you?

2015 results

using clarify

Dec. 1 special election precinct
Dec. 1 special election runoff precinct
Nov. 3 special election precinct
Aug. 11 special election runoff precinct
July 14 special election runoff precinct
July 14 special election precinct
June 16 special election precinct
Feb. 3 special election runoff precinct
Jan. 6 special election precinct

Convert 2010 special election county-level results

Using the following files:

Create individual CSV files for each special election date (which may involve multiple races) using the file name conventions. The CSV files should have the following headers: county, office, district, party, candidate, votes. For offices, follow our naming conventions.

These special election files have overall results on the first page (with full candidate names) and county-specific results on interior pages, so we'll need both for our CSVs - the first page for candidate names and the interior ones for county-specific vote totals.

Convert 2000 Special, Primary & General Election Results

Use the openelections.net Metadata API to extract the URL's for all election results in 2000.

http://openelections.net/api/v1/election/?format=json&limit=0&state__postal=GA&start_date__year=2000

This will return a JSON file that contains all of the URL's for each of the elections.

Create individual CSV files for each special, primary & general election date (which may involve multiple races) using the file name conventions. The CSV files should have the following headers: county, office, district, party, candidate, votes. For offices, follow our naming conventions. See the completed years for an example of what your output needs to be.

Some of these election files have overall results on the first page (with full candidate names) and county-specific results on interior pages, so we'll need both for our CSVs - the first page for candidate names and the interior ones for county-specific vote totals.

openelections / openelections-data-ga Goto Github PK

openelections-data-ga's People

Contributors

Stargazers

Watchers

Forkers

openelections-data-ga's Issues

Recommend Projects

Recommend Topics

Recommend Org