Git Product home page Git Product logo

fpds-data-analysis's Introduction

FPDS-Data-Analysis

Using Python and Pandas to download and analyze contract obligation data from the US government's Federal Procurement Data System (FPDS)

Created on Tue Apr 14 18:44:49 2020

@author: CatsAndProcurement

The purpose of the script is to download a user-defined dataset from the Federal Procurement Data System (FPDS) and aggregate and display the data using Pandas. Documentation is intended to guide a new Python/Pandas user through the process of writing similar scripts in a clear, simple, step-by-step way.

FPDS is a publicly accessible US government data system for prime contract award information. Sample FPDS web API call: https://www.fpds.gov/ezsearch/fpdsportal?s=FPDS&indexName=awardfull&templateName=CSV&q=++CONTRACT_FISCAL_YEAR%3A%222019%22+DEPARTMENT_ID%3A%226900%22+PRODUCT_OR_SERVICE_CODE%3A%22D3*%22

The above sample call pulls data for Contract Fiscal Year 2019, Department ID #6900 (the Department of Transportation), and Product Service Code (PSC) D3 (IT services). These parameter values can be edited (and other parameters added) as needed by data analysts to meet customized needs.

Nothing in this script is reviewed or endorsed by GSA, the reporting agencies, or the U.S. government. None of the data that the script might extract is verified by the author; neither raw data nor conclusions drawn from the data should be interpreted as authoritative.

fpds-data-analysis's People

Contributors

catsandprocurement avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

fpds-data-analysis's Issues

FPDS-Data-Analysis

What is the source for the correct parameter names to pull data from the API? When I use the parameter name from the downloaded csv it not work. When I use the FPDS Screener it does not work either.

Also, the max return for the API is 30,000 records so You have to use parameter combinations to pull all the data but I do not know the correct parameter names to do this.

For example, on your example:
https://www.fpds.gov/ezsearch/fpdsportal?s=FPDS&indexName=awardfull&templateName=CSV&q=++CONTRACT_FISCAL_YEAR%3A%222019%22+DEPARTMENT_ID%3A%226900%22+PRODUCT_OR_SERVICE_CODE%3A%22D3*%22

When hen I use "Contracting Agency ID" as "Contracting_Agency_ID" or "CONTRACTING_AGENCY_ID" it does not pull the data.

Attached is an example file I downloaded using this API.

Any assistance is appreciated.

Jeff

fpds_2023_AC.csv

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.