collecting_fomc_statements_and_eliminating_stop-phrases's Introduction

Collecting FOMC Statements and Eliminating Stop-phrases

For additional information, please contact us using the email addresses provided below.
- [email protected]
- [email protected]
Reference
- Scraping: https://github.com/tengtengtengteng/Webscraping-FOMC-Statements
- Data source: https://www.federalreserve.gov/monetarypolicy/materials/
Tips
- Regular expression online tester: https://pythex.org/

Overview

Input

Variable	Type	Example
start_mmddyyyy	str	"01/01/1990"
end_mmddyyyy	str	"11/17/2022"
insert_into_NRFDB	str	"False"
chromedriver_filepath	str	"C:\GIT\SELENIUM_DRIVERS\chromedriver_win32\chromedriver.exe"
save_root_dir	str	"./Statements"

Full list of stop-phrase patterns

Regular expression	Stop-phrase example
`Release Date: [A-z][a-z]{2,8} \d{1,2}, \d{4}`	Release Date: February 4, 1994
`For immediate release`	For immediate release
`Home \|.*`	Home \| Press releases Accessibility \| Contact Us Last update: April 20, 2007, Home \| News and events Accessibility Last update: December 11, 2001
`\d{4} Monetary policy`	2005 Monetary policy
`Implementation Note issued.*`	Implementation Note issued January 27, 2016
`Frequently Asked Questions.*`	Frequently Asked Questions for… [Refer to this page]
`For media inquiries.*`	For media inquiries, call 202-452-2955.
`\(\d{1,3} KB PDF\)`	(61 KB PDF)

Before removing stop-phrases

Recent...and Christopher J. Waller. For media inquiries, please email [email protected] or call 202-452-2955. Implementation Note issued November 2, 2022

After removing stop-phrases

Recent...and Christopher J. Waller.

Meeting date parsing

Customized function: extract_begin_end_dates()
- Input: date range (Data type: string) in various formats
- Output: meetingdate_start (Data type: datetime), meetingdate_end (Data type: datetime)

Recommend Projects