shadrock / code-snippets Goto Github PK

What am I trying to do?

I'm trying to create a function that will traverse multiple tables stored in .csv files; find a given word; extract the values for that word in the table (e.g. that word's entire record) along with the headers for the values; and concatenate them all in a new .csv.

Example Input & Output

I have 3 .csv files that contain information for three different cities: Mumbai, Nairobi, and Jakarta. I want to extract all of the information regarding Nairobi and concatenate it in a separate file. Each, separate, .csv contains the following:

csv1

csv2

csv3

I want the function to result in the following output:

Background

I am running Python 3.7.1 on a Mac. Most of the time I write scripts in Atom and run them in terminal. However, for a lot of my course preparation and tinkering around I use Anaconda / Jupyter Notebooks. I'm using v 1.9.6.

I am currently working on a web scraping script that involves importing the requests library. When I test the first part of the script I get an error message that suggests a dependency issue between two other Python libraries: urllib3 (v 1.24.1) or chardet (v 2.3.0).

Expected behavior

Import the library and run it.

Actual Behavior

Code and error message are as follows:

import requests

url = 'http://www.showmeboone.com/sheriff/JailResidents/JailResidents.asp'
response = requests.get(url)
html = response.content
print(html)

This results in the following error message:

/anaconda3/lib/python3.7/site-packages/requests/__init__.py:91: RequestsDependencyWarning: urllib3 (1.24.1) or chardet (2.3.0) doesn't match a supported version!
  RequestsDependencyWarning)

Questions

• What is the best way to solve this? Is it possible that I have multiple installs of Python (or of libraries) in different places that are in conflict or is this a case of simply needed to update something to the most recent version (or even go back to an older version)?
• Is it possible that I shouldn't be using the import library at all?

Online resources

StackOverflow post that seems related.

I've written the Python script found here, to rename files in a given directory. The output should be all files in a folder renamed as follows: IDCE_1, IDCE_2, etc. The script works well with the exception that it starts naming with IDCE_2, and not IDCE_1. Any idea what I'm doing wrong? @willdoran (no idea if tagging you in my private repo will actually do anything at all. But look how official this issue is!