``Loading the data into PostgreSQL`` failed about noaa-ghcn-weather-data HOT 5 CLOSED

@uptonking I was previously using Git LFS to store some of the larger files in the repo, but I'd stopped using it after hitting Github space limits for LFS. The requirements.txt file was also stored using Git LFS and that seems to have caused some issues here.

I've removed LFS support completely. Can you see if that fixes the first issue?

The second issue - failing to ingest data from the 2015.csv file - seems to be different. Can you tell me the specific error message you're seeing there?

Did you run this code to download the CSV file from the NOAA FTP server?

curl -O ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/daily/by_year/2015.csv.gz

from noaa-ghcn-weather-data.

@dylburger thanks. please close the issue.
The 2015.csv was ingested after my waiting of 15min.

from noaa-ghcn-weather-data.

@uptonking thanks. This dataset is a bit large - something smaller might be better so users can get working quickly.

from noaa-ghcn-weather-data.

Hi, I am trying to ingest the data, I don't mind waiting 15 mins but but kernel dies in the process. I reduced the chunk size but that's not helping either - kernel still dies. Any advice help will be gracefully received, thank you.

from noaa-ghcn-weather-data.

I got around this issue by manually removing the entries from 2015.csv and things worked fine.

from noaa-ghcn-weather-data.