azavea / gtfs-feed-fetcher Goto Github PK

For the last 2 deploys (July & August), the NJ bus and train data downloaded by fetch_feeds.py was not the most current data and did not match the data available through the NJ Transit developer portal. We should update fetch_feeds to download the data from the portal; unfortunately, it looks like this might involve reverting a part of the fix in PR 13, though maybe we can see how Transitland is handling this issue and update it a similar way.

Occasionally after download and verification, processing output will contain:

ERROR:root:Error processing nj_rail.zip: Download is not a zip file

This appears to be an extraneous error message; zip file can be processed successfully.

Do not output this message for valid zip files (do retain error message for corrupted zip files or files of the wrong format).

We are getting a septa bus error right, now it might not be current as our TransitFeed Validator is no longer maintained and recommends using gtfs-validator from MobilityData now.

I've played around with it a bit - and it can make a nice HTML report - but not sure how best to work with it programmatically.

Another alternative might be to just fully replace this project by a combination of https://github.com/interline-io/transitland-lib and the transitland-atlas.

URL path has changed from patco.zip to PortAuthorityTransitCorporation.zip.

Contacted agency, who said the new URL should stay constant.

Delaware feed always reports as new and gets downloaded again on feed check.

The Delaware GTFS download no longer sets the last-modified header, so instead scrape the "last updated" date from this page with the download link.