Comments (4)
zschira
commented on June 3, 2024
1
Yeah there's an entirely new entry in the feed when a filer resubmits a filing, and they do contain a timestamp, so I think your suggestion seems good. They've been somewhat responsive in the past, but I still haven't heard back from them and I don't know who manages the feed. Also, the naming convention you've provided here will be unique and is more descriptive than the guid even if it was working correctly, so I'm in favor of just going forward with changing it.
from pudl-archiver.
zaneselvans
commented on June 3, 2024
When a respondent submits a revision to and old filing they submit an entirely new filing, with both the old and the revised filing continuing to exist in the feed, right?
If there's a filing submission timestamp available in the RSS feed (or the XBRL) and a respondent ID, could we use those to uniquely identify a filing? E.g. something like... 20230201123456-C000123.xbrl This wouldn't preclude FERC from fixing the GUID. Have they been responsive in the past? Do they even have control over the system, or is it managed by XBRL-US I wonder?
from pudl-archiver.
zaneselvans
commented on June 3, 2024
Each form has its own RSS feed right? So we don't need to worry about ID collisions between different forms?
from pudl-archiver.
jdangerx
commented on June 3, 2024
We changed how we name things, so I think we can close this, right @zschira ?
from pudl-archiver.
Related Issues (20)
- Validate zipfile contents
- Include expected filename in `rssfeed` metadata
- Icebox: Move to new Zenodo API HOT 4
- Reconfigure EIA 860M archive to meet new Zenodo file number restrictions HOT 1
- `published_parsed` field in metadata is not TZ-aware
- Add multi-year partitions to PHMSA archiver
- Reorder files in Zenodo archiver HOT 2
- Recreate sandbox archives for all Zenodo datasets
- Remove `--dry-run` option in favor of `--auto-publish` HOT 6
- Change FERC data format partition value `XBRL_TAXONOMY` to be lower case
- Mixed types in `ferc2` partition value causes complexity downstream
- Add `dbf` data format specifier to older FERC files
- Define `epacems` archiver success conditions
- Fix mixed use of strings and integers for date partitions
- Identify and implement 1-2 additional generic validations for all datasets to help us catch remaining gaps (e.g. size of all files hasn’t changed by more than 10%). HOT 1
- Ensure continuous data availability for CEMS and 860M archives HOT 2
- CEMS archiver fails frequently HOT 6
- Handle 100 file limit for EIA 860M Zenodo archiving
- Automatic archival slack notification doesn't show failures
- Zipfile validation not catching corrupted zipfiles
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pudl-archiver.