Why is data only harvested up to the last day? about metha HOT 3 OPEN

It is not a limitation of the protocol, but a implementation tradeoff - that I'd like to fix in some future version.

Basically: OAI allows two date granularities, day and second. In order to have a single filename type on disk (e.g. 2018-04-30-00000000.xml.gz), we used the coarser granularity. Also, we wanted to avoid having to check for duplicates (e.g. when requesting an endpoint, that only supports day-granularity every hour).

It's not ideal, and I have some prototypes for more seamless handling, already - just need to weave it into metha.

from metha.

Thanks, that's fair enough. If you'd like some help with or review of any of those prototypes or their design or implementation, I'd be happy to be of assistance.

from metha.

If you'd like some help with or review of any of those prototypes or their design or implementation, I'd be happy to be of assistance.

Thanks.

from metha.