neilsmurphy / sharadar-download-manager Goto Github PK

The current implmentation uses poor implementation of boolean, asking user to input 1 or true and 0 for false.

Allows for easier access to the other databases other than just sqlite3.

Need to capture failures from quadl better and cancel download for that table, then try again later.

Better yet to retry the download for that one download a number times.

Useful for selecting dates.

Some of the function docstrings need updating.

Currently the downloads can fail due to memory isssues when downloading some of the larger files.

Need to implement method to batch downloads on date columns and then also on a sub column, likely tickers?

Then if this is done natural to progress to downloading all files for initial installation.

See if there's an existing library for managing batch size. Or perhaps time the batches and adjust size accordingly.

Use asyincio for multi threading downloading.