destan / imdb-data-parser Goto Github PK

extract tar.gz files

when i run imdbparser without any parameters it gives me error:

$ ./imdbparser.py 
type: None
source_dir: None
destination_dir: None
update_lists: False
Parsing, please wait. This may take very long time...
Traceback (most recent call last):
  File "./imdbparser.py", line 29, in <module>
    preferencesMap = {"type":args.type.lower(), "destinationDir": args.destination_dir}
AttributeError: 'NoneType' object has no attribute 'lower'

When we run app with -u parameter, it downloads all of the lists again. We need to compare creation date and file size with downloaded files and download file if server has newer version.

Use a logger which at least prints:

• time
• class and method

... using a library we have talked about.

... to avoid burden of creating a new instance in every loop

Preferably in another package. It shall be invoked by a separate command-line argument like --toDb. Also parsing into CSV be the default mode and this(--toDb) shall be another.

With a CLI command like --fresh-data the application shall download the data into say ${imdb-downloads} and shall use the files from there.

${imdb-downloads} path may be defined in properties file as proposed as in #7

Bind parsers to main function and activate CLI arguments