This set of scripts allows to generate compressed videos, calculate metrics for each quality, average the results and then plot graphs in order to to make a comparison of several codecs.

recipes.json is a JSON formatted files containing the settings for the codec formats to test. You can add new ones easily if you respect the structure:

• quality_start: the quality at which to stop decoding
• quality_end: the quality at which to stop encoding
• quality_step: the interval of quality between two settings
• encode_extension: the extension for encoded images
• decode_extension: the extension for decoded images
• encode_cmd: the command for encoding at a given quality
• second_pass: optionnal second pass command
• decode_cmd: the command for decoding the encoded video

Variables recognized:

• $quality: the quality parameter
• $target: the filename of the encoded image
• $target_dec: the filename of the decoded image
• $origy4m_10bits: the original 10bits Y4M video to compress.

Generate compressed videos from raw Y4M and calculate quality and speed metrics for a given format. It takes 3 arguments:

• Arg 1: the codec format to test.
• Arg 2: the name of the subset to test (e.g. 'subset1').
• Arg 3: the path to the subset to test (e.g. 'subset1/').

Calculate for each format the weighted averages for the metrics generated by rd_collect.py. It takes 1 arguments:

• Arg 1: Path to the results of a subset generated by rd_collect.py.

  For ex: rd_average.py 'results/subset1'.

Generate a plot for each quality metrics based on the results generated with rd_average.py. It takes 2 arguments:

• Arg 1: Path to a subset with results generated by rd_average.py.

  For ex: rd_plot.py 'results/subset1'.

• Arg 2: Comma-separated list of formats to plot.

  For ex: 'av1,vp9,x264,x265'.

• ImageMagick
• ffmpeg
• pandas
• numpy
• matplotlib
• six
• pytablewriter

The code is licensed under BSD Clause 3.

rd_collect.py is loosely based on a script written by Josh Aas, licensed under : https://github.com/bdaehlie/web_image_formats

vmaf_v0.6.1.pkl and vmaf_v0.6.1.pkl.model are licensed under the Apache Software License 2.0.