Recontructed images visualization about nvae HOT 4 OPEN

Hi Elsa,

Sorry for my slow reply. Yes for colored images output.sample() is a good way of obtaining images. Are you planning on computing metrics like FID score on these samples? When we sample from the decoder using the method above, there is a very small amount of noise that is usually not visible to us but it can badly hurt the FID score.

Regards,
-- Arash

from nvae.

Hi Arash,
Thank you for your answer and for the details.
I am not planning to compute metrics like FID score on the images for the moment. I am focusing on image reconstruction instead of image generation.
I would like to compare the output image to the input image during training and testing. My final goal is to study how well the network is able to reconstruct an given input image, for instance through the use of a metric like MSE. Therefore, how can I get the final reconstructed image for a given input ?
Kind regards,
Elsa

from nvae.

For that purpose too, output.sample() should work. As you have noticed we record reconstructed images in this line:
https://github.com/NVlabs/NVAE/blob/master/train.py#L202

from nvae.

Great, thank you, I was looking for this specific line.
Best regards,
Elsa

from nvae.