There is a gap in performance than in the paper about tfvaegan HOT 7 CLOSED

Hello @in-my-heart,
Thank you for your interest in our work. The counterfactual paper used PS2.0 splits whereas our paper uses PS1.0 . The 2% drop mentioned in the counterfactual paper exists because of PS2.0.
Also, when you are changing the pytorch version from 0.3.1 to 1.8 you will need to do the hyperparameter search again.

from tfvaegan.

Hello @in-my-heart,
Thank you for your interest in our work. The counterfactual paper used PS2.0 splits whereas our paper uses PS1.0 . The 2% drop mentioned in the counterfactual paper exists because of PS2.0.
Also, when you are changing the pytorch version from 0.3.1 to 1.8 you will need to do the hyperparameter search again.

Hello @in-my-heart,
Thank you for your interest in our work. The counterfactual paper used PS2.0 splits whereas our paper uses PS1.0 . The 2% drop mentioned in the counterfactual paper exists because of PS2.0.
Also, when you are changing the pytorch version from 0.3.1 to 1.8 you will need to do the hyperparameter search again.

soga，Let me confirm: PSv1 is used in the paper, but the link(https://drive.google.com/drive/folders/16Xk1eFSWjQTtuQivTogMmvL3P6F_084u?usp=sharing) to the dataset you provided is PSv2. So the result I got using the dataset you provided will be a bit lower than the paper.

from tfvaegan.

Hello, @in-my-heart the training data link I provided is for the PSv1 split. if you run our code using the PSv2 split the numbers will be lower as reported by the counterfactual paper.

from tfvaegan.

Hello, @in-my-heart the training data link I provided is for the PSv1 split. if you run our code using the PSv2 split the numbers will be lower as reported by the counterfactual paper.
Sorry to disturb you, this is the split of the cub dataset I downloaded from your link. Is this v1?

from tfvaegan.

@in-my-heart if you downloaded the dataset from the drive I shared then its correct this is v1 dataset.

from tfvaegan.

@in-my-heart if you downloaded the dataset from the drive I shared then its correct this is v1 dataset.

I'm really sorry to trouble you for so long, I want to ask you question about psv2. This smallquestion puzzled me for a long time.
Q1:《Zero-Shot Learning—A Comprehensive Evaluation of the Good, the Bad and the Ugly》
Are the SS and PS in the figure below proposed in this paper psv1 and psv2 respectively? (note that I use matlab software to determine that your data link is PS)

from tfvaegan.

@in-my-heart For our paper, we used the psv1 which were uploaded by the original authors on the webpage.

from tfvaegan.