Comments (13)
It seems that your batch size is kind of too large, basically you'll expect to get results with better quality when training with a smaller batch size in the generative model.
Or it can be possibly caused by some error in extracting the AU feature, which is a very important condition in this network architecture.
I train this model with CelebA and the batch size is set to 25. some of my testing results are listed as follows,
Here, I try to change expression of the left most person to the right most one's. I interpolate it continuously by using the method mentioned in Section 6.2 of the original paper.
But, please note that the above shown results are cherry picked by me. There are also lots of failure results, even more than good results. Also I list some of them as follows,
I'm not sure it is because of my training data set or whatever. Or the quality of generated images are inherently unstable, just as lots of other GAN based model have shown.
from ganimation.
GANs are still unstable, but you can can still improve your results by training longer/more data/better data. Also, you may be able to further improve the results playing with the hyperparameters.
from ganimation.
@chenyvehtung Hi, Yuedong Chen. Can you package your data set , the processed AU, as well as the code and send me a copy ? I compare what went wrong.
from ganimation.
@albertpumarola Hi, albertpumarola. Can you send me a copy for your data set and processed AU ,I feel my processed AU is error.
from ganimation.
@shliang0603 I have the same issue, did you overcome it? as a result I just get similar images...
from ganimation.
@chenyvehtung What kind of image are you using in your training? I use the aligned one and find their size is fixed at 178 × 218,so in order to change them to 128*128, I add a centercrop and resize(128) into the transform in dataloader, but the training result is not good as expected. Could you tell me how to preprocess the dataset? Thanks.
from ganimation.
@chenyvehtung hello, the output images of openface is *.bmp on my cumputer. Did you get the *.bmp images too? That makes me "An ignorant face"........
from ganimation.
@shliang0603 How do you visualize it?There are no web link tutorials?thank
from ganimation.
@yangzhikai
3. should be visualized by test.py
; 5 should be visualized by tensorboard, under the image tab. There are plenty of tutorials on tensorboard you can look up.
Others seems to be visualized by custom code. It can be done with pytorch and some plotting library like matplotlib.
from ganimation.
@donydchen Hello, I use the same dataset as you,but the results seem to be bad. The output is almost the same as the input. I don't know what went wrong.
Have you modified the parameters of the network? If so, would you like to share your params? Thaks a lot!
from ganimation.
@donydchen Hello, I use the same dataset as you,but the results seem to be bad. The output is almost the same as the input. I don't know what went wrong.
Have you modified the parameters of the network? If so, would you like to share your params? Thaks a lot!
Sorry for the late reply. Actually I don't use the codes provided by this project. Instead, I replicate GANimation from scratch using the information illustrated in the original paper.
You can checkout https://github.com/donydchen/ganimation_replicate if you are interested.
I also provide my preprocessed CelebA dataset and pretrained model. Hope it help.
from ganimation.
@shliang0603 Have you solved this issue? I encountered the same issue with the implementation by @donydchen.
from ganimation.
@joyyang1997 Me too. Have you fixed that? I have tested the pretrained model provided by @donydchen, and it was pretty good. However, when I retrain the model with the provided codes, the results are bad. Any suggestions?
from ganimation.
Related Issues (20)
- Is this how you would run your sample images ? HOT 2
- TypeError: iteration over a 0-d array
- Problem with Preparing annotation
- Pretrained Openface HOT 3
- About the paper figure
- A question about some loss functions in the paper
- Give “Attention” a name.
- Suggestion of using AU R-CNN instead of OpenFace for better AU detection accuracy.
- tensors must have same number of dimensions: got 2 and 3
- Attention Loss
- TypeError: Cannot handle this data type HOT 1
- when training “the loss_d_real is negative value ” is OK? and why
- Generator is different from that in paper HOT 1
- AUs as input parameter for trained model HOT 1
- IndexError: During training 0-dim tensor error HOT 2
- Can you share you train data in this paper? HOT 1
- Pretrained Model HOT 2
- Demo??
- Why the c_dim is 5 HOT 1
- How to get tar_aus in the batch ,what is the tar_aus?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ganimation.