Git Product home page Git Product logo

3dfacecam's Introduction

Controllable 3D Generative Adversarial Face Model via Disentangling Shape and Appearance

Fariborz Teherkhani, Aashish Rai*, Shaunak Srivastava*, Quankai Gao*, Xuanbai Chen, Fernando de la Torre, Steven Song, Aayush Prakash, Daeil Kim (* equal contribution)

Carnegie Mellon University, Facebook/Meta

WACV 2023

This is the official Pytorch implementation of the paper.

[Project Page] [Video] [Colab Demo] [Arxiv]

Testing

Conda environment: Refer environment.yml

Download pre-trained weights and put the "checkpoints" folder in the main directory. [Link]

  • Generate 3D Faces (mesh and texture)

    python generate_faces.py
    
  • Generate meshes only

    python test_gan3d.py
    
  • Generate textures only

    python test_texture.py
    

Train your own model

Dataset

We primarily used the FaceScape dataset. It can be downloaded from [Link]. The dataset is restricted to be used for non-commercial research only. Learn more about Facescape License [Link].

Preprocess data

- Download Facescape dataset and specify path to the "facescape_trainset" folder.

python preprocess_traindata.py

Start training

  • Shape

    Train AE
    python train_ae.py 
    
    Generate Reduced Data
    python gen_reduced_data.py 
    
    Train GAN
    python train_gan3d.py 
    
  • Texture

    Train P-GAN
    python train_texture.py --init_step 1 --batch_size 128
    

License

The code is available under X11 License. Please read the license terms available at [Link]. Quick summary available at [Link].

Citation

If you use find this paper/code useful, please consider citing:

@InProceedings{Taherkhani_2023_WACV,
    author    = {Taherkhani, Fariborz and Rai, Aashish and Gao, Quankai and Srivastava, Shaunak and Chen, Xuanbai and de la Torre, Fernando and Song, Steven and Prakash, Aayush and Kim, Daeil},
    title     = {Controllable 3D Generative Adversarial Face Model via Disentangling Shape and Appearance},
    booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
    month     = {January},
    year      = {2023},
    pages     = {826-836}
}

3dfacecam's People

Contributors

aashishrai3799 avatar shaunak99 avatar zerg-overmind avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

3dfacecam's Issues

Face with diversity of texture

Hi,

Thank you for the great work!
How can I reproduce the faces with diversity in age, gender, skin color, facial features, and face shape as shown in Figure 4 in the paper.

image

Gan inversion ?

Amazing work! Is it possible to do inversion with image put ?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.