Git Product home page Git Product logo

nabeel3133 / 3d-texture-fitting Goto Github PK

View Code? Open in Web Editor NEW
35.0 4.0 10.0 9.56 MB

Project Page of Synthesizing Normalized Faces From Facial Identity Features - [CVPR 2017]

Home Page: http://openaccess.thecvf.com/content_cvpr_2017/html/Cole_Synthesizing_Normalized_Faces_CVPR_2017_paper.html

License: MIT License

Python 100.00%
bfm texture-fitting morphable-model ddfa synthesizing normalized faces texture-eigenspace eigenvalues

3d-texture-fitting's Introduction

Synthesizing Normalized Faces From Facial Identity Features (Additional Results B.3 Section Implementation Only)

License: MIT GitHub issues GitHub repo size

This repository provides a Python implementation of the CVPR 2017 Paper - Synthesizing Normalized Faces From Facial Identity Features (Additional Results B.3 Implementation Only). Only Fitting Texture part is implemented which is mentioned in Additional Results Section B.3 of the paper.

Paper

Synthesizing Normalized Faces From Facial Identity Features

Dependencies

Usage

1. Cloning the repository

git clone https://github.com/nabeel3133/3D-texture-fitting.git
cd 3D-texture-fitting

2. Downloading the model

  • BFM09: Basel Face Model 2009
    • After you have acquired BFM, extract the BaselFaceModel.tgz and go toPublicMM1 folder, copy 01_MorphableModel.mat, BFM_exp_idx.mat and paste it in ./3D-texture-fitting/configs folder.

3. Running the code

Run the main.py with obj output from ddfa as input

python main.py -o ./samples/test.obj

If you can see the following output log in terminal, you ran it successfully.

BFM Mapping for Texture Prediction Started...
BFM Mapping for Texture Prediction Completed
Predicting Ear and Neck Texture...
Predicting Ear and Neck Texture Completed
Dump to ./samples/output.obj
Dump to ./samples/output.ply

Two output files (obj and ply) will be saved in 3D-texture-fitting/samples folder with the name output.obj and output.ply which can be redered by Meshlab or Microsoft 3D Builder.

Citation

If this work is useful for your research or if you use this implementation in your academic projects, please cite the following papers:

@misc{cole2017synthesizing,
    title={Synthesizing Normalized Faces from Facial Identity Features},
    author={Forrester Cole and David Belanger and Dilip Krishnan and Aaron Sarna and Inbar Mosseri and William T. Freeman},
    year={2017},
    eprint={1701.04851},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}

References

  @misc{3ddfa_cleardusk,
  author =       {Jianzhu Guo, Xiangyu Zhu and Zhen Lei},
  title =        {3DDFA},
  howpublished = {\url{https://github.com/cleardusk/3DDFA}},
  year =         {2018}
}

3d-texture-fitting's People

Contributors

nabeel3133 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

3d-texture-fitting's Issues

the detail of function "get_predicted_texture" in texture.py

Hello, thanks for your share,
I can't find the Additional Results Section B.3 of the paper,
and when I tried to read the code, I can't understand the detail of function "get_predicted_texture" in texture.py,could you give me some advice?
Thanks a lot!

The problem of downloading BFM model

Hi @nabeel3133, thanks for you awesome work.

I have a problem of downloading BFM model. In readme of this repo, you write

After you have acquired BFM, extract the BaselFaceModel.tgz and go toPublicMM1 folder, copy 01_MorphableModel.mat, BFM_exp_idx.mat and paste it in ./3D-texture-fitting/configs folder.

However, I can not find BFM_exp_idx.mat in BaselFaceModel.tgz, whose file tree is as follows:

PublicMM1
    │  01_MorphableModel.mat
    │  04_attributes.mat
    │  
    ├─09_mask
    │      face05_4seg.mat
    │      face05_4seg.txt
    │      
    ├─11_feature_points
    │      Farkas_face05.fp
    │      fit_face05_9.fp
    │      MPEG4_FDP_face05.fp
    │      
    ├─13_symmetry_indices
    │      face05_symlist.txt
    │      
    └─matlab
            apply_attributes.m
            coef2object.m
            defrp.m
            display_face.m
            idx2intl.m
            load_model.m
            object2coef.m
            plywrite.m
            script_gen_random_head.m
            script_load_scan.m
            script_render_fittings.m

Can you give me advice?

The BFM_exp_idx.mat file

Hi, Nabeel!Thank you so much for your great work!When I run it, and found that the BFM_exp_idx.mat is required, I cannot download from the Basel Face Model 2009 web.Can you share it, or send it to me([email protected])?
Thank you very much!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.