Git Product home page Git Product logo

facshuman's Introduction

FACSHuman v0.0.1 Alpha

FACSHuman plugin for MakeHuman project

Create pictures and videos of facial expressions for your experiments.

This work is based on the Facial Action coding System :

Ekman, P., Friesen, W. V., & Hager, J. C. (2002). Facial action coding system. A Human Face.

This plugin allow you to create facial expressions by moving the corresponding Action Units (AU) described in the FACS Manual. Additional plugins are available to create scene (lights placement and lights colors) and animations.

Paper

Please cite the following paper if you use this plugin for your research :

Gilbert, M., Demarchi, S., & Urdapilleta, I. (2021). FACSHuman, a software program for creating experimental material by modeling 3D facial expressions. Behavior Research Methods. https://doi.org/10.3758/s13428-021-01559-9 Pdf is available here : https://link.springer.com/content/pdf/10.3758/s13428-021-01559-9.pdf

The conference

Gilbert, M., Demarchi, S., & Urdapilleta, I. (2018). FACSHuman a Software to Create Experimental Material by Modeling 3D Facial Expression. Proceedings of the 18th International Conference on Intelligent Virtual Agents - IVA ’18, 333‑334. https://doi.org/10.1145/3267851.3267865 - ISBN: 978-1-4503-6013-5

  1. https://iva2018.westernsydney.edu.au/
  2. https://dl.acm.org/citation.cfm?id=3267865#

Link to my profile

https://www.researchgate.net/profile/Michael_Gilbert10

Documentation

Get started

Download and install MakeHuman from here http://www.makehumancommunity.org/content/downloads.html and follow the instructions for your Operating System.

Then start MakeHuman once to create the MH directory in your home/YOURUSER/Document/

For MH

If you have any questions about the installation and the use of this software :

http://www.makehumancommunity.org/wiki/Main_Page

http://www.makehumancommunity.org/forum/

FACSHuman Installation

Main files (the core)

Put this files inside the plugin directory of your MH installation (not in the plugin directory of MH in USER/Document/makehuman)

File Usage
7_FACSHuman.py (main program)
8_FACSAnim.py (to create facial animation)
9_FACS_scene_editor.py (to edit/create scene)

Target files of the AUs

All the FACSHuman target files were created with Blender and the MH tools for Blender.

Place targets files directory into :

For lastest version of MH :

/home/YOUR_USER/Documents/makehuman/YOUR_NUMBER/data/FACSHuman/

For earlier versions :

/home/YOUR_USER/Documents/makehuman/data/FACSHuman/

This directory contains :

  • 00 Emotions
  • 01 Upper Face AUs
  • 02 Lower Face AUs
  • 03 Lip Parting and Jaw Opening
  • 04 Eye Positions
  • 05 Head Positions
  • 06 Miscellaneous AUs
  • au.json
  • black.jpg

Whithout these files plugins do not work

Additional ressources

Teeth, eyes, eylashes and tongue are modified versions of materials assets from the http://www.makehumancommunity.org/

Place directories in :

for lastest version of MH :

/home/YOUR_USER/Documents/makehuman/YOUR_NUMBER/data/...

for earlier versions :

/home/YOUR_USER/Documents/makehuman/data/...

Teeth

In order to avoid teeth distortion (original models) when you use mouth opening AUs, you need to use the modified facs models.

Place it in /teeth

This directory contains :

  • FACSTeeth01
  • FACSTeeth01a
  • FACSTeeth01b
  • FACSTeeth02
  • FACSTeeth02a
  • FACSTeeth02b
  • FACSteeth03
  • FACSteeth03_bw
  • FACSteeth04

Eyes

Place it in /eyes

This directory contains :

  • black_map.png
  • /eyes_no_cornea
  • /facs-poly
  • makehuman_eye_specular.png
  • makehuman_eye_specular2.png
  • /materials
  • /real_pupil_no-cornea
  • specular_map.png
  • specular_map_invert.png
  • specular_map_white_b.png

Eyelashes

Place it in /eyelashes

This directory contains :

  • FACSEyeLashes01

Tongue

Place it in /tongue

This directory contains :

  • FACSTongue
  • FACSTongue_bw (black and white model)

Custom

Place it in /custom

This directory contains :

  • close_lips.target

This target is useful to close the small gap between lips of the MH model.

Additional installations

FACSvatar

An Open Source Modular Framework From Face to FACS Based Avatar Animation (Unity3D / Blender) More on FACSvatar: https://github.com/NumesSanguis/FACSvatar

FFmpeg

If you want to use the video production inside FACSHuman you need to install FFmpeg tools :

https://ffmpeg.org/about.html

and put this software into the path of your computer.

You will find the procedure on the net depending of your operating system.

Information

https://www.michaelgilbert.fr/facshuman/

FACSHuman is a plugin for Makehuman.

If you have any questions please contact me not the MH Team

Demo videos

More tutorials videos will be available soon.

All AUs demonstration

IMAGE ALT TEXT HERE

Full demo

IMAGE ALT TEXT HERE

FACSvatar Datas

IMAGE ALT TEXT HERE

https://www.youtube.com/channel/UCEAepvD886XqB6wikmXW8Qg

Usable Action Units in FACSHuman

Table 1: Usable Action Units in FACS
Action units Simple Right / Left Alternative
Upper Face AUs      
1 Inner Brow Raise X X X
2 Outer Brow Raise X X X
4 Brow Lowerer X X X (41,42,44)
5 Upper Lid Raise X X  
6 Cheek Raise X X X (2)
7 Lids Tight X X  
43 Eye Closure X X  
45 Blink Use 43 Use 43  
46 Wink Use 43 Use 43  
70 Brows Not Visible - - -
71 Eyes Not Visible - - -
Head Positions      
51 Turn Left X    
52 Turn Right X    
53 Head Up X    
54 Head Down X    
55 Tilt Left X    
56 Tilt Right X    
57 Forward X    
58 Back X    
Eye Positions      
61 Eyes Left X X  
62 Eyes Right X X  
63 Eyes Up X X  
64 Eyes Down X X  
65 Walleye X    
66 Crosseye      
Lip Parting and Jaw Opening      
25 Lips Part X X X
26 Jaw Drop X   X(4)
27 Mouth Stretch Use 26    
Table 2: Lower Face and Miscellaneous Action Units
Action units Simple Right / Left Alternative
Lower Face AUs      
9 Nose Wrinkle X X X
10 Upper Lip Raiser X + 25 X  
11 Nasolabial Furrow Deepener X X  
12 Lip Corner Puller X X X(2)
13 Sharp Lip Puller X X  
14 Dimpler X X  
15 Lip Corner Depressor X X  
16 Lower Lip Depress X X  
17 Chin Raiser X   X
18 Lip Pucker X   X
20 Lip Stretch X    
22 Lip Funneler X   X(2)
23 Lip Tightener X    
24 Lip Presser X    
28 Lips Suck X   X(2)
72 Lower Face Not Visible - - -
Miscellaneous AUs      
8 Lips Toward Each Other - - -
19 Tongue Show X + 26    
21 Neck Tightener - - -
29 Jaw Thrust X    
30 Jaw Sideways X    
31 Jaw Clencher X    
32 Bite X    
33 Blow X    
34 Puff X    
35 Cheek Suck X    
36 Tongue Bulge - - -
37 Lip Wipe - - -
38 Nostril Dilate X    
39 Nostril Compress X    
Table 3: Additional Action Units
FACSHuman Simple Right / Left Alternative
pupils dilatation X X  
pupils constriction X X  
Table 4: Table of legends
X : Usable in the module
-  : non implemented
+ : Usable with …
(Num) : Alternative Action units

facshuman's People

Contributors

montybot avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

facshuman's Issues

FACSTeeth pushes a plane through neck when neck is narrowed and teeth position is lowered

--Edit-- This only occurs when another target that lowers the position of the teeth is involved.

The FACSTeeth model pushes through the neck if the neck is narrowed. This occurs at less than extreme narrowing of the neck. The neck size is still within normal human parameters and this can occur.
I will attempt a fix by remodelling the teeth, but my experience in that particular area of how MakeHuman handles custom models is very limited.

Thank you again for this amazing work. be well

FACSeyes malfunctioning

When selecting the FACS eyes, they do not change the eyes, but they often do make a second set of ghost eyes, positioned about the chest area. after they have been selected, and they misplace themselves, they do not go away when you select 'None'. they remain when you select different eyes also. this may be a graphical glitch, as i do not recall them actually exporting.

Thanks again and be well

plugin not loading correctly: FACSHuman 0.1 and FACS Animation Tool menus missing

This might be a duplicate of issue #6, but @eioe doesn't specify exactly what the solution was, and I'm unable to find any errors in my installation. The FACS Scene Editor loads but the FACSHuman 0.1 and FACS Animation Tool menus are not available.
Screen Shot 2021-07-25 at 7 09 32 PM

I'm running the latest FACSHuman under MakeHuman 1.2.0 on a Mac. Per issue #6, I checked the following:

  • activate plugins: the FACSHuman python scripts were added to /Applications/MakeHuman.app/Contents/Resources/makehuman/plugins and show up in the Plugins menu, but there is no option to activate plugins there. The User Plugins menu has an option to activate plugins, but no plugins are listed (and I didn't see a user plugins directory at the same level as plugins.

Screen Shot 2021-07-25 at 7 05 36 PM

- logs: warnings are as follows

Screen Shot 2021-07-25 at 7 06 04 PM

Here are shots of my directory structure for the AU target files and plugin scripts:
Screen Shot 2021-07-25 at 7 07 03 PM
Screen Shot 2021-07-24 at 4 24 07 PM

Please let me know if you have any more information on what fixed @eioe's problem or can suggest other troubleshooting steps--thanks!

export AU to expression?

Hello,
First of all Happy New Year!

Yes, I'm on your plugin on January 1st 😄
Is there a way to save Emotions and AU as expression (like in the Expression mixer)?
I noted that the same AU has different results in the plugin interface and the Expression mixer. Is there a reason?
Screenshot from 2020-01-01 18-49-09
More visible here, AU on one eye vs Expression from mixer on the other:
grab_2020-01-01_19 08 14

Thanks,

plugin not showing in MH v1.2.0.

Hello!

I'm trying to get FACSHuman to run but the plugin (FACSHuman 0.1) does not show up in makehuman (v 1.2.0).
I followed the steps dicribed in the README. Interestingly, the "FACS Scene Editor" shows up - but the FACSHuman main plugin and the "FACS Animation Tool" do not. This is how my makehuman looks like on my machine (Win10):
image

Where in the demo video it looks like this:
image

I'm totally new to makehuman. So maybe, I'm missing something quite basic.

Does FACSHuman require an installation of FACSvatar? This I skipped for now as I thought it's only necessary for mapping facial expressions of real face pictures/videos to avatars (which I don't want to do).
Thanks a lot for support already!

License question

Edit: I see your are licensed LGPL, not GPL or AGPL like parts of makehuman are. That being the case, i will close this as question answered as: No, i do not need to open source, Yes, i can use the morph targets, and, yes, i can use the models.
If i am incorrect, please correct me. otherwise, issue closed. Thank you

If i was to use a facial expression from this for a game character, is this just allowed, or am i expected to open source my game?

If i wanted to use morph targets from this on models controllable by sliders in my character creation screen, am i allowed?
if so, with what limitations.
if i use a MakeHuman character as my game character, am i allowed to use the modified models you have provided such as teeth and tongue?

Thank you for spending the time, and having the skill to make this

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.