rwsarmstrong / strongtrack Goto Github PK

Is available on Linux OS?

Hi, @rwsarmstrong, thanks for your job! When I try to implement this project on linux, there is a problem: Segmentation fault. It's seems that something goes wrong with pyqt5, but I can't find any solution for this. Can you help me with that? I installed pyqt5 with the code: pip install pyqt5

Hi

I would love to showcase your app in a short film, but really want to ask for more explicit and verbose steps to install strongtrack for a non-dev. I am using a regular laptop based webcam with win 10.

Regards and please keep on going.

Lee

While trying to export to .txt after doing everything in the tutorial I am getting this error "IndexError: index 2 is out of bounds for axis 0 with size 2"

I tried with a different video and different model and they both give me this error

https://imgur.com/a/cCgxcps

Hi! First off, amazing tool! It's really great how well this works! However, I do have a question. How does this software convert landmark positions to blend shapes? I see that there is a calibration function and it works really well, but it would be really awesome to know how that works!

Summer

opens up just fine. Loads video just fine. Does a pretty good job guessing all placement. I set all markers where they should be for the initial neutral pose, hit F, and it crashes.

Here is the log dump. Seems like maybe an issue with Qt5Core.dll? I"m using Windows 10-64bit. And the latests version of Python and all pip installed components:

Log Name: Application
Source: Application Error
Date: 5/22/2021 6:37:38 PM
Event ID: 1000
Task Category: (100)
Level: Error
Keywords: Classic
User: N/A
Computer: Emo-Lappy-Dev
Description:
Faulting application name: strongtrack.exe, version: 0.0.0.0, time stamp: 0x5ffec122
Faulting module name: Qt5Core.dll, version: 5.15.2.0, time stamp: 0x5fa4dd3b
Exception code: 0xc0000409
Fault offset: 0x00000000000204e8
Faulting process id: 0x3df0
Faulting application start time: 0x01d74f62aa37ac04
Faulting application path: C:\Users\Eric\Downloads\strongtrack0.9\strongtrack0.9\strongtrack.exe
Faulting module path: C:\Users\Eric\AppData\Local\Temp_MEI126162\Qt5Core.dll
Report Id: 93a989fb-6f60-447d-a38d-f881fbf5aa99
Faulting package full name:
Faulting package-relative application ID:
Event Xml:



1000
0
2
100
0
0x80000000000000

8147


Application
Emo-Lappy-Dev



strongtrack.exe
0.0.0.0
5ffec122
Qt5Core.dll
5.15.2.0
5fa4dd3b
c0000409
00000000000204e8
3df0
01d74f62aa37ac04
C:\Users\Eric\Downloads\strongtrack0.9\strongtrack0.9\strongtrack.exe
C:\Users\Eric\AppData\Local\Temp_MEI126162\Qt5Core.dll
93a989fb-6f60-447d-a38d-f881fbf5aa99

Hi, very new to this all. Just got an exported txt, but when trying to apply it to the model nothing happens. Is the mesh configured wrong or missing something? The face mesh is separate from the clothes and pretty much the exact same as the template mesh except for the fact that the teeth and tongue are not connected to it. (I am using a makehuman model by the way)

The openVideo function shows only directories in Ubuntu 20.04 with PyQt 5.12.8.
This seems like a Qt issue. I worked around it by changing the filter (argument 4) to an empty string.
Now I am encountered many more bugs, like inability to create the model XML file because "projects" is an ambiguous file path relative to the working directory, which changes all the time when you load video files from different directories.

Your soft is really great and could be really usefull in production.
But for now, it's useless in prod, because of the blendshapes restriction and the format you use for export.

if you have an option to export the animation of the landmark points (in FBX by exemple), we could use it to drive rigs (blendshapes or joins) in maya or 3ds.

some of my work : https://www.youtube.com/watch?v=4rmUh7mlywc&t=12s

The ue4 project link you put in readme is a livelink example, not a osc example.Is there a osc example project like Youtube tutorial?

Hi,

first thanks for the tool, it's amazing.

I'm trying your windows 10 compiled version which seems to work fine.
However, when I export the data, I have this result :
testMOCAP.txt

I don't see any blendshape names, and also it seems there are only 50 blendshapes recorded per frame, not 51 as announced, if I'm correct.
My idea is to build a maxscript to be able to test these data into 3dsmax,
I can easily extract the blendshape from this file using the shapes order you let in the Blender file, but I would like to be sure the export is correct, and if there is one blendshape missing, which one is it ?

Thanks for your time

Hi, whenever I try to run the script in Blender "Python Script Failed, Check The Message in the System Console. When I do I get the messages below:

Traceback (most recent call last):
File "E:\Projects\Mocap\Blender Project\Strongtrack08BlenderExample.blend\blender_import_strongtrack_data.py", line 7, in
File "C:\Program Files\Blender Foundation\Blender 2.92\2.92\python\lib\site-packages\numpy\lib\npyio.py", line 968, in loadtxt
fh = np.lib._datasource.open(fname, 'rt', encoding=encoding)
File "C:\Program Files\Blender Foundation\Blender 2.92\2.92\python\lib\site-packages\numpy\lib_datasource.py", line 269, in open
return ds.open(path, mode, encoding=encoding, newline=newline)
File "C:\Program Files\Blender Foundation\Blender 2.92\2.92\python\lib\site-packages\numpy\lib_datasource.py", line 615, in open
found = self._findfile(path)
File "C:\Program Files\Blender Foundation\Blender 2.92\2.92\python\lib\site-packages\numpy\lib_datasource.py", line 452, in _findfile
if self.exists(name):
File "C:\Program Files\Blender Foundation\Blender 2.92\2.92\python\lib\site-packages\numpy\lib_datasource.py", line 549, in exists
if os.path.exists(path):
File "C:\Program Files\Blender Foundation\Blender 2.92\2.92\python\lib\genericpath.py", line 19, in exists
os.stat(path)
ValueError: stat: embedded null character in path
Error: Python script failed, check the message in the system console

I looked at my .txt export file and everything looks like zeros in it. Maybe I am having a problem with my export? I am using the version that runs though Blender. When I run the compiled version it crashes when I try to export the txt file. I attached my exported .txt file to this message to maybe help decode it.

BlendTestExport2.txt

Hello!

Just a small issue. When exporting to txt the program closes with no indication and nothing appears in the folder I directed the export to. Is it a lack of installed libraries or something else?

Hi Robert

There is a free android ip webcam that is quite easy to setup. As an indie film maker I am looking to make cg movies with no budget and trying to find a facial capture rig using plain old android smartphones. https://play.google.com/store/apps/details?id=com.pas.webcam

I can get this app working quite well on an old Samsung mini s3 I have lying around. Is it possible to get this video stream into strongtrack? My setup will be android to windows 10 running unreal engine and strongtrack.

Hoping I can build a facial capture rig using an android phone streaming to strongtrack.

Regards

Lee

I tried to use strong track but whenever I try to export/stream it's always crashing.

Update on first run on Windows 10.

Got my ugly mug with various poses into strongtrack. Moved all markers on first neutral pose and hit T and the app crashed. Maybe I did something wrong, so I will try again.

I had a previous crash in 0.7 and got a glimpsse of the console just before it went away. Had something to do with a divide by zero error. Probably not related. I will try my ugly mug again and give some feedback. If I can send you more info, pls mention how to do that.

Thanks for the awesome work so far.

Hi,
the landmark guessing and training is better in the 0.9 preview. However, with the windows 10 .exe I can't access the 'Key Poses' options because they are greyed out. The program indicates that I have sufficient landmarks.
Let me know what I should try. Thanks.

Problem: program crashes after loading xml from the previous session

Steps:

1. Train model
2. Export
3. Restart program
4. Open webcam feed
5. Load xml that was saved into \strongtrack\projects

could capture the error message:

updating for webcam
pausing
Division by zero was about to happen. Fix this.
XML file loaded successfully
model with values found
Keyposes extraction poses found and loaded
showing points first time
Traceback (most recent call last):
File "strongtrack.py", line 933, in loadModel
File "strongtrack.py", line 1071, in checkPredictor
File "render_functions.py", line 279, in drawFace
IndexError: list index out of range

projects.zip
If images are needed please tell me how can I share privately.

I would like to know if there are any specific version for Dlib?
I am getting the application crash even though I installed all the requirements and Dlib installed correctly.

This is what I am ghetting: (Windows 10)
Traceback (most recent call last):
File "strongtrack.py", line 18, in
ImportError: DLL load failed while importing dlib: A dynamic link library (DLL) initialization routine failed.
[23644] Failed to execute script strongtrack

FYI this is the executable version.

why is var keyposes_mouth modified in line 250 and re-assigned with another value at line 252? It is a bug?