pperle / gaze-tracking-pipeline Goto Github PK

Hello, thank you for this work, I want to have an idea about how will be the output.
I want to run the code in the colab:
https://colab.research.google.com/drive/1LvhTnsOw3MnVR5YDOP8euNbcpMvzdUC8?usp=sharing
to get the calibration_matrix.yaml file, while I got this below error:
[ WARN:0] global /tmp/pip-req-build-7m_g9lbm/opencv/modules/videoio/src/cap_v4l.cpp (893) open VIDEOIO(V4L2:/dev/video0): can't open camera by index OpenCV: FFMPEG: tag 0x5634504d/'MP4V' is not supported with codec id 12 and format 'mp4 / MP4 (MPEG-4 Part 14)' OpenCV: FFMPEG: fallback to use tag 0x7634706d/'mp4v' Traceback (most recent call last): File "camera_calibration.py", line 103, in <module> record_video(width=1280, height=720, fps=30) File "camera_calibration.py", line 24, in record_video for idx, frame in enumerate(source): File "/content/gaze-tracking-pipeline/webcam.py", line 30, in __iter__ raise StopIteration StopIteration
I appreciate let me know how I can fix this issue.
Thanks

I am running the main.py as it's described. I've created the yaml file and downloaded the trained model. After running the command, there is no reaction. I am debugging to see the issue and it says : Exception has occurred: OSError

model is not used why do i need this???

Hi! First of all thanks for publishing your work, it is really helpful! I have been working on my graduation project which is very similar to yours and I wanted to run your program to get some idea on how it works.

I was able to calibrate and get the yaml file, then I ran the main,py and manually set entered the screen sizes. However, when I run it the screen appears to be way smaller then the actual screen (playing with the numbers didn't help), the laser doesn't appear , and it shows the red line mostly in the center unless I move my head than the line starts moving towards the side my head moved.
Can it be because of the calibration? Or what might cause it? How did it work for you, can you share with more details please?

Thank you!

Hello, i would like to use parts of the code presented here in my own project.

The gaze-tracking Repo has a license file, sadly this repository does not.
Would it be possible to update this repository with a license?

Best regards.

Hi, is there a way to convert the received data (https://github.com/pperle/gaze-data-collection) to train a model from your other repository https://github.com/pperle/gaze-tracking . train.py expects the MPIIFaceGaze dataset format preprocessed, but I would like to train the model on my own collected data, is there a way to do this?

This code in main.py:

seems duplicated in this call:

with the only difference being the main call smooths the face_landmarks.

Is this intentional?

When I look at the corners of my screen, the estimated points are only shown inside this square. Is there any scaling factor for that?

Hi @pperle !
Thanks for this original work ! I wanted to try out the demo. Could you provide processed datasets and model checkpoint links ?
Current ones seems to be dead.

Much thanks !

Hi, I cannot understand how the calibration data obtained with the main.py script in the gaze-data-collection project is used in this project. In that case a .csv file is produced and the calibration images are saved. How and where are this data used to optimize the gaze vector projection from the 3D space to the point on the monitor on the 2D space? The paper "Efficiency in Real-time Webcam Gaze Tracking" talks about three ways to perform this type of monitor calibration. Geometric, machine learning and hybrid? What kind of optimization do you apply?

Thanks

what you used python version?
i can't do pip install in python 3.7