Light

lysdexic-audio / jweb-hands-gesture-recognizer Goto Github PK

View Code? Open in Web Editor NEW

6.0 3.0 0.0 5.21 MB

A self contained example demonstrating how to use MediaPipe Hand Gesture Recognizer with Max's jweb connected to either a live webcamera stream or using still images. This example does both handtracking and gesture recognition.

License: GNU General Public License v3.0

CSS 0.70% JavaScript 9.90% HTML 1.53% Max 87.87%

gesture-recognizer jweb max maxmsp mediapipe mediapipe-hands mediapipe-gesture

jweb-hands-gesture-recognizer's Introduction

jweb-hands-gesture-recognizer

A self contained example demonstrating how to use MediaPipe Hand Gesture Recognizer with Max's jweb connected to either a live webcamera stream or using still images.

This example does both handtracking and gesture recognition. If you only require handtracking try: jweb-hands-landmarker

Features

The Gesture classification model bundle can recognize these common hand gestures:

0 - Unrecognized gesture, label: Unknown
1 - Closed fist, label: Closed_Fist
2 - Open palm, label: Open_Palm
3 - Pointing up, label: Pointing_Up
4 - Thumbs down, label: Thumb_Down
5 - Thumbs up, label: Thumb_Up
6 - Victory, label: Victory
7 - Love, label: ILoveYou

The hand landmark model bundle detects the keypoint localization of 21 hand-knuckle coordinates within the detected hand regions. The model was trained on approximately 30K real-world images, as well as several rendered synthetic hand models imposed over various backgrounds.

Resources

This example is inspired by an example by Rob Ramirez, which is in turn inspired by MediaPipe in JavaScript.

jweb-hands-gesture-recognizer's People

Contributors

Stargazers

Watchers

jweb-hands-gesture-recognizer's Issues

The webcam is white?

Hello,
I downloaded the hand gesture file, hand landmarks file and the face tracking file but the webcam cannot initialize? Is there any externals I should download or there's some issues with my max?

M4L device

Thanks for sharing these awesome patches! I'm trying to get the hands-gestures to work in M4L. While editing the device everything works but after closing the editor, the camera isn't picked up (jweb object remains blank) in Ableton. All necessary files are in the device folder. Freezing the device doesn't help. Ableton has access to the camera. Furthermore, when dragging the device into a Live set, Ableton wants to shut down and asks me to save/don't save/cancel... Any ideas what's going on and how I could solve this?

Ableton Live 12.0.2
Max 8.6.2
MacOS 14.4.1

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.