Git Product home page Git Product logo

bbiyongel / american-sign-language-detection-using-computer-vision Goto Github PK

View Code? Open in Web Editor NEW

This project forked from namanmanchanda09/american-sign-language-detection-using-computer-vision

0.0 0.0 0.0 35.82 MB

The project consists of American Sign Language Translator to English language. It uses Computer Vision and Deep Learning to predict the ASL alphabet and forms sentences on the basis of prediction. It uses text to speech to convert the predicted word into speech. The project was implemented at MNNIT Hack36 Allahabad Hackathon.

Home Page: https://www.youtube.com/watch?v=mIyWNsGfHAQ

Jupyter Notebook 97.74% Python 2.26%

american-sign-language-detection-using-computer-vision's Introduction

Hack36_Project_Team MISFITS

Hack36 MNNIT Allahabad Hackathon Submission

American Sign Language Detection using Deep Neural Networks

American Sign Language (ASL) is a visual language. With signing, the brain processes linguistic information through the eyes. The shape, placement, and movement of the hands, as well as facial expressions and body movements, all play important parts in conveying information. It is the primary language of many North Americans who are deaf and hard of hearing, and is used by many hearing people as well. The project can be used by dumb people to easily communicate with people who doesn't understand sign language. ASL

Formation of message using finger spelling in ASL

Fingerspelling is part of ASL and is used to spell out English words. In the fingerspelled alphabet, each letter corresponds to a distinct handshape. Fingerspelling is often used for proper names or to indicate the English word for something. We are using Convolutional Neural Networks to predict the sign language letter and combine those predicted letters to form the sentence to be conveyed. The message will then be converted from text to speech using Python's built-in support. The input will be provided in real time using the webcam.

Data Source

https://www.kaggle.com/grassknoted/asl-alphabet

Project Demo

https://www.youtube.com/watch?v=mIyWNsGfHAQ

Prediction of Alphabet A

WhatsApp Image 2020-02-16 at 6 15 27 AM

Prediction of Alphabet L

WhatsApp Image 2020-02-16 at 6 14 19 AM

Final Message

WhatsApp Image 2020-02-16 at 6 13 45 AM

american-sign-language-detection-using-computer-vision's People

Contributors

dependabot[bot] avatar namanmanchanda09 avatar vatsalgupta02 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.