Git Product home page Git Product logo

raselane / conversion-of-pakistan-sign-languag-into-text-and-speech-using-openpose-and-machine-learning Goto Github PK

View Code? Open in Web Editor NEW

This project forked from saadbutt32/conversion-of-pakistan-sign-languag-into-text-and-speech-using-openpose-and-machine-learning

0.0 0.0 0.0 492.16 MB

Real-time translation of Pakistan sign language into text and speech using OpenPose and Machine Learning

License: GNU General Public License v3.0

JavaScript 0.07% Python 82.43% CSS 1.45% HTML 16.05%

conversion-of-pakistan-sign-languag-into-text-and-speech-using-openpose-and-machine-learning's Introduction

Conversion of Pakistan Sign Language into text and speech using Machine Learning

The University of Lahore (Department of CS & IT) (Fall 2015 โ€“ Spring 2019) - Final Year Project

Supervised by:

Dr. Mudasser Naseer

Group Members
  • Muhammad Junaid Ejaz
  • Muhammad Saad Qadri

The project is divided into 3 main modules

  • RealTime sign detection module - convert Pakistan Sign Language (PSL) alphabet and words into text and speech in realtime.
  • Capture Dataset module - Automated system for capturing and adding new data to the dataset
  • PSl learning module - Learn PSL interactively

Dependencies

The system uses OpenPose v1.5.0 library for extacting skelatal features.
The code was developed with python 3.7 and has been tested with the libraries/versions in requirements.txt file.

Dataset Used

We have made our own Pakistan Sign Language (PSL) dataset containing multiple samples of 37 urdu aplhabets and 12 urdu words. The dataset is made publically available at: https://www.kaggle.com/saadbutt321/pakistan-sign-language-dataset

External resources

OpenPose GitHub repo: https://github.com/CMU-Perceptual-Computing-Lab/openpose Origin of OpenPose: https://github.com/ZheC/Realtime_Multi-Person_Pose_Estimation Paper describing the method: https://arxiv.org/abs/1611.08050 Keras implementation of the Realtime Multi-Person Pose Estimation (my major inspiration): https://github.com/michalfaber/keras_Realtime_Multi-Person_Pose_Estimation.

conversion-of-pakistan-sign-languag-into-text-and-speech-using-openpose-and-machine-learning's People

Contributors

saadbutt32 avatar dependabot[bot] avatar juni05 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.