Git Product home page Git Product logo

a-silent-voice's Introduction

A Silent Voice Logo

A Silent Voice

An application of Convolutional Neural Networks along with various computer vision algorithms for recognizing Filipino Sign Language. The project serves as an undergraduate thesis of the developers in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science at Holy Angel University.

Project Scope and Delimitation

  1. Best results are acquired on a simple white background.
  2. Filipino Sign Language Gestures of Letters A-Z

Project Dependencies

  • opencv-python 3.4.1.15
  • pywin32 223
  • pyttsx3 2.7
  • scikit-learn 0.19.1
  • tensorflow 1.8.0 (non-gpu)
  • keras 2.2.0
  • pyqt5 4.19.8
  • matplotlib 2.2.2

Note: Additional dependencies may be required by the above listed modules.

Installing Project Dependencies

As of the moment, automatic installation of the project's dependencies is only available to the Windows OS. Simply run the wininstall.bat included in the project by double clicking or using the command prompt.

cd MainDirectoryOfASilentVoice
wininstall

Datasets

For each gesture, 1300 greyscaled and thresholded images were used to train the model. The developers have decided to flip 1300 of these images to give consideration to both right and left handed users. A total of 2400 images are used per gesture. Datasets are uploaded on google drive as the developers consider them too large to be uploaded on an online repository. The datasets can be found here.

Developers

  • Diaz, Jericho Hans
  • De Leon, Julius
  • Jimenez, John Joshua
  • Olsen, Ola

License

GNU Affero General Public License v3.0. For a more detailed explanation, check it out here.

Acknowledgements

De Leon, J., Diaz, J. H., Jimenez, J. J., & Olsen, O. (2018). A Silent Voice: An Application of Computer Vision for Recognizing Filipino Sign Language (p. iii). Holy Angel University.

The researchers would like to express their utmost gratitude to the following instructors: Ms. Ma. Louella Salenga for providing advices and guidance during the initial stages of the research and Ms. Arcely Napalit for being the adviser and contributing her knowledge and expertise to make the research a success. The researchers extend their heartfelt gratitude to the Principal of Angeles Elementary School, Ms. Ofelia Canlas, for giving the researchers permission to conduct their research on the school, as well as the professional Filipino Sign Language interpreters/teachers: Ms. Editha Peña, Ms. Melodia Delfin and Ms. Lovely Katlin Garcia. The researchers express their gratitude to the representative of Philippine Registry of Interpreters for the Deaf (PRID), Ms. Vivian Saulo, for providing data as well as sharing her knowledge and resources about Filipino Sign Language. To the Machine Learning Professionals, Mr. Arian Yambao, Mr. John Paul Ada and Mr. Jake Abasolo, the researchers would like to expresses their gratitude for evaluating and providing professional feedback about the prototype and the model. Special thanks to the Hearing-Impaired Interviewees, Ms. Sanchez, Mr. Panlilio and Ms. Silvestre and to the Non-Hearing-Impaired Interviewees, Mrs. Sanchez, Mrs. Nicdao and Mrs. Panlilio for their continuous support throughout the multiple visitations of the researchers. Lastly, the researchers extend their heartfelt gratitude to their friends, classmates, family and most especially to God, for not with their support would have made the research possible.

a-silent-voice's People

Contributors

jerichodiaz avatar jjjimenez100 avatar olaolsen22 avatar mekkiharu avatar

Stargazers

 avatar Lloyd Escoto avatar  avatar  avatar

Watchers

James Cloos avatar  avatar  avatar

Forkers

jerichodiaz

a-silent-voice's Issues

[Documentation] Establish new pre and post test instruments.

Pre-Survey:

Observation
(Establish the need for the application, specify the problem.)

Interview
(Experts): 3 Teachers/Interepreters of ASL (Identify resources for information)
3 Non-SL people of Angeles Elementary School (Re-establish the need)


Post-Evaluation:
(Experts): 3 Computer Science Grads (BS, Masteral, Doctorate, etc.)
(Experts): Previous 3 Teachers/Interpreters of ASL (Evaluate the system)
Previous 3 Non-SL people of Angeles Elementary School (Evaluate the system)

Dataset URL is missing

The URL for the dataset is missing.
How are able to recognize the J letter in the FSL?

Gather new datasets

200 for each letter, on each person, on a different shade of white background, as well as different lighting condition.

[Documentation] Expert CVs

Arian Yambao, John Ada - Done
Ms. Edith - Done

Ms. Lovely, Ms. Delfin - Not done
AI Expert One - Not done

Re-structure post evaluation questionnaire.

Questions for asl and ai experts should adhere to the evaluation machine learning models book. User questions should be adjusted based on the functionalities of the prototype.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.