Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal Bulletin of Electrical Engineering and Informatics
Caballero-Hernandez, Héctor
Unknown Affiliation
Electrical & Electronics Engineering

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
Translation of Mexican sign language into Spanish using machine learning and internet of things devices Caballero-Hernandez, Héctor; Muñoz-Jiménez, Vianney; Ramos-Corchado, Marco Antonio
Bulletin of Electrical Engineering and Informatics Vol 13, No 5: October 2024
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/eei.v13i5.7853

Abstract

This paper describes an application based on internet of things (IoT) and gesture recognition through the MediaPipe library to communicate people with hearing and speech disabilities who use Mexican sign language (MSL) with people who do not have a disability. The system is made up of two modules, on the one hand, there is an Apple watch with the ability to obtain text and voice inputs in Spanish to stand for the translation into sign language through video and images. The system can set up a connection with an application in charge of performing sign recognition by capturing images from a camera, the IoT user can connect so that communication between both modules is carried out bidirectionally through Firebase database. During the development of the experimental tests, the visual recognition module was able to recognize signs belonging to the Spanish alphabet, digits, and greetings, with a 96% of precision, while the IoT device correctly displayed voice translations and text to symbology compared to the MSL.
Co-Authors Muñoz-Jiménez, Vianney Ramos-Corchado, Marco Antonio