Supriya Nilesh Thakur
Marathawada Mitra Mandal's College of Engineering Karvenagar

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

An assistive communication system for mute individuals using MATLAB-based image processing and sensor integration Mohan P. Thakre; Krupali Kanekar; Badal Kumar; Alok Kumar; Supriya Nilesh Thakur; Pranali M. Thakre; Prashant K. Magadum
Bulletin of Electrical Engineering and Informatics Vol 15, No 4: August 2026
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/eei.v15i4.11395

Abstract

Interactions between non-verbal people and verbal communicators have always presented serious challenges. Although functional, current sign language systems often lack the flexibility and affordability needed for wider use. This document provides a novel speaking system created for those who are mute, supporting communication using two methodologies: i) recognition of hand motions with flex sensors and ii) detection of finger positions through image processing techniques combined with MATLAB. The setup in question uses a single camera and a Raspberry Pi to capture hand photos. Finger coordinates are then extracted from these photos and compared to an existing database for matching. An appropriate verbal output is then produced from the identified gesture. Flex sensor-based inputs are simultaneously connected to an Arduino, which uses a Bluetooth module to transmit text data to an external application for speech conversion. This dual-mode technology improves everyday communication for people who are silent by providing a customized and efficient framework for converting sign-based gestures into vocal communications. This approach makes a significant contribution to the development of inclusive technology by offering an affordable, adaptable, and practical alternative for assistive communication.