Bulletin of Electrical Engineering and Informatics
Vol 15, No 4: August 2026

An assistive communication system for mute individuals using MATLAB-based image processing and sensor integration

Mohan P. Thakre (Walchand College of Engineering)
Krupali Kanekar (Ramrao Adik Institute of Technology, D. Y. Patil deemed to be university)
Badal Kumar (JSPM University)
Alok Kumar (JSPM University)
Supriya Nilesh Thakur (Marathawada Mitra Mandal'
s College of Engineering Karvenagar)

Pranali M. Thakre (Willingdon College)
Prashant K. Magadum (Brahmdevdada Mane Institute of Technology)



Article Info

Publish Date
01 Aug 2026

Abstract

Interactions between non-verbal people and verbal communicators have always presented serious challenges. Although functional, current sign language systems often lack the flexibility and affordability needed for wider use. This document provides a novel speaking system created for those who are mute, supporting communication using two methodologies: i) recognition of hand motions with flex sensors and ii) detection of finger positions through image processing techniques combined with MATLAB. The setup in question uses a single camera and a Raspberry Pi to capture hand photos. Finger coordinates are then extracted from these photos and compared to an existing database for matching. An appropriate verbal output is then produced from the identified gesture. Flex sensor-based inputs are simultaneously connected to an Arduino, which uses a Bluetooth module to transmit text data to an external application for speech conversion. This dual-mode technology improves everyday communication for people who are silent by providing a customized and efficient framework for converting sign-based gestures into vocal communications. This approach makes a significant contribution to the development of inclusive technology by offering an affordable, adaptable, and practical alternative for assistive communication.

Copyrights © 2026






Journal Info

Abbrev

EEI

Publisher

Subject

Electrical & Electronics Engineering

Description

Bulletin of Electrical Engineering and Informatics (Buletin Teknik Elektro dan Informatika) ISSN: 2089-3191, e-ISSN: 2302-9285 is open to submission from scholars and experts in the wide areas of electrical, electronics, instrumentation, control, telecommunication and computer engineering from the ...