TELKOMNIKA (Telecommunication Computing Electronics and Control)
Vol 22, No 6: December 2024

Real time Indian sign language recognition using transfer learning with VGG16

Sumit Kumar (Symbiosis International (Deemed University))
Ruchi Rani (Dr. Vishwanath Karad MIT World Peace University)
Sanjeev Kumar Pippal (GL Bajaj Institute of Technology and Management)
Ulka Chaudhari (Dr. Vishwanath Karad MIT World Peace University)



Article Info

Publish Date
01 Dec 2024

Abstract

Normal people’s interaction and communication are easier than those with disabilities such as hearing and speech, which are very complicated; hence, the use of sign language plays a crucial role in bridging this gap in communication. While previous attempts have been made to solve this problem using deep learning techniques, including convolutional neural networks (CNNs), support vector machine (SVM), and K-nearest neighbours (KNN), these have low accuracy or may not be employed in real time. This work addresses both issues: improving upon prior limitations and extending the challenge of classifying characters in Indian sign language (ISL). Our system, which can recognize 23 hand gestures of ISL through a purely camera-based approach, eliminates expensive hardware like hand gloves, thus making it economical. The system yields an accuracy of 97.5% on the training dataset, utilizing a pre-trained VGG16 CNN optimized by the Adam optimizer and cross-entropy loss function. These results clearly show how effective transfer learning is in classifying ISL and its possible real-world applications.

Copyrights © 2024






Journal Info

Abbrev

TELKOMNIKA

Publisher

Subject

Computer Science & IT

Description

Submitted papers are evaluated by anonymous referees by single blind peer review for contribution, originality, relevance, and presentation. The Editor shall inform you of the results of the review as soon as possible, hopefully in 10 weeks. Please notice that because of the great number of ...