Jurnal Satya Informatika
Vol. 10 No. 2 (2025): JURNAL SATYA INFORMATIKA

PENERAPAN CONVOLUTIONAL NEURAL NETWORK PADA PENGENALAN BAHASA ISYARAT INDONESIA SECARA REAL-TIME

Maulana, Rifki Ryan (Unknown)
Abdul Kholiq (Unknown)
Edy Widodo (Unknown)



Article Info

Publish Date
01 Sep 2025

Abstract

Sign language is a form of visual communication used by individuals who are deaf or speech-impaired. However, many people in the general public still lack understanding of sign language, which hinders communication between people with disabilities and their surroundings. This research aims to develop a real-time alphabet translator system for Indonesian Sign Language (BISINDO), implemented as an Android application. The system utilizes a Convolutional Neural Network (CNN) model based on the MobileNetV2 architecture, which is trained to recognize 26 alphabet letters from hand gesture images sized 128x128 pixels in RGB format. The dataset was collected and processed through augmentation and divided into training, validation, testing, and evaluation sets. The model was trained using transfer learning and fine-tuning methods and then converted into TensorFlow Lite (.tflite) format for deployment on Android devices. Evaluation results show that the model achieved an average accuracy of 93% on the evaluation dataset. Testing the Android application also demonstrated good real-time performance in recognizing hand gestures. This application is expected to help bridge communication between people with disabilities and the general public through practical and accessible technology.

Copyrights © 2025






Journal Info

Abbrev

jsk

Publisher

Subject

Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Electrical & Electronics Engineering Library & Information Science Social Sciences Other

Description

Jurnal Satya Informatika adalah informasi yang menyajikan tentang ilmu pengetahuan dan informasi penelitian atau aplikasi penelitian dan pengembangan terkini yang berhubungan dengan bidang Teknologi Informasi yang ada di Univeritas Satya Negara Indonesia (USNI). Jurnal Satya Informatika merupakan ...