Jupiter
Vol 17 No 1 (2025): Jurnal Penelitian Ilmu dan Teknologi Komputer (JUPITER)

Sistem Klasifikasi Alfabet Bahasa Isyarat Indonesia Menggunakan CNN dengan MobileNetV2 berbasis Android

Reihan Saputra (Unknown)
Gentur Wahyu Nyipto Wibowo, S.Kom. M.Kom. (Unknown)
Akhmad Khanif Zyen, S.Kom. M.Kom. (Unknown)



Article Info

Publish Date
18 Jan 2025

Abstract

Communication is a basic human need, including for deaf and hard of hearing people who face difficulties in interacting using verbal language. One of the problems is the lack of optimal technology in supporting communication with Indonesian Sign Language (BISINDO) in real-time. This research aims to test the ability of MobileNetV2 in classifying the BISINDO alphabet as a technological solution that supports communication for the deaf and hard of hearing in real-time. This research dataset consists of 5200 BISINDO alphabet images (200 images per class) processed with data augmentation. The data is divided into 80% train data, 10% validation data, and 10% test data. Transfer learning was used to train the MobileNetV2 model with initial weights from ImageNet. The model is equipped with Global Average Pooling, Batch Normalization, and Dropout to improve performance. Training used Adam's optimizer with a learning rate of 1e-4. Evaluation resulted in validation accuracy of 95% and testing accuracy of 93.85%. The model is converted to TensorFlow Lite for use in Android applications, so that BISINDO alphabet classification can be done in real-time through the camera. This application is expected to be a solution for people who face difficulties in communicating with the deaf and speech impaired.   Keywords— Convolutional Neural Network (CNN), MobileNetV2, Sign Language

Copyrights © 2025






Journal Info

Abbrev

jupiter

Publisher

Subject

Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Electrical & Electronics Engineering Industrial & Manufacturing Engineering Library & Information Science

Description

Tentang Jurnal Ini Fokus dan Ruang Lingkup Bidang kajian yang dapat dimuat pada jurnal Jupiter meliputi dan tidak terbatas pada: Mobile Computing Image Processing Computer Graphic Artificial Intelligence Information Retrieval Computer Vision Algorithm & Complexity Data Mining Information System ...