Journal of Soft Computing Exploration
Vol. 5 No. 3 (2024): September 2024

Real-time detection of indonesian sign language (ISL) gestures based on long short-term memory

Sari, Christy Atika (Unknown)
Rachmawanto, Eko Hari (Unknown)
Saifullah, Zidan (Unknown)
Jatmoko, Cahaya (Unknown)
Sinaga, Daurat (Unknown)



Article Info

Publish Date
22 Sep 2024

Abstract

eaf people often encounter communication challenges, and sign language serves as a crucial tool for those who cannot speak. In Indonesia, Indonesian Sign Language (ISL) or Sistem Isyarat Bahasa Indonesia (SIBI) is officially recognized by the government and is taught in Special Schools (Sekolah Luar Biasa - SLB). The sign language dictionary comprises 3483 words, facilitating communication and participation in daily life for the deaf community. This research aims to convert ISL gestures within SIBI into understandable text, employing the Long-Short-Term Memory (LSTM) method as the primary approach. The study conducted experiments with two models: Model 1, using a smaller dataset, and Model 2, employing a larger dataset and implementing the k-fold method. The results indicate that Model 2 with k-fold accuracy achieved an accuracy of 98%, while Model 1 reached an accuracy of 85%. Nevertheless, challenges persist in these models, particularly in detecting words with similar gestures, such as’maaf’ (sorry) and 'cinta' (love), which may still be misidentified. Despite these challenges, this research contributes positively to the development of assistive technology for the deaf community, enabling more effective communication through sign language.

Copyrights © 2024






Journal Info

Abbrev

joscex

Publisher

Subject

Computer Science & IT

Description

Journal of Soft Computing Exploration is a journal that publishes manuscripts of scientific research papers related to soft computing. The scope of research can be from the theory and scientific applications as well as the novelty of related knowledge insights. Soft Computing: Artificial ...