Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : International Journal of Advances in Intelligent Informatics

Detecting signal transtition in dynamic sign language using R-GB LSTM method Ridwang, Ridwang; Adriani, Adriani; rahmania, Rahmania; Sahrim, Mus’ab; Syahyadi, Asep Indra; Setiaji, Haris
International Journal of Advances in Intelligent Informatics Vol 10, No 2 (2024): May 2024
Publisher : Universitas Ahmad Dahlan

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.26555/ijain.v10i2.1445

Abstract

Sign Language Recognition (SLR) helps deaf people communicate with normal people. However, SLR still has difficulty detecting dynamic movements of connected sign language, which reduces the accuracy of detection. This results from a sentence's usage of transitional gestures between words. Several researchers have tried to solve the problem of transition gestures in dynamic sign language, but none have been able to produce an accurate solution. The R-GB LSTM method detects transition gestures within a sentence based on labelled words and transition gestures stored in a model. If a gesture to be processed during training matches a transition gesture stored in the pre-training process and its probability value is greater than 0.5, it is categorized as a transition gesture. Subsequently, the detected gestures are eliminated according to the gesture's time value (t). To evaluate the effectiveness of the proposed method, we conducted an experiment using 20 words in Indonesian Sign Language (SIBI). Twenty representative words were selected for modelling using our R-GB LSTM technique. The results are promising, with an average accuracy of 80% for gesture sentences and an even more impressive accuracy rate of 88.57% for gesture words. We used a confusion matrix to calculate accuracy, specificity, and sensitivity. This study marks a significant leap forward in developing sustainable sign language recognition systems with improved accuracy and practicality. This advancement holds great promise for enhancing communication and accessibility for deaf and hard-of-hearing communities.
Co-Authors Abdul Hafid Abiyani Choirul Huda ADRIANI ADRIANI Ahmad Basuki Al Maidah, Annisa Aldri Frinaldi Alfania, Alfania Anastasia Ampang Ariansyah, Kevin Donny Arifin, Irma Asdar Asdar Aswati M., Aswati Baharuddin Paloloang Buchair, Hikmah Budi M. Taftazani Cahyani, Rori Shanaz Dani, Andrea Tri Rian Diantika, Diantika Fabila, Nova Fajar, Muhammad Rizal Febrian Dedi Sastrawan Hamidah . Haq, Pendais Hartini, Diah Ayu Herlyn Safitri Desyanti Ihlas, Ihlas Ilham Bakri Abdul Rahim Thaha,Isrun, Ilham Bakri IMAMAH, NURIL Indriani Indriani Joni, M. Juniar, Firza KURNIA KURNIA, KURNIA Lucky Hartanti, Lucky Lumbantoruan, Hendra Eliakim M. Redho Maemunah Maherawati, Maherawati Mar'ah, Mar'ah Marlina Susanti Marselina Marselina Meidi Arisalwadi Menasita Mayantasari Muh Jusman Rau Muh. Reza Fachrul Jaya Muh. Rizal Muhammad Aqil Rusli, Muhammad Aqil Muhammad Danial Muhammad Ramadhan Muhammad Yunus Mutmainnah, Nurfadhilah Nunung Nurwati Nur Fatimah Nur, Adrian Rahmat Nurhayati, Andi Nuris, Nuris Nurul Hidayah Pajrul, Muh Prasetya, Arif Rendi Ramlawati Ramlawati Rasmid Rasmid, Rasmid Reychan Kusuma Raharja Ridwang Ridwang, Ridwang ROHANA ROHANA Rostamailis Rostamailis Sahrim, Mus’ab Sasria, Nia Sastrawan, Febrian Dedi Septiana, Atut Reni Setiaji, Haris Setyagustina, Kurniasih Sibuea, Nunti Sifriyani, Sifriyani Simbaju, Deiske Sitanggang, Syahrul Gunawan SUHITASARI, WINAHYU DWI Syafruddin Syafruddin SYAHYADI, ASEP INDRA Tabrani Gani Taigan , Andre Yohanes Umar, Mutmainnah Umrah Umrah Wahyuningsih, Rossy Timur Yanita, Merita Yelfi Yana Linda Br Sijabat