Article Per Year (5 Year)
p-Index From 2020 - 2025
0.947
P-Index
This Author published in this journals
All Journal Jurnal Ilmu Komputer dan Informasi Journal of ICT Research and Applications Indonesian Journal of Electrical Engineering and Computer Science
Erdefi Rakun
Universitas Indonesia
Computer Science & IT

Published : 5 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Journal of ICT Research and Applications

 1 
Translating SIBI (Sign System for Indonesian Gesture) Gesture-to-Text in Real-Time using a Mobile Device Misael Jonathan; Erdefi Rakun
Journal of ICT Research and Applications Vol. 16 No. 3 (2022)
Publisher : DRPM - ITB

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.5614/itbj.ict.res.appl.2022.16.3.5

Abstract

The SIBI gesture translation framework by Rakun was built using a series of machine learning technologies: MobileNetV2 for feature extraction, Conditional Random Field for finding the epenthesis movement frame, and Long Short-Term Memory for word classification. This high computational translation system was previously implemented on a personal computer system, which lacks portability and accessibility. This study implemented the system on a smartphone using an on-device inference method: the translation process is embedded into the smartphone to provide lower latency and zero data usage. The system was then improved using a parallel multi-inference method, which reduced the average translation time by 25%. The final mobile SIBI gesture-to-text translation system achieved a word accuracy of 90.560%, a sentence accuracy of 64%, and an average translation time of 20 seconds.
Co-Authors I Gusti Bagus Hadi Widhinugraha Misael Jonathan Noer Fitria Putra Setyono Noer FP Setyono Saputra, Muhammad Alfhi Satria Putra