Barry Ceasar Octariadi
Department of Informatics Engineering, Faculty of Engineering and Computer Science, Universitas Muhammadiyah Pontianak, Indonesia

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

Indonesian Sign Language Letter Recognition Using Mediapipe Hand Landmark Extraction And Random Forest Classification Barry Ceasar Octariadi; Alda Cendekia Siregar; Sucipto Sucipto; Azrul Fathany
Jurnal Teknik Informatika (Jutif) Vol. 7 No. 5 (2026): JUTIF Volume 7, Number 5, October 2026
Publisher : Informatika, Universitas Jenderal Soedirman

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52436/1.jutif.2026.7.5.5841

Abstract

This study aims to recognize letter patterns in Indonesian Sign Language (BISINDO) using the Random Forest algorithm. BISINDO represents 26 alphabet letters through distinct hand gestures. To automate the recognition process, this research utilizes MediaPipe for real-time feature extraction. MediaPipe detects and tracks hand movements using handedness to distinguish between left and right hands, as well as landmarks and world landmarks to capture key coordinate points that serve as input features for classification. The model is evaluated under various conditions, including differences in distance and lighting. Experimental results show that the model performs optimally at a distance of 30 cm. Under normal lighting conditions, the system achieves an accuracy of 88% by correctly recognizing 23 classes in the first test, and improves to 96% with 25 recognized classes in the second test, resulting in an average accuracy of 92%. However, under low-light conditions at the same distance, performance decreases, where only 9 out of 13 tested classes are correctly recognized, yielding an accuracy of 69%. When the distance increases to 60 cm, the model’s performance further declines, with 22 classes recognized at 84% accuracy in the first test and 20 classes at 76% accuracy in the second test. Further evaluation using a confusion matrix shows excellent classification performance, achieving 100% accuracy, recall, and precision. Overall, the integration of MediaPipe and Random Forest proves effective for BISINDO letter recognition and contributes to the development of assistive technologies that support inclusive communication through computer vision and machine learning approaches.