Andra Munandar
Universitas Malikussaleh

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

Indonesian Sign Language (BISINDO) Alphabet Detection System Using YOLO (You Only Look Once) Algorithm Andra Munandar; Zara Yunizar; Sujacka Retno
Proceedings of Malikussaleh International Conference on Multidisciplinary Studies (MICoMS) Vol. 4 (2024): Proceedings of Malikussaleh International Conference on Multidisciplinary Studies (MI
Publisher : LPPM Universitas Malikussaleh

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.29103/micoms.v4i.952

Abstract

This research aims to develop an Indonesian Sign Language (BISINDO) alphabet detection system using the YOLOv5 algorithm, an efficient and fast deep learning-based object detection model. The dataset used consists of BISINDO alphabet images enriched through data augmentation techniques such as rotation, flipping, and brightness adjustment. The evaluation results show that the YOLOv5s model achieved very good performance, with an average precision of 85.2%, recall of 89.3%, F1-score of 87.2%, and mean average precision (mAP) of 87.1%. The confusion matrix also indicates the model's ability to differentiate each BISINDO alphabet with high accuracy. The training data testing showed the model successfully achieved consistent decreases in all loss components, such as a decrease in train box loss from 0.06 to 0.015, and validation loss converging towards 0.002 for object loss and class loss. The real time testing also shows that the YOLOv5-based BISINDO alphabet detection system can perform well and consistently, indicating the practical application potential of this system to facilitate communication between people with hearing/speech disabilities and the general public. Overall, this research has resulted in an accurate and realtime implementable BISINDO alphabet recognition system.