Proceedings of Malikussaleh International Conference on Multidisciplinary Studies (MICoMS)
Vol. 4 (2024): Proceedings of Malikussaleh International Conference on Multidisciplinary Studies (MI

Indonesian Sign Language (BISINDO) Alphabet Detection System Using YOLO (You Only Look Once) Algorithm

Andra Munandar (Universitas Malikussaleh)
Zara Yunizar (Universitas Malikussaleh)
Sujacka Retno (Universitas Malikussaleh)



Article Info

Publish Date
18 Dec 2024

Abstract

This research aims to develop an Indonesian Sign Language (BISINDO) alphabet detection system using the YOLOv5 algorithm, an efficient and fast deep learning-based object detection model. The dataset used consists of BISINDO alphabet images enriched through data augmentation techniques such as rotation, flipping, and brightness adjustment. The evaluation results show that the YOLOv5s model achieved very good performance, with an average precision of 85.2%, recall of 89.3%, F1-score of 87.2%, and mean average precision (mAP) of 87.1%. The confusion matrix also indicates the model's ability to differentiate each BISINDO alphabet with high accuracy. The training data testing showed the model successfully achieved consistent decreases in all loss components, such as a decrease in train box loss from 0.06 to 0.015, and validation loss converging towards 0.002 for object loss and class loss. The real time testing also shows that the YOLOv5-based BISINDO alphabet detection system can perform well and consistently, indicating the practical application potential of this system to facilitate communication between people with hearing/speech disabilities and the general public. Overall, this research has resulted in an accurate and realtime implementable BISINDO alphabet recognition system.

Copyrights © 2024






Journal Info

Abbrev

micoms

Publisher

Subject

Engineering Environmental Science Physics

Description

The proceedings compile a wide range of research papers presented during the conference, showcasing the commitment of the academic and professional community to exploring innovations in polymer materials and their eco-friendly applications. Key Topics Discussed: Polymer Materials and Sustainable ...