Jurnal Pengembangan Riset dan Observasi Teknik Informatika
Vol. 11 No. 2 (2024)

Implementasi Algoritma You Only Look Once (YOLO) untuk Mendeteksi Bahasa Isyarat SIBI

Pratama, Bagus Kurniawan (Unknown)
Sri Lestanti (Unknown)
Yusniarsi Primasari (Unknown)



Article Info

Publish Date
28 Aug 2024

Abstract

The Indonesian Sign Language System (SIBI) is a translator of sign language into text or speech. This research aims to bridge communication between ordinary people and speech impaired people through the introduction of SIBI sign language using the YOLO algorithm. This research uses 24 alphabets which are divided into 4 groups, where each alphabet has 20 image data which is divided into 70% train data, 25% valid data, and 5% test data. The train data was then added with augmented data from Roboflow which was then carried out using a training process using a batch number of 16 and epochs of 100. The results of the research show that the YOLO algorithm can detect SIBI sign language alphabet gestures using confusion matrix testing and achieve quite good performance, as shown by the results F1 Score: Group 1 was 90.90%, Group 2 was 97.1%, Group 3 was 90.90%, and Group 4 was 83.8%. Other factors such as hand size, lighting conditions, and variations in data position also affect detection accuracy. A limitation in this research is that the alphabets J and Z were not included because these two alphabets not only use shape patterns, but also gesture patterns.

Copyrights © 2024






Journal Info

Abbrev

ProTekInfo

Publisher

Subject

Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management

Description

rotekinfo (Pengembangan Riset dan Observasi Teknik Informatika) is a Computer Science or Informatics journal published by Program Studi Informatika Universitas Serang Raya with registered number ISSN 2406-7741(Print) 2597-6559 (On-Line). This journal aims to publish the results of research in the ...