Science in Information Technology Letters
Vol 4, No 2 (2023): November 2023

Hand image reading approach method to Indonesian Language Signing System (SIBI) using neural network and multi layer perseptron

Bagaskoro, Muhammad Cahyo (Unknown)
Prasojo, Fadillah (Unknown)
Handayani, Anik Nur (Unknown)
Hitipeuw, Emanuel (Unknown)
Wibawa, Aji Prasetya (Unknown)
Liang, Yoeh Wen (Unknown)



Article Info

Publish Date
24 Nov 2023

Abstract

Classification complexity is the main challenge in recognizing sign language through the use of computer vision to classify Indonesian Sign Language (SIBI) images automatically. It aims to facilitate communication between deaf or mute and non-deaf individuals, with the potential to increase social inclusion and accessibility for the disabled community. The comparison of algorithm performance in this research is between the neural network algorithm and multi-layer perceptron classification in letter recognition. This research uses two methods, namely a neural network and a multi-layer perceptron, to measure accuracy and precision in letter pattern recognition, which is expected to provide a foundation for the development of better sign language recognition technology in the future. The dataset used consists of 32,850 digital images of SIBI letters converted into alphabetic sign language parameters, which represent active signs. The developed system produces alphabet class labels and probabilities, which can be used as a reference for the development of more sophisticated sign language recognition models. In testing using the neural network method, good discrimination results were obtained with precision, recall and accuracy of around ±81%, while in testing using the multi-layer perceptron method around ±86%, showing the applicative potential of both methods in the context of sign language recognition. Testing of the two normalization methods was carried out four times with comparison of the normalized data, which can provide further insight into the effectiveness and reliability of the normalization technique in improving the performance of sign language recognition systems.

Copyrights © 2023






Journal Info

Abbrev

sitech

Publisher

Subject

Computer Science & IT

Description

Science in Information Technology Letters (SITech) aims to keep abreast of the current development and innovation in the area of Science in Information Technology as well as providing an engaging platform for scientists and engineers throughout the world to share research results in related ...