IJoICT (International Journal on Information and Communication Technology)
Vol. 9 No. 2 (2023): Vol.9 No. 2 Dec 2023

The The Recognition of American Sign Language Using CNN with Hand Keypoint

Muhamad Asep Ridwan (Universitas Siliwangi)
Aradea (Unknown)
Husni Mubarok (Unknown)



Article Info

Publish Date
16 Dec 2023

Abstract

Sign Language is a method used by the deaf community for their communication. In line with the advances of deep learning, researchers have widely interpreted neural networks for language recognition in recent years. Many models and hardware have been developed to help get high accuracy in language recognition, but generally, the problem of accuracy is still a concern of researchers, even the accuracy problem related to American language or American sign language (ASL) still requires further research to solve. This paper discusses a method to improve ASL recognition accuracy using Convolutional Neural Network (CNN) with hand keypoint. Pre-trained Keypoint detector is used to generate hand keypoints on the massey dataset as an input for classification in the CNN model. The results show that the accuracy of the proposed method is better than the previous studies, obtaining an accuracy of 99.1% in recognizing the 26 statistical signs of the ASL alphabet.

Copyrights © 2023






Journal Info

Abbrev

ijoict

Publisher

Subject

Computer Science & IT

Description

International Journal on Information and Communication Technology (IJoICT) is a peer-reviewed journal in the field of computing that published twice a year; scheduled in December and ...