Bulletin of Electrical Engineering and Informatics
Vol 13, No 1: February 2024

An Adam based CNN and LSTM approach for sign language recognition in real time for deaf people

Kumer Paul, Subrata (Unknown)
Ala Walid, Md. Abul (Unknown)
Rani Paul, Rakhi (Unknown)
Uddin, Md. Jamal (Unknown)
Rana, Md. Sohel (Unknown)
Kumar Devnath, Maloy (Unknown)
Rahman Dipu, Ishaat (Unknown)
Haque, Md. Momenul (Unknown)



Article Info

Publish Date
01 Feb 2024

Abstract

Hand gestures and sign language are crucial modes of communication for deaf individuals. Since most people can't understand sign language, it's hard for a mute and an average person to talk to each other. Because of technological progress, computer vision and deep learning can now be used to count. This paper shows two ways to use deep knowledge to recognize sign language. These methods help regular people understand sign language and improve their communication. Based on American sign language (ASL), two separate datasets have been constructed; the first has 26 signs, and the other contains three significant symbols with the crucial sequence of frames or videos for regular communication. This study looks at three different models: the improved ResNet-based convolutional neural network (CNN), the long short-term memory (LSTM), and the gated recurrent unit (GRU). The first dataset is used to fit and assess the CNN model. With the adaptive moment estimation (Adam) optimizer, CNN obtains an accuracy of 89.07%. In contrast, the second dataset is given to LSTM and GRU and a comparison has been conducted. LSTM does better than GRU in all classes. LSTM has a 94.3% accuracy, while GRU only manages 79.3%. Our preliminary models' real-time performance is also highlighted.

Copyrights © 2024






Journal Info

Abbrev

EEI

Publisher

Subject

Electrical & Electronics Engineering

Description

Bulletin of Electrical Engineering and Informatics (Buletin Teknik Elektro dan Informatika) ISSN: 2089-3191, e-ISSN: 2302-9285 is open to submission from scholars and experts in the wide areas of electrical, electronics, instrumentation, control, telecommunication and computer engineering from the ...