Building of Informatics, Technology and Science
Vol 6 No 3 (2024): December 2024

Development of AI-Based Presentation Application using Deep Learning for Individuals With Disabilities

Hutagalung, Carli Apriansyah (Unknown)
Fitrianto, Adi (Unknown)
Akbar, Gebran (Unknown)



Article Info

Publish Date
26 Dec 2024

Abstract

This study addresses the challenges individuals with disabilities face in controlling presentation devices, particularly in noisy environments, by developing an AI-based application using a hybrid LSTM-GRU model. The primary objective is to improve voice command recognition accuracy for commonly used presentation commands, such as “next” and “back,” even under varying noise conditions. The research employs a hybrid deep learning architecture combining Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) with an attention mechanism to focus on the most relevant temporal features. The model was trained using the Speech Commands Dataset and further fine-tuned with noise-augmented data to simulate real-world environments. Results show that the LSTM-GRU model achieved high accuracy in clean environments and maintained reasonable performance in noisy conditions, outperforming traditional models like Hidden Markov Model (HMM) and Gaussian Mixture Model (GMM). The fine-tuned model, at its optimal epoch, demonstrated robust performance with a balanced precision and recall, making it suitable for deployment in real-world scenarios. The study concludes that while deep learning models offer significant improvements, further refinement is necessary to enhance noise resilience in practical applications

Copyrights © 2024






Journal Info

Abbrev

bits

Publisher

Subject

Computer Science & IT

Description

Building of Informatics, Technology and Science (BITS) is an open access media in publishing scientific articles that contain the results of research in information technology and computers. Paper that enters this journal will be checked for plagiarism and peer-rewiew first to maintain its quality. ...