Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Journal of Dinda : Data Science, Information Technology, and Data Analytics

CNN-LSTM for MFCC-based Speech Recognition on Smart Mirrors for Edge Computing Command Aji Gautama Putrada; Ikke Dian Oktaviani; Mohamad Nurkamal Fauzan; Nur Alamsyah
Indonesian Journal of Data Science, IoT, Machine Learning and Informatics Vol 4 No 2 (2024): August
Publisher : Research Group of Data Engineering, Faculty of Informatics

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.20895/dinda.v4i2.1504

Abstract

Smart mirrors are conventional mirrors that are augmented with embedded system capabilities to provide comfort and sophistication for users, including introducing the speech command function. However, existing research still applies the Google Speech API, which utilizes the cloud and provides sub-optimal processing time. Our research aim is to design speech recognition using Mel-frequency cepstral coefficients (MFCC) and convolutional neural network–long short-term memory (CNN-LSTM) to be applied to smart mirror edge devices for optimum processing time. Our first step was to download a synthetic speech recognition dataset consisting of waveform audio files (WAVs) from Kaggle, which included the utterances “left,” “right,” “yes,” “no,” “on,” and “off. ” We then designed speech recognition by involving Fourier transformation and low-pass filtering. We benchmark MFCC with linear predictive coding (LPC) because both are feature extraction methods on speech datasets. Then, we benchmarked CNN-LSTM with LSTM, simple recurrent neural network (RNN), and gated recurrent unit (GRU). Finally, we designed a smart mirror system complete with GUI and functions. The test results show that CNN-LSTM performs better than the three other methods with accuracy, precision, recall, and an f1-score of 0.92. The speech command with the best precision is "no," with a value of 0.940. Meanwhile, the command with the best recall is "off," with a value of 0.963. On the other hand, the speech command with the worst precision and recall is "other," with a value of 0.839. The contribution of this research is a smart mirror whose speech commands are carried out on the edge device with CNN-LSTM.
Co-Authors Abdillah, Hilal Nabil Abiyan Bagus Baskoro Aditya Firman Ihsan Adrian Gusti Nurcahyo Agita Rachmad Muzakhir Algi Fajardi Alieja Muhammad Putrada Andrian Rakhmatsyah Angga Anjaini Sundawa Anita Auliani Argo Surya Adi Dewantoro Aziz Nurul Iman Baginda Achmad Fadillah Bambang Setia Nugroho Bayu Kusuma Belva Rabbani Driantama Bramantio Agung Prabowo Calvin M.T Manurung Catur Wirawan W Catur Wirawan Wijiutomo Daniel Arga Amallo Dawani, Febri Dicky Prasetiyo Dita Oktaria Doan Perdana Dodi W. Sudiharto Dodi Wisaksono Sudiharto Dody Qori Utama Endro Ariyanto Erwid Musthofa Jadied Fachrial Akbar Fadhlillah Fadhlillah Fadhlurahman Irwan Fairus Zuhair Azizy Atoir Fakhri Akbar Pratama Farisah Adilia Fauzan Ramadhan Sudarmawan Fauzan, Mohamad Nurkamal Fauzan, Mohamad Nurkamal Fazmah Arif Yulianto Febrina Puspita Utari Fitra Ilham Gabe Dimas Wicaksana Gentur Cipto Tri Atmaja Hamman Aryo Bimmo Hanifa Zahra Dhiah Hilal Hudan Nuha Hirianinda Malsegianty S Ikbar Mahesa Ikke Dian Oktaviani Ikke Dian Oktaviani Ikrimah Muiz Ilham Fadli Surbakti Imas Nur Tiarani Irfan Dwi Wijaya Irfan Nugraha Januar Triandy Nur Elsan Krisna Kristiandi Hartono Kurnia Wisuda Aji Mahmud Dwi Sulistiyo Mahmud Imroba Maman Abdurohman Maman Abdurrahman Mar Ayu Fotina Mas'ud Adhi Saputra Maya Ameliasari Mohamad Nurkamal Fauzan Mohamad Nurkamal Fauzan Mohamad Nurkamal Fauzan Muhamad Nurkamal Fauzan Muhammad Al Makky Muhammad Alkahfi Khuzaimy Abdullah Muhammad Dafa Prima Aji Muhammad Fahmi Nur Fajri Muhammad Ihsan Muhammad Kukuh Alif Lyano Muhammad Shibgah Aulia Muhhamad Affan Hasby Muhhamad Affan Hasby Muhtadu Syukur A Mulia Hanif Nando, Parlin Nando, Parlin Niken Cahyani Novian Anggis Suwastika Nuha, Hilal H Nur Alamsyah NUR ALAMSYAH Nur Alamsyah, Nur Nur Ghaniaviyanto Ramadhan Nurkamal Fauzan, Mohamad Pahlevi , Rizka Reza Pamungkas, Rizaldi Ramdlani Parman Sukarno Prasti Eko Yunanto Putrada, Alieja Muhammad Putri Azanny Raden Muhamad Yuda Pradana Kusumah Rafie Afif Andika Rahmat Suryoputro Rahmat Yasirandi Randy Agustyo Raharjo Reynaldo Lino Haposan Pakpahan Richasdy, Donny Rizki Jamilah Guci Sabrina Adinda Sari Sailellah, Hassan Rizky Putra Seli Suhesti Sena Amarta Sidik Prabowo Siti Amatullah Karimah Subkhan Ibnu Aji Sulthan Kharisma Akmal Syafrial Fachri Pane Syafwan Almadani Azra Syiarul Amrullah, Muhammad Taufik Suyanto Vera Suryani Wanda Firdaus Yahya Ermaya Yuda Prasetia Zidni Fahmi Suryandaru