Article Per Year (5 Year)
p-Index From 2020 - 2025
0.23
P-Index
This Author published in this journals
All Journal Indonesian Journal of Electrical Engineering and Informatics (IJEEI)
Ali Sophian
Mechatronics Department Faculty of Engineering International Islamic University Malaysia
Computer Science & IT Electrical & Electronics Engineering

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
On the Audio-Visual Emotion Recognition using Convolutional Neural Networks and Extreme Learning Machine Arselan Ashraf; Teddy Surya Gunawan; Fatchul Arifin; Mira Kartiwi; Ali Sophian; Mohamed Hadi Habaebi
Indonesian Journal of Electrical Engineering and Informatics (IJEEI) Vol 10, No 3: September 2022
Publisher : IAES Indonesian Section

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52549/ijeei.v10i3.3879

Abstract

The advances in artificial intelligence and machine learning concerning emotion recognition have been enormous and in previously inconceivable ways. Inspired by the promising evolution in human-computer interaction, this paper is based on developing a multimodal emotion recognition system. This research encompasses two modalities as input, namely speech and video. In the proposed model, the input video samples are subjected to image pre-processing and image frames are obtained. The signal is pre-processed and transformed into the frequency domain for the audio input. The aim is to obtain Mel-spectrogram, which is processed further as images. Convolutional neural networks are used for training and feature extraction for both audio and video with different configurations. The fusion of outputs from two CNNs is done using two extreme learning machines. For classification, the proposed system incorporates a support vector machine. The model is evaluated using three databases, namely eNTERFACE, RML, and SAVEE. For the eNTERFACE dataset, the accuracy obtained without and with augmentation was 87.2% and 94.91%, respectively. The RML dataset yielded an accuracy of 98.5%, and for the SAVEE dataset, the accuracy reached 97.77%. Results achieved from this research are an illustration of the fruitful exploration and effectiveness of the proposed system.
Co-Authors Arselan Ashraf Fatchul Arifin Mira Kartiwi Mohamed Hadi Habaebi Teddy Surya Gunawan