Jurnal Teknik Informatika (JUTIF)
Vol. 7 No. 5 (2026): JUTIF Volume 7, Number 5, October 2026

Indonesian Speech Emotion Recognition Using CNN with Hybrid Audio Features

Alun Sujjada (Informatics, Universitas Nusa Putra, Indonesia)
M. Ilham Nurdiansyah Alfajar (Informatics, Universitas Nusa Putra, Indonesia)
Ivana Lucia Kharisma (Informatics, Universitas Nusa Putra, Indonesia)



Article Info

Publish Date
10 Oct 2026

Abstract

This study develops a speech emotion recognition system for the Indonesian language using deep learning combined with hybrid audio features. A total of 300 speech samples from the IndoWaveSentiment dataset, labeled into five emotion classes neutral, happy, surprised, disgusted, and disappointed were used. The extracted features include Mel-Frequency Cepstral Coefficients (MFCC), Hilbert Multispectrum, and Cochleagram, capturing frequency, amplitude, and auditory perception characteristics of the speech signals. Three deep learning models were implemented: Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), and a hybrid CNN-LSTM model. All models were trained and evaluated using accuracy, precision, recall, F1-score, and Area Under the Curve (AUC). The CNN model achieved the highest validation accuracy of 98.3%, followed by LSTM (91.6%) and the hybrid CNN-LSTM (85%). All models demonstrated strong reliability with AUC values above 0.9. A local web-based interface using Flask was developed to enable real-time audio recording or upload for emotion prediction. This research contributes to speech emotion recognition and applied informatics in the Indonesian language, demonstrating that hybrid audio features combined with CNN provide accurate and practical solutions for emotion classification.

Copyrights © 2026






Journal Info

Abbrev

jurnal

Publisher

Subject

Computer Science & IT

Description

Jurnal Teknik Informatika (JUTIF) is an Indonesian national journal, publishes high-quality research papers in the broad field of Informatics, Information Systems and Computer Science, which encompasses software engineering, information system development, computer systems, computer network, ...