Revan Vio Endriansyah
Universitas Jenderal Achmad Yani

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

Emotion recognition of electroencephalogram using hybrid convolutional neural networks and vision transformer Esmeralda Contessa Djamal; Revan Vio Endriansyah; Daswara Djajasasmita
IAES International Journal of Artificial Intelligence (IJ-AI) Vol 15, No 4: August 2026
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/ijai.v15.i4.pp3934-3943

Abstract

Electroencephalogram (EEG) signal-based emotion classification faces challenges in spatio-temporal complexity and inter-channel redundancy. This paper proposes a 2D convolutional neural network (CNN) and vision transformer (ViT) approach. Relevant emotions require signal extraction in the 4-40 Hz frequency band using the discrete wavelet transform (DWT). This study uses the SEED dataset from 15 subjects, with 62 channels reduced to 12. Every 5-second segment is decomposed using DWT into four frequency bands, which are then mapped to a 2D spatial representation for CNNs and ViTs. Experiment results show that the DWT-2D CNN-ViT achieves the best accuracy of 87% with a final loss of 0.087. In the meantime, the CNN-only model (85%), the ViT-only model (77%), and the DWT-only model (47%). Testing with several optimizers also shows that AdamW provides the highest performance with the fastest training time of 12.34 minutes. These results demonstrate that this integration can produce more efficient and stable learning. These findings indicate that the combination of DWT and the CNN-ViT hybrid architecture is effective for accurate, stable EEG-based emotion recognition and is potentially applicable to real-time emotion-monitoring systems.