Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Jurnal INFOTEL

Student Emotion Recognition from Low-Quality Videos Using Multimodal Deep Learning TAIBA, ANDI MAWADDA TAIBA MAWADDA; Bakti, Rizki Yusliana; Faisal, Muhammad; S. Kuba, Muhammad Syafaat; Anas, Lukman; H. T, Emil Agusalim; Rahman, Fahrim I.
JURNAL INFOTEL Vol 18 No 1 (2026): February
Publisher : LPPM INSTITUT TEKNOLOGI TELKOM PURWOKERTO

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.20895/infotel.v18i1.1523

Abstract

Emotion recognition plays a critical role in intelligent e-learning systems by enabling adaptive feedback and timely pedagogical interventions based on students’ affective states. However, most existing approaches rely heavily on visual facial cues, which are highly vulnerable to real-world conditions such as low-resolution video, partial facial occlusion, poor lighting, and unstable network connections commonly encountered in online learning environments. These limitations significantly degrade the performance of unimodal deep learning models. To address this challenge, this study proposes a multimodal deep learning framework for student emotion recognition that is robust to low-quality and occluded video input. The proposed model integrates visual and audio modalities through a hybrid architecture, combining a lightweight CNN-based visual feature extractor with a BiLSTM-based speech emotion model. An attention-based fusion mechanism is employed to adaptively weight cross-modal features, allowing the system to compensate for degraded or missing visual information using complementary acoustic cues. Experimental evaluations are conducted using publicly available datasets representative of realistic online learning scenarios, including DAiSEE and RAVDESS, with additional augmentation to simulate varying levels of occlusion and video degradation. The results demonstrate that the multimodal approach consistently outperforms unimodal baselines, particularly under high occlusion conditions, while maintaining computational efficiency suitable for near real-time deployment. These findings confirm that multimodal fusion with attention mechanisms provides a more resilient and practical solution for emotion-aware e-learning systems operating under non-ideal input conditions
Co-Authors . Darniati Abdul Rahman, Titik Khawa Ade Irfan Agus, Fauziah Agusalim, Agusalim Ahmad Syafi'i Zulmi Akbar, Syahril Akrar Syah Al Imran, Hamzah Ali, Muhammad Yunus Amal, Citra Amalia AMRI, MUH ULIL Amrullah Anas, Andi Bunga Tongeng Andi Bunga Tongeng Anas Andi Rahmat Anis Dandi Juandani Antaria, Sukmasari Arman, Muayyanah Arsyad, Zulfikar Asnita Virlayani, Asnita Bakti, Rizki Yusliana Bakti, Rizki Yusliana Berni Satria Gemilang Danuputri, Chyquitha Danuputri, Chyquitha Desi Anggreani Djunur, Lutfi Hair Fachrim Irhamna Rachman Faeruddin, Muhammad Asygar Fausiah Latief Fauzan Hamdi Fithriyah Arief Wangsa Gaffar, Farida Gemilang, Berni Satria Habi Talib, Emil Agusalim Hamzah Al Imran Hasanuddin, Novianingsih Hasbir, Syahrul Irma Suryana Irwan Irwan, Muhammad Ahlil Khairi Juandani, Anis Dandi Juliandro, Juliandro Karim, Nenny Kasmawati Kato, Muh Alvin Achmad Kusumawardani, Nurul Lantara, Andi Bintang Latief, Fausiah Lisnawati Lisnawati LUKMAN ANAS Lukman Lukman Lukman, Lukman Lutfi Hair Djunur M Agusalim Ma'rupah, Ma'rupah Mahmud, Rajib Mahmuddin Mahmuddin Mahmuddin Mohamad Munawir Muh Alvin Achmad Kato Muhammad Aminuddin, Muhammad Muhammad Faisal Muhyiddin A.M Hayat Mujidah, Jihan Izzathul Munawir, Mohamad Nenny Nenny Nenny Nenny, Nenny Nini Apriani Rumata Nur Alam Nur Rahman, Ahmad Nurdiansah, Nurdiansah Nurnawaty Nurnawaty Nurnawaty, Nurnawaty Panguriseng, Darwis Pawara, Ismail Putri, Adriani Rahmasari, St. Rajib Mahmud Risman, Andi Muh. Riswal Karamma Riswal Karamma Sahril Sandi, Andi Muhammad Sari, Reski Anugrah Sarina Siba, Ikhsan Suhardi, Syahrul Syah, Akrar Syahrul, Syahrulrahman Syamsuri, Andi Makbul Syamsuri, Andi Maqbul Syarifuddin, Nur Annisa T Karim, Nenny TAIBA, ANDI MAWADDA TAIBA MAWADDA Taufiq, Muh Titin Wahyuni Toha Andi Lala Usman, Sucipto Wangsa, Fithriyah Arief Zulfikar Arsyad Zulhaidir DJ, Muhammad Zulmi, Ahmad Syafi'i