Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal International Journal of Electrical and Computer Engineering
Ade Rifky Setiawan
Sebelas Maret University
Computer Science & IT Electrical & Electronics Engineering

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
Real-time facial and body pose emotion recognition for children with autism based on YOLOv8 and LSTM Siti Nurohmahwati; Ananda Putra Kanieza; Ade Rifky Setiawan; Ahmad Fadlan
International Journal of Electrical and Computer Engineering (IJECE) Vol 16, No 4: August 2026
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/ijece.v16i4.pp1899-1912

Abstract

Children with autism spectrum disorder (ASD) often face challenges in recognizing and expressing emotions, which can affect their behavior and participation in inclusive classroom environments. This study proposes a real-time multimodal emotion recognition system integrating deep learning and Internet of Things (IoT) technologies to support early emotional monitoring in children with ASD. The framework combines YOLOv8 for facial expression detection and YOLOv8-based pose estimation for body movement analysis, along with a long short-term memory (LSTM) network for temporal emotion classification. At the facial level, the system recognizes five emotional states: sad, happy, neutral, boredom, and tantrum. At the temporal level, the LSTM model classifies behavioral sequences into three categories: neutral/bored, happy, and tantrum, enabling hierarchical emotion interpretation from instantaneous expressions to temporal patterns. Experimental results show that the facial expression model achieves 92% precision, while the LSTM-based classifier reaches 95% peak validation accuracy and 93.33% final test accuracy. The system is deployed on a web- based monitoring platform with real-time notifications for educators and parents. The proposed approach demonstrates effectiveness in providing timely emotional insights to support early intervention and improve inclusive education for children with ASD.
Co-Authors Ahmad Fadlan Ananda Putra Kanieza Siti Nurohmahwati