International Journal of Electrical and Computer Engineering
Vol 16, No 5: October 2026

Real-time multimodal fatigue detection using facial vision and alert integration via ESP32 for occupational health applications

Andrés Enrique Rojas Primo (Universidad Tecnológica del Perú)
Alfredo Lazaro Gutierrez (Universidad Tecnológica del Perú)
Felix Pucuhuayla-Revatta (Universidad Tecnológica del Perú)



Article Info

Publish Date
01 Oct 2026

Abstract

Early detection of work fatigue is a major challenge in industrial settings due to the lack of non-invasive, accessible, and low-cost systems capable of operating in real time. In this context, this research proposes a multimodal real-time fatigue detection system using facial vision and artificial intelligence, aimed at risk prevention and promoting occupational health. The system integrates geometric and behavioral parameters, such as eye aspect ratio (EAR), head tilt, and mouth opening, processed on a Raspberry Pi 5 using MediaPipe and a hybrid convolutional neural network (CNN) MobileViT model. Visual and audible alerts are managed by an ESP32 microcontroller using the message queuing telemetry transport (MQTT) protocol, while a graphical interface developed in Tkinter allows real-time monitoring of operator status. Experimental results, evaluated in a simulated work environment using AI-generated synthetic videos, show an accuracy greater than 97% and a latency of less than 250 ms, confirming the system's effectiveness in the early detection of signs of drowsiness and attention deficit. In conclusion, the proposal represents a non-invasive, scalable, and efficient solution that combines computer vision, deep learning, and the Internet of Things (IoT) to strengthen workplace safety and well-being.

Copyrights © 2026






Journal Info

Abbrev

IJECE

Publisher

Subject

Computer Science & IT Electrical & Electronics Engineering

Description

International Journal of Electrical and Computer Engineering (IJECE, ISSN: 2088-8708, a SCOPUS indexed Journal, SNIP: 1.001; SJR: 0.296; CiteScore: 0.99; SJR & CiteScore Q2 on both of the Electrical & Electronics Engineering, and Computer Science) is the official publication of the Institute of ...