Journal of Computer Networks, Architecture and High Performance Computing
Vol. 7 No. 3 (2025): Articles Research July 2025

Integrated Cnn Based Facial Emotion Detection And Camera Based PPG Heart Rate Monitoring

Panggabean, Erwin (Unknown)
Simanjorang, R. Mahdelena (Unknown)
Apriani , Wira (Unknown)
Nuraisana , Nuraisana (Unknown)
Sipahutar, Hartati Palentina (Unknown)
Siagian, Tesalonika Pesta (Unknown)



Article Info

Publish Date
10 Jul 2025

Abstract

Human emotion detection and heart rate estimation are two important aspects in developing a more responsive and adaptive human-computer interaction system. This study proposes a real-time video-based system that is able to detect facial emotions and estimate the user's heart rate simultaneously. The Convolutional Neural Network (CNN) method is used to classify facial expressions into several emotion categories such as happy, sad, angry, afraid, and neutral. Meanwhile, heart rate estimation is carried out using a non-contact Photoplethysmography (PPG) approach, which utilizes variations in color intensity in the user's facial area from video recordings to calculate the pulse rate. This system is developed using a standard webcam camera without additional medical devices, allowing for practical and economical implementation. The test results show that the system is able to recognize facial expressions with good accuracy, and estimate heart rate with an average error rate that is still within the tolerance limit of non-medical applications. By integrating computer vision technology and biometric signals, this study contributes to the development of a passive, real-time, and easily accessible emotion and health monitoring system.

Copyrights © 2025






Journal Info

Abbrev

CNAPC

Publisher

Subject

Computer Science & IT Education

Description

Journal of Computer Networks, Architecture and Performance Computing is a scientific journal that contains all the results of research by lecturers, researchers, especially in the fields of computer networks, computer architecture, computing. this journal is published by Information Technology and ...