RABIT: Jurnal Teknologi dan Sistem Informasi Univrab
Vol 11 No 2 (2026): Juli

PENDEKATAN DEEP LEARNING UNTUK PEMANTAUAN AKTIVITAS BELAJAR MENGAJAR SISWA PADA LINGKUNGAN PEMBELAJARAN KELAS

Ripka Nduru (Universitas Prima Indonesia)
Rina Andayani Rotua (Universitas Prima Indonesia)
Aldio Simamora (Universitas Prima Indonesia)
Edwin Todo Pardamean Sinaga (Universitas Prima Indonesia)
Amir Mahmud Husein (Universitas Prima Indonesia)



Article Info

Publish Date
10 Jul 2026

Abstract

This study aims to develop a student learning activity monitoring system based on deep learning and computer vision using YOLOv12n, DeepSORT, MediaPipe FaceMesh, and the Fuzzy Mamdani method. The study was conducted on eighth-grade students of SMP Swasta Deli Murni Suka Maju using classroom learning activity videos that had undergone data selection and preprocessing. The proposed system was designed to detect students, track their identities, and analyze their attention levels automatically and in real-time based on eye conditions and head position. YOLOv12n was employed for student detection, DeepSORT for identity tracking, MediaPipe FaceMesh for extracting facial features, including the Eye Aspect Ratio (EAR) and head position, while the Fuzzy Mamdani method was utilized to classify students' attention levels. System evaluation was performed by comparing the prediction results with manually annotated ground truth and was assessed using the Confusion Matrix, accuracy, precision, recall, and F1-score. The experimental results demonstrate that the proposed system is capable of performing multi-student detection, identity tracking, and automatic attention level analysis. The evaluation achieved an accuracy of 90.20%, indicating that the integration of YOLOv12n, DeepSORT, MediaPipe FaceMesh, and the Fuzzy Mamdani method provides reliable performance for classifying students' attention levels in a smart classroom environment.

Copyrights © 2026






Journal Info

Abbrev

rabit

Publisher

Subject

Computer Science & IT Engineering

Description

This journal is called RABIT, where the name comes from two words namely, RAB which means Abdurrab University and IT which means information technology, it can be interpreted as a journal of this journal Journal of Informatics Engineering Study Program Pekanbaru Abdurrab University. This RABIT ...