Claim Missing Document
Check
Articles

Found 38 Documents
Search

Student Emotion Recognition from Low-Quality Videos Using Multimodal Deep Learning ANDI MAWADDA TAIBA MAWADDA TAIBA; Rizki Yusliana Bakti; Muhammad Faisal; Muhammad Syafaat S. Kuba; Lukman Anas; Emil Agusalim H. T; Fahrim I. Rahman
JURNAL INFOTEL Vol 18 No 1 (2026): February
Publisher : LPPM INSTITUT TEKNOLOGI TELKOM PURWOKERTO

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.20895/infotel.v18i1.1523

Abstract

Emotion recognition plays a critical role in intelligent e-learning systems by enabling adaptive feedback and timely pedagogical interventions based on students’ affective states. However, most existing approaches rely heavily on visual facial cues, which are highly vulnerable to real-world conditions such as low-resolution video, partial facial occlusion, poor lighting, and unstable network connections commonly encountered in online learning environments. These limitations significantly degrade the performance of unimodal deep learning models. To address this challenge, this study proposes a multimodal deep learning framework for student emotion recognition that is robust to low-quality and occluded video input. The proposed model integrates visual and audio modalities through a hybrid architecture, combining a lightweight CNN-based visual feature extractor with a BiLSTM-based speech emotion model. An attention-based fusion mechanism is employed to adaptively weight cross-modal features, allowing the system to compensate for degraded or missing visual information using complementary acoustic cues. Experimental evaluations are conducted using publicly available datasets representative of realistic online learning scenarios, including DAiSEE and RAVDESS, with additional augmentation to simulate varying levels of occlusion and video degradation. The results demonstrate that the multimodal approach consistently outperforms unimodal baselines, particularly under high occlusion conditions, while maintaining computational efficiency suitable for near real-time deployment. These findings confirm that multimodal fusion with attention mechanisms provides a more resilient and practical solution for emotion-aware e-learning systems operating under non-ideal input conditions
Optimasi Kinerja Arsitektur CNN Ringan Menggunakan Pendekatan Bayesian untuk Identifikasi Skrip Bima Dayang Aisyah; Muhammad Faisal; Lukman Anas; Abd Rakhim Nanda; Syadiah Nor Wan Shamsuddin; Muhammad Syafaat S. Kuba
Buletin Sistem Informasi dan Teknologi Islam (BUSITI) Vol 7, No 2 (2026)
Publisher : Universitas Muslim Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.33096/busiti.v7i2.3462

Abstract

Identifikasi aksara daerah penting untuk mendukung pelestarian budaya digital, namun masih terkendala keterbatasan dataset, kemiripan karakter, dan kebutuhan model yang efisien. Penelitian ini mengoptimasi arsitektur Lightweight CNN menggunakan Bayesian Optimization untuk identifikasi aksara Bima. Dataset terdiri atas 6.190 citra aksara Bima dalam 44 kelas, mencakup aksara Bima baru dan lama. Model menggunakan MobileNetV3-Large sebagai backbone dengan optimasi learning rate, dropout, batch size, dan konfigurasi fine-tuning melalui Tree-structured Parzen Estimator. Hasil eksperimen menunjukkan accuracy 93,06%, precision 92,26%, recall 92,55%, dan F1-score 91,91%, lebih unggul dibanding machine learning tradisional, CNN konvensional, dan beberapa CNN ringan modern. Target accuracy 90% dicapai pada trial keempat. Dengan 3.253.676 parameter dan waktu inferensi 63,35 ms per citra, model ini terbukti akurat, efisien, dan berpotensi diterapkan pada digitalisasi manuskrip serta OCR aksara daerah.
KLASIFIKASI PENYAKIT TANAMAN NILAM BERDASARKAN CITRA DAUN MENGGUNAKAN GLCM DAN SVM Sarina; Rizki Yusliana Bakti; Muhammad Faisal; Muhammad Syafaat; Andi Makbul Syamsuri; Muhyiddin AM Hayat; Andi Lukman Anas
PROGRESS Vol 17 No 2 (2025): September
Publisher : P3M STMIK Profesional Makassar

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

This study presents a classification model for detecting diseases in patchouli (Pogostemon cablin Benth) leaves using image processing techniques. The method combines Grey Level Co-occurrence Matrix (GLCM) for texture feature extraction and Support Vector Machine (SVM) for classification, optimised using the Particle Swarm Optimisation (PSO) algorithm. A total of 2,080 leaf images were collected and categorized into four classes: healthy, leaf spot, yellowing, and mosaic. Each image was augmented and converted to grayscale to enhance the dataset and reduce computational complexity. Four GLCM features—contrast, correlation, energy, and homogeneity—were extracted to represent leaf textures. The classification model achieved an accuracy of 89.74% using SVM alone, and improved to 97.12% when optimized with PSO. The results indicate that the integration of GLCM, SVM, and PSO provides an effective and accurate solution for early detection of patchouli leaf diseases, potentially supporting farmers in decision-making and improving crop productivity and quality.
IMPLEMENTASI DEEP LEARNING MENGGUNAKAN HYBRID SENTENCE-TRANSFORMERS DAN K-MEANS UNTUK PERBANDINGAN JURNAL Muhammad Asygar Faeruddin; Muhammad Faisal; Rizki Yusliana Bakti; Muhammad Syafaat; Muhyiddin AM Hayat; Andi Makbul Syamsuri; Andi Lukman Anas
PROGRESS Vol 17 No 2 (2025): September
Publisher : P3M STMIK Profesional Makassar

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

This study addresses the challenge of identifying semantic relatedness between scientific journal articles by developing a classification system based on deep learning. The system applies an unsupervised learning approach using the Sentence-Transformers model and K-Means clustering to generate semantic similarity scores and categorical labels. Abstracts from journal PDFs are extracted and processed to determine similarity levels across four predefined categories. The optimal number of clusters was determined using Elbow Method, Silhouette Score, and Davies-Bouldin Index, resulting in k = 4. The system is implemented as a web-based application that allows users to upload two PDF files, compare them semantically, and receive both a similarity score and an AI-generated narrative explanation. Functional testing showed that all core features performed as expected. This system significantly reduces the time required to assess relatedness between journal articles, offering an efficient tool for academic research navigation.
IMPLEMENTASI K-MEANS DAN ANALISIS SENTIMEN KRITIK SARAN BERBASIS NLP PADA DATA MONEV BBPSDMP KOMINFO MAKASSAR Syahril Akbar; Muhammad Faisal; Rizki Yusliana Bakti; Muhammad Syafaat; Andi Makbul Syamsuri; Muhyiddin AM Hayat; Andi Lukman Anas
PROGRESS Vol 17 No 2 (2025): September
Publisher : P3M STMIK Profesional Makassar

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

Manual analysis of large-scale and unstructured textual feedback data is often inefficient and subjective, thereby hindering data-driven decision-making. This study aims to design and implement an integrated analytical workflow to automatically filter, cluster, and classify feedback data consisting of criticisms and suggestions. The research employs a hybrid approach that begins with TF-IDF-based data filtering, followed by dimensionality reduction using Latent Semantic Analysis (LSA), and topic clustering through K-Means clustering optimized with the Silhouette Score. The resulting cluster labels are then used as training data to build a Multinomial Naive Bayes classification model. The results show that this workflow successfully identified two main thematic clusters, namely "Criticism and Expectations" and "Suggestions and Compliments", and the classification model achieved an overall accuracy of 91%. Although class imbalance affected the recall of the minority class (47%), the model demonstrated high precision (95%) for that class. It is concluded that this hybrid approach effectively transforms raw data into structured insights, and utilizing clustering results as training data is an efficient strategy for automating feedback categorization, providing a reliable tool for institutional analysis.
PREDIKSI PEMAKAIAN AIR BULANAN DI PDAM KECAMATAN TAMALATE MENGGUNAKAN METODE AUTOREGRESSIVE INTEGRATED MOVING AVERAGE (ARIMA) Nur Annisa Syarifuddin; Titin Wahyuni; Muhammad Faisal; Muhammad Syafaat; Andi Makbul Syamsuri; Muhyiddin AM Hayat; Andi Lukman Anas
PROGRESS Vol 17 No 2 (2025): September
Publisher : P3M STMIK Profesional Makassar

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

Water consumption forecasting is a crucial aspect of efficient water resource management, particularly in urban areas with increasing demand. This study aims to predict the monthly water usage volume at the PDAM of Tamalate District using the Autoregressive Integrated Moving Average (ARIMA) method. The dataset consists of historical water usage data from January 2022 to December 2024, totaling 36 monthly observations. The analysis process includes stationarity testing using the Augmented DickeyFuller (ADF) test, model parameter identification through ACF and PACF plots, and performance evaluation using MAE, RMSE, and MAPE metrics. The results show that the best-performing model is ARIMA, which demonstrates high prediction accuracy, with a MAE of 26,049.80 m³, RMSE of 37,459.00 m³, and MAPE of 4.12%. This model is capable of generating predictions close to actual values and can be relied upon as a basis for PDAM’s water distribution planning. It is expected that this research will contribute to data-driven decision-making and support digital transformation in the public service sector.
IMPLEMENTASI HYBRID LEXICON-BASED DAN SVM UNTUK KLASIFIKASI ANALISIS SENTIMEN TERHADAP PELATIHAN BBPSDMP KOMINFO MAKASSAR Nur Alam; Muhammad Faisal; Rizki Yusliana Bakti; Muhammad Syafaat; Andi Makbul Syamsuri; Muhyiddin AM Hayat; Andi Lukman Anas
PROGRESS Vol 17 No 2 (2025): September
Publisher : P3M STMIK Profesional Makassar

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

The evaluation of government training programs is often hindered by manual analysis of unstructured qualitative feedback, making the process inefficient and subjective. This study aims to implement and evaluate a sentiment classification model using a hybrid Lexicon-Based and Support Vector Machine approach to analyze participants’ perceptions of the Vocational School Graduate Academy training organized by BBPSDMP Kominfo Makassar, as well as to compare the performance of a standard SVM model with a model optimized using Particle Swarm Optimization. This quantitative research employs 2,313 unstructured review data, which undergo text preprocessing, initial lexicon-based labeling, and TF-IDF feature extraction before being classified using an SVM with an RBF kernel. The results show that the SVM model optimized with PSO consistently outperforms the standard model across all four evaluation aspects, with the most significant accuracy improvement observed in the instructor category from 84.71% to 89.02% and in the assessor category reaching 91.46%. PSO optimization has proven effective in enhancing the model’s ability to identify negative sentiments, which represent the minority class. The hybrid approach with PSO optimization is capable of producing a more accurate and balanced classification system, with practical implications as an objective automated evaluation tool.
PENERAPAN ALGORITMA MOBILENETV2 UNTUK KLASIFIKASI HURUF HIJAIYAH BERBASIS GESTUR TANGAN Muh. Riswan; Titin Wahyuni; Chyquitha Danuputri; Emil Agusalim Habi Talib; Muhammad Faisal; Lukman Anas; Andi Agung
PROGRESS Vol 18 No 1 (2026): April
Publisher : P3M STMIK Profesional Makassar

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

The digitalization of religious education offers significant opportunities to enhance Hijaiyah letter learning, particularly for the hearing-impaired community through visual gesture recognition. This study aims to develop and evaluate a real-time web-based classification system for 28 Hijaiyah hand gestures using the MobileNetV2 architecture. The research methodology involves a quantitative approach utilizing transfer learning with a balanced dataset of augmented images. The model was trained using fine-tuning techniques and deployed on a web platform using TensorFlow.js and MediaPipe for efficient on-device inference. Experimental results demonstrate that the model achieved an overall accuracy of 84% on the independent test set, with specific classes reaching near-perfect detection in real-time scenarios, although misclassification persisted among visually similar gestures. The system effectively balances computational efficiency with classification performance, minimizing latency during user interaction. In conclusion, the implementation of MobileNetV2 facilitates a responsive and accessible educational tool, proving the viability of computer vision in creating inclusive religious learning environments without requiring complex server-side infrastructure.
Co-Authors Abd Halik Lateko Abdul Rakhim Nanda Adi Malik Muhammad Mutsuhito Agung, Andi Ahmad Risal Akbar, Syahril Alfiani, Ananda Andi Agung ANDI AGUNG DWI ARYA BULU Andi Makbul Syamsuri Andi Makbul Syamsuri ANDI MAWADDA TAIBA MAWADDA TAIBA Andi Muhammad Akbar Andi Yusri andi Yusri Arvianda Asep Indra Syahyadi Aswad, Muh. Akhwan Adam Bakti, Rizki Yusliana Basir, Basri Chatarina Umbul Wahyuni Chyquitha Danuputri Danuputri, Chyquitha Dayang Aisyah Dian Pramana Putra, Dian Pramana Emil Agus Salim Habi Talib Emil Agusalim H. T Fachrim Irhamna Rachman Faeruddin, Muhammad Asygar Fahmi Ramadhan S Fahrim I. Rahman Firman Firman Furqan Zakiyabarsi Herdiansyah Herdiansyah Irma Andriani Kasmiati Kasmiati Kazman Riyadi Lukman M a h a r i d a Muh. Akhwan Adam Aswad Muh. Nasrum Massi Muh. Riswan Muhammad Asygar Faeruddin Muhammad Faisal Muhammad Syafaat Muhammad Syafaat S. Kuba Muhsin, Arief Muhsin, Muh Arief Muhyiddin A.M Hayat Mujadilah, Siti Muniardi Muniardi Muniardi, Muniardi Nadir Nadir Namora, Namora Nandy Rizaldy Najib Nur Alam Nur Alam Nur Annisa Syarifuddin Nur Fadillah Sari Rahman Rahman Rahman, Erik RAHMANIA Rahmania Rahmaniah, Rahmaniah Rahmi Rahmi Reski Amalia Salam Rezki Nurdin Ridwang Ridwang Ridwang Ridwang Ridwang, Ridwang Riswan, Muh. Saleh, Syafiuddin Sarina Sarina Setiawan, Tommy Reynaldy Syadiah Nor Wan Shamsuddin SYAFAR, A. MUHAMMAD Syafiuddin Saleh Syahril Akbar SYAHYADI, ASEP INDRA Syamsuri, Andi Makbul Syarifuddin, Nur Annisa TANTRI INDRABULAN Titin Wahyuni Wahyuddin