Claim Missing Document
Check
Articles

Student Emotion Recognition from Low-Quality Videos Using Multimodal Deep Learning ANDI MAWADDA TAIBA MAWADDA TAIBA; Rizki Yusliana Bakti; Muhammad Faisal; Muhammad Syafaat S. Kuba; Lukman Anas; Emil Agusalim H. T; Fahrim I. Rahman
JURNAL INFOTEL Vol 18 No 1 (2026): February
Publisher : LPPM INSTITUT TEKNOLOGI TELKOM PURWOKERTO

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.20895/infotel.v18i1.1523

Abstract

Emotion recognition plays a critical role in intelligent e-learning systems by enabling adaptive feedback and timely pedagogical interventions based on students’ affective states. However, most existing approaches rely heavily on visual facial cues, which are highly vulnerable to real-world conditions such as low-resolution video, partial facial occlusion, poor lighting, and unstable network connections commonly encountered in online learning environments. These limitations significantly degrade the performance of unimodal deep learning models. To address this challenge, this study proposes a multimodal deep learning framework for student emotion recognition that is robust to low-quality and occluded video input. The proposed model integrates visual and audio modalities through a hybrid architecture, combining a lightweight CNN-based visual feature extractor with a BiLSTM-based speech emotion model. An attention-based fusion mechanism is employed to adaptively weight cross-modal features, allowing the system to compensate for degraded or missing visual information using complementary acoustic cues. Experimental evaluations are conducted using publicly available datasets representative of realistic online learning scenarios, including DAiSEE and RAVDESS, with additional augmentation to simulate varying levels of occlusion and video degradation. The results demonstrate that the multimodal approach consistently outperforms unimodal baselines, particularly under high occlusion conditions, while maintaining computational efficiency suitable for near real-time deployment. These findings confirm that multimodal fusion with attention mechanisms provides a more resilient and practical solution for emotion-aware e-learning systems operating under non-ideal input conditions
Optimasi Kinerja Arsitektur CNN Ringan Menggunakan Pendekatan Bayesian untuk Identifikasi Skrip Bima Dayang Aisyah; Muhammad Faisal; Lukman Anas; Abd Rakhim Nanda; Syadiah Nor Wan Shamsuddin; Muhammad Syafaat S. Kuba
Buletin Sistem Informasi dan Teknologi Islam (BUSITI) Vol 7, No 2 (2026)
Publisher : Universitas Muslim Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.33096/busiti.v7i2.3462

Abstract

Identifikasi aksara daerah penting untuk mendukung pelestarian budaya digital, namun masih terkendala keterbatasan dataset, kemiripan karakter, dan kebutuhan model yang efisien. Penelitian ini mengoptimasi arsitektur Lightweight CNN menggunakan Bayesian Optimization untuk identifikasi aksara Bima. Dataset terdiri atas 6.190 citra aksara Bima dalam 44 kelas, mencakup aksara Bima baru dan lama. Model menggunakan MobileNetV3-Large sebagai backbone dengan optimasi learning rate, dropout, batch size, dan konfigurasi fine-tuning melalui Tree-structured Parzen Estimator. Hasil eksperimen menunjukkan accuracy 93,06%, precision 92,26%, recall 92,55%, dan F1-score 91,91%, lebih unggul dibanding machine learning tradisional, CNN konvensional, dan beberapa CNN ringan modern. Target accuracy 90% dicapai pada trial keempat. Dengan 3.253.676 parameter dan waktu inferensi 63,35 ms per citra, model ini terbukti akurat, efisien, dan berpotensi diterapkan pada digitalisasi manuskrip serta OCR aksara daerah.
A Calibrated ROI-Aware Hybrid CNN-Transformer for Kidney Stone Presence Classification on Heterogeneous Axial CT Images Muh Ilham Akbar; Muhammad Faisal; Desi Anggreani; Abd Rakhim Nanda; Try Gustaf Said; Muhammad Syafaat S. Kuba
Buletin Sistem Informasi dan Teknologi Islam (BUSITI) Vol 7, No 2 (2026)
Publisher : Universitas Muslim Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.33096/busiti.v7i2.3463

Abstract

Batu ginjal merupakan penyebab umum nyeri pinggang akut, dan CT non-kontras menjadi standar referensi untuk mendeteksi kalkulus. Pada penelitian ini, istilah heterogen merujuk pada variasi protokol akuisisi antarrumah sakit, seperti perbedaan dosis radiasi, ketebalan irisan, rekonstruksi, dan bidang pandang, yang dapat mengubah tampilan citra serta menurunkan konsistensi pembacaan. Penelitian ini mengusulkan model hibrida CNN-Transformer yang sadar ROI (implisit) untuk klasifikasi keberadaan batu ginjal pada citra CT aksial heterogen. Arsitektur menggabungkan EfficientNet-B3, encoder Transformer ringan, dan Convolutional Block Attention Module (CBAM) tanpa anotasi ROI manual. Dataset terdiri dari 3.364 citra (1.577 batu, 1.787 non-batu) dengan pemisahan bertingkat 70/15/15. Evaluasi mencakup akurasi, presisi, sensitivitas, spesifisitas, F1, ROC-AUC, PR-AUC, inspeksi kalibrasi, dan audit Grad-CAM. Hasil menunjukkan bahwa penambahan Transformer meningkatkan kinerja dibanding baseline CNN, sedangkan CBAM menggeser profil kesalahan ke sensitivitas yang lebih tinggi. Varian Hybrid+Attention mencapai akurasi 0,9861, F1 0,9851, dan ROC-AUC 0,9967 pada set uji, dengan jumlah negatif palsu lebih rendah dibanding varian hibrida tanpa perhatian. Temuan ini menunjukkan potensi model sebagai alat bantu dokter untuk triase dan pembacaan awal yang lebih konsisten pada data lintas protokol, meskipun validasi eksternal, pemisahan berbasis pasien, dan metrik kalibrasi kuantitatif masih diperlukan sebelum klaim kesiapan klinis.
Explainable Fake News Detection in Indonesian Language Using IndoBERT and SHAP Muhammad Hasraddin Hasnan; Rizky Yusliana Bakti; Muhammad Faisal; Titik Khawa Abd Rahman; Nurnawaty Nurnawaty; Muhammad Syafaat S. Kuba; Titin Wahyuni
Buletin Sistem Informasi dan Teknologi Islam (BUSITI) Vol 7, No 2 (2026)
Publisher : Universitas Muslim Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.33096/busiti.v7i2.3466

Abstract

Perkembangan media sosial dan teknologi informasi menyebabkan penyebaran berita palsu (fake news) semakin cepat dan sulit dikendalikan. Penelitian ini bertujuan mengembangkan model deteksi fake news berbahasa Indonesia yang tidak hanya memiliki performa tinggi, tetapi juga mampu memberikan interpretasi terhadap hasil prediksi. Metode yang digunakan adalah IndoBERT sebagai model klasifikasi utama dan SHAP (SHapley Additive exPlanations) sebagai metode Explainable Artificial Intelligence (XAI) untuk menjelaskan kontribusi kata terhadap keputusan model. Dataset diperoleh dari dua sumber berbeda yang kemudian melalui tahap preprocessing, filtering bahasa Indonesia, balancing data, serta pembagian data latih dan data uji. Sebagai pembanding, digunakan model baseline berbasis TF-IDF dan Logistic Regression. Pengujian menghasilkan akurasi model baseline sebesar 83%, sementara IndoBERT mencapai 94,39% dengan precision 96,12%, recall 92,53%, serta F1-score 94,29%. Analisis visualisasi SHAP mengungkap bahwa model berhasil menangkap kata-kata kunci utama yang berperan dalam mengklasifikasikan berita hoaks atau asli. Hasil penelitian membuktikan bahwa integrasi IndoBERT dan SHAP efektif dalam meningkatkan performa deteksi fake news sekaligus memberikan transparansi terhadap proses pengambilan keputusan model
A Hybrid K-Means and Neural Network for Enhancing Students’ Academic Performance Suriani Suriani; Muhammad Faisal; Darniati Darniati; Emil Agusalim H. T; Muhammad Syafaat S. Kuba; Swa Lee Lee; Nurdiansyah Nurdiansyah
Buletin Sistem Informasi dan Teknologi Islam (BUSITI) Vol 7, No 2 (2026)
Publisher : Universitas Muslim Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.33096/busiti.v7i2.3467

Abstract

Ketersediaan data pada Learning Management System (LMS) mendorong penerapan pembelajaran adaptif di pendidikan tinggi. Penelitian ini mengusulkan kerangka kerja hybrid berbasis kecerdasan buatan yang mengintegrasikan K-Means clustering dan Neural Network untuk profil mahasiswa berbasis perilaku dan prediksi kinerja akademik. Model divalidasi menggunakan Open University Learning Analytics Dataset yang mencakup data demografi, interaksi, dan performa akademik. Hasil menunjukkan akurasi sebesar 0,68 dan F1-score sebesar 0,66, melampaui metode dasar dengan stabilitas yang lebih baik. Clustering menghasilkan silhouette score 0,62 yang menunjukkan pemisahan kelompok yang jelas. Selain itu, sistem meningkatkan relevansi konten sebesar 27% dan menurunkan risiko putus studi sebesar 18%, dengan waktu inferensi rata-rata 0,85 detik. Temuan ini menunjukkan efektivitas kerangka dalam mendukung pembelajaran adaptif yang dipersonalisasi dan skalabel
Analysis of Sediment Characteristics and Sedimentation Rate of the Noling River, Luwu Regency Juliandro Juliandro; Muhammad Syafa'at S Kuba; Farida Gaffar; Ismail Pawara
BANDAR: JOURNAL OF CIVIL ENGINEERING Vol. 7 No. 2 (2025): Bandar: Journal of Civil Engineering
Publisher : Universitas Sulawesi Barat

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.31605/bjce.v7i2.5272

Abstract

The Noling River plays an important role in the lives of the surrounding communities; however, it faces sedimentation problems that lead to riverbed aggradation, infrastructure disturbances, and reduced flow capacity. This study aims to determine the sediment characteristics and the rate of sedimentation in the Noling River, Luwu Regency. Sediment samples were collected from the midstream section of the river and analyzed in the laboratory to determine grain size distribution, specific gravity, and physical characteristics of the sediment. The results show that the Noling River sediment is dominated by sand (57.4%), gravel (31.8%), and silt/clay (10.9%), with a sediment classification of sandy clay. The sedimentation rate was calculated using both direct measurement and empirical approaches (Meyer-Peter and Duboys methods). The average suspended sediment load was found to be 5,251.97 tons/month, while the bed load reached 1,102.91 tons/month. The flow velocity, which exceeds the sediment fall velocity, indicates that sediment transport occurs actively. The findings of this study are expected to serve as a reference for better river management and future sedimentation mitigation efforts.
Integrating multi-criteria decision making and public sentiment analysis for sustainable urban green space planning Muhammad Syafaat S. Kuba; Muhammad Faisal; Nurnawaty Nurnawaty; Titik Khawa Abdul Rahman; Andi Makbul Syamsuri; Muhyiddin AM Hayat; Rizki Yusliana Bakti
Bulletin of Electrical Engineering and Informatics Vol 15, No 2: April 2026
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/eei.v15i2.11168

Abstract

Sustainable planning of green open spaces (GOS) requires decision-making models that combine expert evaluation with public input. This study proposes a novel hybrid framework that integrates multi-criteria group decision making (MCGDM) with public sentiment analysis to support community-based and data-driven urban planning. The workflow consists of evaluating 25 community-proposed GOS locations using stepwise weight assessment ratio analysis (SWARA) for criteria weighting and MABAC-BORDA for multi-criteria ranking, resulting in 11 feasible alternatives. To incorporate community perspectives, a term frequency-inverse document frequency-support vector machine (TF-IDF–SVM) classifier was applied to 1500 public comments, where SVM achieved the highest accuracy (0.80–0.96). The integrated approach improves ranking stability, reduces decision ambiguity, and strengthens alignment between expert judgment and community sentiment. This study contributes a transparent, participatory decision-support model that unifies MCGDM and sentiment analysis to enhance the effectiveness of sustainable GOS planning.
KLASIFIKASI TINGKAT KEMATANGAN LADA MENGGUNAKAN ENSEMBLE LEARNING BERDASARKAN CITRA WARNA KULIT Jihan Izzathul Mujidah; Rizki Yusliana Bakti; Lukman; Muhammad Faisal; Muhammad Syafaat; Muhyiddin AM Hayat; Andi Makbul Syamsuri
PROGRESS Vol 17 No 2 (2025): September
Publisher : P3M STMIK Profesional Makassar

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

Pepper fruit (Piper nigrum L.) is an agricultural commodity whose market value strongly depends on its ripeness level at harvest. Ripeness determination, which is still commonly performed through visual observation, tends to be inaccurate and subjective. This study aims to classify the ripeness level of pepper fruit based on skin color using an ensemble learning approach. The dataset consists of 1,996 pepper fruit images categorized into four ripeness levels unripe, semi ripe, ripe, and overripe. Color features were extracted from the HSV color model using color moment statistics including mean, standard deviation, and skewness. Random Forest and XGBoost models were combined using a soft voting method. The results show that the ensemble model achieved 98.25% accuracy, 98.30% precision, 98.27% recall, and 98.26% F1-score. The ensemble approach proved superior to single models by providing more accurate and stable classification of pepper fruit ripeness.
KLASIFIKASI PENYAKIT TANAMAN NILAM BERDASARKAN CITRA DAUN MENGGUNAKAN GLCM DAN SVM Sarina; Rizki Yusliana Bakti; Muhammad Faisal; Muhammad Syafaat; Andi Makbul Syamsuri; Muhyiddin AM Hayat; Andi Lukman Anas
PROGRESS Vol 17 No 2 (2025): September
Publisher : P3M STMIK Profesional Makassar

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

This study presents a classification model for detecting diseases in patchouli (Pogostemon cablin Benth) leaves using image processing techniques. The method combines Grey Level Co-occurrence Matrix (GLCM) for texture feature extraction and Support Vector Machine (SVM) for classification, optimised using the Particle Swarm Optimisation (PSO) algorithm. A total of 2,080 leaf images were collected and categorized into four classes: healthy, leaf spot, yellowing, and mosaic. Each image was augmented and converted to grayscale to enhance the dataset and reduce computational complexity. Four GLCM features—contrast, correlation, energy, and homogeneity—were extracted to represent leaf textures. The classification model achieved an accuracy of 89.74% using SVM alone, and improved to 97.12% when optimized with PSO. The results indicate that the integration of GLCM, SVM, and PSO provides an effective and accurate solution for early detection of patchouli leaf diseases, potentially supporting farmers in decision-making and improving crop productivity and quality.
IMPLEMENTASI DEEP LEARNING MENGGUNAKAN HYBRID SENTENCE-TRANSFORMERS DAN K-MEANS UNTUK PERBANDINGAN JURNAL Muhammad Asygar Faeruddin; Muhammad Faisal; Rizki Yusliana Bakti; Muhammad Syafaat; Muhyiddin AM Hayat; Andi Makbul Syamsuri; Andi Lukman Anas
PROGRESS Vol 17 No 2 (2025): September
Publisher : P3M STMIK Profesional Makassar

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

This study addresses the challenge of identifying semantic relatedness between scientific journal articles by developing a classification system based on deep learning. The system applies an unsupervised learning approach using the Sentence-Transformers model and K-Means clustering to generate semantic similarity scores and categorical labels. Abstracts from journal PDFs are extracted and processed to determine similarity levels across four predefined categories. The optimal number of clusters was determined using Elbow Method, Silhouette Score, and Davies-Bouldin Index, resulting in k = 4. The system is implemented as a web-based application that allows users to upload two PDF files, compare them semantically, and receive both a similarity score and an AI-generated narrative explanation. Functional testing showed that all core features performed as expected. This system significantly reduces the time required to assess relatedness between journal articles, offering an efficient tool for academic research navigation.
Co-Authors . Darniati Abdul Rakhim Nanda Ade Irfan Aedah Abd Rahman Agus, Fauziah Agusalim, Agusalim Ahmad Nur Rahman Ahmad Syafi'i Zulmi Akrar Syah Al Imran, Hamzah Ali, Muhammad Yunus Alizha Nur Arspandy Alvian Syah Burhani Amal, Citra Amalia Amrullah Anas, Andi Bunga Tongeng Andi Agung Andi Bunga Tongeng Anas Andi Makbul Syamsuri ANDI MAWADDA TAIBA MAWADDA TAIBA Andi Rahmat Anis Dandi Juandani Antaria, Sukmasari Arina Manasikana Arman, Muayyanah Arsyad, Zulfikar Ashabul Kahfi Asnita Virlayani, Asnita Bakti, Rizki Yusliana Berni Satria Gemilang Chyquitha Danuputri Danuputri, Chyquitha Danuputri, Chyquitha Darniati Dayang Aisyah Desi Anggreani Dince Danga Dupa Djunur, Lutfi Hair E. Sulistiyowati . Emil Agus Salim Habi Talib Emil Agusalim Habi Talib Erdi Katanga Yani Ersita Hambajawa Eunike Mita Ga Fachrim Irhamna Rachman Fahrim I. Rahman Fahrim Irhamna Rachman Fahrim Irhamna Rachman Farida Gaffar Fausiah Latief Fauzan Hamdi Firrofiqil A'la Kadram Fithriyah Arief Wangsa Gaffar, Farida Gemilang, Berni Satria Hamzah Al Imran Hasanuddin, Novianingsih Hasbir, Syahrul Hasmi . Ida Mulyadi, Ida Indriyanti Indriyanti Azis Irma Suryana Irwan Irwan, Muhammad Ahlil Khairi Ismail Pawara Jesynta Landu Natar Jihan Izzathul Mujidah Juandani, Anis Dandi Juliandro Juliandro Juliandro, Juliandro Karim, Nenny Kasmawati Kato, Muh Alvin Achmad Kusumawardani, Nurul Lantara, Andi Bintang Latief, Fausiah Leonard Rihi Lisnawati Lisnawati Lukman Lukman Lukman Anas LUKMAN ANAS Lukman, Lukman Lutfi Hair Djunur M Agusalim M. Fikri Haikal Ayatullah Ma'rupah, Ma'rupah Mahmud, Rajib Mahmuddin Mahmuddin Mahmuddin Mohamad Munawir Muh Alvin Achmad Kato Muh Faisal Muh Ilham Akbar Muhammad Aminuddin, Muhammad Muhammad Asygar Faeruddin Muhammad Faisal Muhammad Hasraddin Hasnan Muhammad Khadafi Muhsin, Muh Arief Muhyiddin A.M Hayat Muhyiddin A.M Hayat Munawir, Mohamad Nenny Nenny Nenny Nenny, Nenny Nini Apriani Rumata Nur Alam Nur Annisa Syarifuddin Nur Rahman, Ahmad Nurdiansah, Nurdiansah Nurdiansyah Nurdiansyah Nurnawaty Nurul Kusumawardani Panguriseng, Darwis Pawara, Ismail Putri, Adriani Rahmasari, St. Rajib Mahmud Risman, Andi Muh. Riswal Karamma Runal Rezkiawan S.R. Setyaningsih . Sahril Sandi, Andi Muhammad Sari, Reski Anugrah Saribanong . Sarina Siba, Ikhsan St. Narwiyani . St.S. Yasin . Suhardi, Syahrul Suriani Suriani Suriati . Swa Lee Lee Syadiah Nor Wan Shamsuddin Syah, Akrar Syahril Akbar Syahrul Hasbir Syahrul Suhardi Syahrul, Syahrulrahman Syamsuri, Andi Maqbul Syatriana, Eny T Karim, Nenny Taufiq, Muh Teto Putri Asgetri Titik Khawa Abd Rahman Titik Khawa Abdul Rahman Titin Wahyuni Toha Andi Lala Try Gustaf Said Ulil Amri Umbu Leha Kulandima Usman, Sucipto W. Suharni . Wa Nanda Sulystrian Wangsa, Fithriyah Arief Wiwin Fuad Sanjaya Yesinta Pangga Limu Yosua Pebryanto Blegur Yundari, Yundari Zulfikar Arsyad Zulhaidir DJ, Muhammad Zulmi, Ahmad Syafi'i