Claim Missing Document
Check
Articles

Performance Comparison Of Xgboost Lightgbm And Lstm For E-Commerce Repeat Buyer Prediction Nugroho, Lustiyono Prasetyo; Saputro, Rujianto Eko; Utomo, Fandy Setyo
Jurnal Teknik Informatika (Jutif) Vol. 7 No. 1 (2026): JUTIF Volume 7, Number 1, February 2026
Publisher : Informatika, Universitas Jenderal Soedirman

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52436/1.jutif.2026.7.1.5746

Abstract

Repeat buyer behavior is a critical indicator of customer retention success in e-commerce platforms. However, accurately predicting repeat buyers remains a challenging problem due to the complexity of user behavior patterns and the temporal characteristics embedded in interaction data. Existing studies often focus on single modeling approaches or limited sequence exploration, resulting in insufficient comparative insight between ensemble-based machine learning and sequence-based deep learning models. Therefore, this study aims to systematically compare the performance of tree-based ensemble models (XGBoost and LightGBM) and a sequence-based deep learning model (LSTM) in predicting repeat buyers using user behavior data. To ensure fair evaluation, data preprocessing and feature engineering were carefully designed to prevent data leakage by utilizing user behavior prior to the first purchase. Model performance was evaluated using Accuracy, F1-score, and ROC–AUC metrics. Experimental results show that XGBoost and LightGBM achieve stable classification performance with accuracy values of 86.11% and 85.84%, respectively, while the LSTM model attains the highest ROC–AUC value of 0.937, indicating superior capability in capturing temporal behavioral patterns. This study provides valuable insights for e-commerce platforms seeking to optimize predictive models for repeat buyers, contributing to more effective customer retention strategies.
Adaptive Test Model Enhancement Based on Salmon Salar Optimization and Partially Observable Markov Decision Process Rujianto Eko Saputro; Fandy Setyo Utomo; Linda Perdana Wanti
Journal of Applied Data Sciences Vol 7, No 1: January 2026
Publisher : Bright Publisher

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47738/jads.v7i1.1065

Abstract

Cognitive Diagnosis Models (CDMs) in Computerized Adaptive Testing (CAT) are widely used to assess students’ cognitive abilities; however, existing approaches face significant limitations. The Latent Trait Model often suffers from specification errors due to its complexity, the Diagnostic Classification Model encounters difficulties in integrating hierarchical structures, and Deep Learning Models demand substantial computational resources. To address these challenges, this study introduces Salmon Salar Optimization (SSO) to enhance CDM performance and integrates the Partially Observable Markov Decision Process (POMDP) to improve dynamic question selection. The proposed adaptive testing framework comprises three components: preprocessing, CDM, and a selection algorithm. Experimental results on the ASSISTments 2009-2010 dataset demonstrate that SSO outperforms representative baselines from both deep learning: Neural CD and Latent Trait Model: MIRT approaches. Using 5-fold cross-validation, the proposed model achieved superior predictive performance with 75.51% accuracy and an AUC of 0.8191, highlighting its robustness compared to existing state-of-the-art methods. Furthermore, adaptive test simulations reveal that the SSO- and POMDP-based model delivers superior outcomes, attaining 80.3% accuracy with a reward of 8.03 for 10-question exams and 79.8% accuracy with a reward of 11.97 for 15-question exams. These findings confirm the effectiveness of the proposed model in enhancing cognitive diagnosis and adaptive testing performance.
WhatsApp Hybrid Chatbot Architecture Rasa-DeepSeek: Design and Performance Evaluation Iqbaluddin Syam Had; Fandy Setyo Utomo; Giat Karyono; Dwi Putriana Nuramanah Kinding
SISTEMASI Vol 15, No 2 (2026): Sistemasi: Jurnal Sistem Informasi
Publisher : Universitas Islam Indragiri

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.32520/stmsi.v15i2.5791

Abstract

This study designed and evaluated a hybrid chatbot for a domain-specific application by addressing two main issues: limited NLU coverage and the variability of latency and cost when all queries are routed directly to an LLM. The proposed solution integrates a deterministic Rasa-based pipeline with a DeepSeek fallback mechanism. In this architecture, Rasa handles NLU processing, rules, stories, and context storage for mk and jk, while the LLM is only invoked when the NLU confidence score falls below a defined threshold. The methodology includes end-to-end implementation through a Node.js bridge connected to Rasa, functional testing to validate the intent–entity–action flow, and performance testing using load (stress) testing across two access paths: the Rasa REST endpoint and the Node-to-Rasa bridge. Meanwhile, the LLM pipeline was profiled separately through instrumented action calls. The results indicate that domain-specific conversations were successfully answered using curated knowledge, and both deterministic access paths met the service level objective (SLO), achieving a median latency of approximately 32 milliseconds with no observed errors. This study contributes by demonstrating that a hybrid chatbot architecture separating deterministic and generative pipelines can maintain SLO compliance in domain-specific settings. In addition, it highlights limitations of LLMs in understanding domain ontologies, reinforcing the need for semantic guardrails.
COMPARISON OF THE PERFORMANCE OF SVM, RANDOM FOREST, AND NEURAL NETWORK ALGORITHMS IN SENTIMENT ANALYSIS OF OPENAI APPLICATION REVIEWS ON THE GOOGLE PLAY STORE Ahmad Latif; Muhtyas Yugi; Fandy Setyo Utomo; Taqwa Hariguna
JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika) Vol 11, No 1 (2026)
Publisher : STKIP PGRI Tulungagung

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.29100/jipi.v11i1.7793

Abstract

This study compares the performance of three machine learning algo-rithms—Support Vector Machine (SVM), Random Forest (RF), and Neural Network (NN)—in sentiment analysis of user reviews for the OpenAI application on the Google Play Store. The primary objective of this study is to evaluate the effectiveness of each algorithm in clas-sifying user reviews into three sentiment categories: positive, negative, and neutral. The dataset used consists of user reviews of the OpenAI application, collected directly from the Google Play Store. Model per-formance was evaluated using accuracy, precision, recall, and F1-score metrics. The results indicate that the Neural Network algorithm achieved the best overall performance in terms of accuracy and F1-score. SVM demonstrated competitive performance, particularly in classifying positive and neutral sentiments, while Random Forest showed an advantage in terms of precision but performed lower over-all, especially in classifying negative sentiments. Therefore, the Neural Network is considered the most effective algorithm for sentiment analysis tasks in this study
Co-Authors Abdul Hakim Prima Yuniarto Ade Fatahillah Adiya, Az Zahra Dwi Nur Afit Ajis Solihin Ahmad Latif Aisha Hukama Setyowati Aji Saeful Aji Septa, Adrian Ajis Solihin, Afit Amar Al Farizi Anas Nur Khafid Anggini, Melisa Anggraeni, Mutia Dwi Anggraini, Nova Anggriani, Epri Anies Indah Hariyanti Azhari Shouni Barkah Azmi, Mohd Sanusi Bagus Adhi Kusuma Baihaqi, Wiga Maulana Balit, Muhamad Naufal Burhanuddin Berlilana Berlilana Berlilana Burhanuddin Balit, Muhamad Naufal Churil Aeni, Agustina Chyntia Raras Ajeng Widiawati Darmono Dedi Purwanto, Dedi Didi Prasetyo Dwi Krisbiantoro, Dwi Dwi Putriana Nuramanah Kinding Dzaky Candy Fahrezy Fadhilah, Siti Nur Fajar Rohmattulloh Faradina Faradina Febriansyah Husni Adiatma Giat Karyono Giat Karyono Giat Karyono Gilang Miftkahul Fahmi Fahmi Hanif Hidayatulloh Hendra Marcos, Hendra hidayatulloh, hanif Ilham, Rifqi Arifin Imam Tahyudin Imam Tahyudin Indriyani, Ria Iqbaluddin Syam Had Jamie Mayliana Alyza Kafilla, Princess Iqlima Kusuma, Bagus Adhi Kusuma, Velizha Sandy Lasmedi Afuan Latif, Ahmad Linda Perdana Wanti Lubna, Zuhriyatul Lukita, Dita Maulana Baihaqi, Wiga Mohd Fairuz Iskandar Othman Mohd Nazrin Muhammad Mohd Sanusi Azmi Muaziz, Imam Muhamad Naufal Burhanuddin Balit Muhtyas Yugi Muhtyas Yugi Muhtyas Yugi Murtiyoso Murtiyoso Nandang Hermanto Nanna Suryana Nikmah Trinarsih Nugroho, Khabib Adi Nugroho, Lustiyono Prasetyo Nur Cholis Romadhon Octavia, Annisa Suci Prayoga, Fandhi Dhuga Priaji Januardi Pungkas Subarkah Purbo, Yevi Septiray Purwidiantoro, Moch. Hari Pyawai, Hero Galuh R. Vitto Mahendra Putranto Ramadhan, Aziz Ramadhan, Rio Fadly Rifqi Arifin Ilham RR. Ella Evrita Hestiandari Rujianto Eko Saputro Sagita, Selvi Samsul Arifin Sarmini - Sarmini Sarmini Sarmini Sekhudin, Sekhudin Setiabudi, Rizki Setiawan, Ito Shafira, Lulu Shendy Filanzi Slamet Widodo Slamet Widodo Sofa, Nur Sri Hartini Suryana, Nanna Taqwa Hariguna Titi Safitri Maharani Trinarsih, Nikmah Turino, Turino Utomo, Dadang Wahyu Wahid, Arif Mu'amar Wibisono, Arif Cahyo Wiga Maulana Baihaqi Yugi, Muhtyas Yuli Purwat Yuli Purwati Yulianto, Koko Edy