Pratomo Setiaji
Sistem Informasi, Fakultas Teknik, Universitas Muria Kudus, Kudus, Indonesia

Published : 3 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 3 Documents
Search

Klasifikasi Sentimen Ulasan Pengguna Aplikasi Paylater di Indonesia Menggunakan Mesin Pembelajaran Muhammad Ardi Hermansyah; Muhammad Arifin; Pratomo Setiaji
IDEALIS : InDonEsiA journaL Information System Vol. 9 No. 2 (2026): Jurnal IDEALIS Juli 2026
Publisher : Universitas Budi Luhur

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.36080/idealis.v9i2.3814

Abstract

The increasing use of paylater services in various regions of Indonesia has given rise to a large collection of user reviews that contain meaningful information about how users evaluate and perceive the experience of using the service. This research focuses on the classification of sentiment contained in paylater app reviews using two machine learning approaches, namely Random Forest and Logistic Regression, which are tested both with and without the application of the Synthetic Minority Oversampling Technique (SMOTE) to address class inequality. Review information is obtained from the Google Play Store and goes through a series of initial steps involving text cleaning, case processing, standardization of non-standard words, splitting sentences into tokens, removing meaningless words, and also stemming. Subsequent characteristic extraction is carried out using the TF-IDF method (Term Frequency-Inverse Document Frequency), before the data is divided into training and testing sets using three split configurations: 80:20, 70:30, and 60:40, to evaluate model consistency across varying training data sizes. The 80:20 split consistently produced the highest performance across all models. The results of all tested configurations, the combination of Logistic Regression with SMOTE provided the best results, achieving 88.38% accuracy, 88.37% precision, 88.38% recall, and 88.37% F1-score. Unlike previous studies that analyzed sentiment from a single paylater application using a single algorithm without class balancing, this study contributes by simultaneously collecting data from three major paylater applications and empirically comparing the effect of SMOTE on two algorithms across three data split configurations, providing a more comprehensive and generalizable benchmark for paylater sentiment classification in Indonesia. This finding indicates that the application of SMOTE also strengthens the model's performance by addressing the imbalance between sentiment classes, while Logistic Regression is proven to be able to recognize patterns related to sentiment in review text. In general, this study shows that combination of TF-IDF, Logistic Regression, and SMOTE builds an effective system for classifying sentiment in paylater application reviews.
Optimasi Hiperparameter Extreme Learning Machine Menggunakan Particle Swarm Optimization dan Indikator Teknikal untuk Peramalan Bitcoin Bagus Putra Sulung; Wiwit Agus Triyanto; Pratomo Setiaji
IDEALIS : InDonEsiA journaL Information System Vol. 9 No. 2 (2026): Jurnal IDEALIS Juli 2026
Publisher : Universitas Budi Luhur

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.36080/idealis.v9i2.3812

Abstract

Highly volatile price changes in crypto assets like Bitcoin complicate precise forecasting. The Extreme Learning Machine (ELM) artificial neural network approach offers high computational speed but is prone to performance instability due to random weight initialization and manual hyperparameter determination. To overcome this problem, this study proposes a hybrid PSO-ELM algorithm to automate the search for optimal parameters, namely the number of hidden neurons and the regression regularization penalty. Evaluated using a five-fold Walk-Forward Validation to prevent data leakage, the model comparatively tested five input feature scenarios based on technical indicators, which are mathematical calculations from historical prices to identify market patterns. Results demonstrate the hybrid PSO-ELM outperforms conventional static models, reducing average error (MAPE) by 18.67 percent. The cross-scenario comparison reveals that applying the Simple Moving Average technical indicator yields the best forecasting model, achieving a 26.65 percent error reduction and a final MAPE accuracy of 2.15 percent. The contribution of this research is providing empirical evidence that automatic parameter optimization combined with a random fluctuation filtering feature is proven to be more robust and accurate in responding to extreme volatility compared to the stacking of various complex derivative momentum indicators.
Analisis Sentimen Ulasan Mobile Legends: Bang Bang dalam Bahasa Indonesia Menggunakan Random Forest, KNN, TF-IDF, dan SMOTE Ahmad Alif Candra Selamet; Pratomo Setiaji; Wiwit Agus Triyanto
IDEALIS : InDonEsiA journaL Information System Vol. 9 No. 2 (2026): Jurnal IDEALIS Juli 2026
Publisher : Universitas Budi Luhur

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.36080/idealis.v9i2.3819

Abstract

Mobile Legends: Bang Bang (MLBB) is one of the most popular mobile games, generating a large number of user reviews on the Google Play Store. The large volume of reviews makes manual sentiment analysis impractical, requiring an automated machine learning approach. This study compares the performance of Random Forest and K-Nearest Neighbors (KNN) for classifying sentiment in Indonesian-language MLBB reviews. A total of 6,994 reviews were obtained through web scraping and preprocessing. The proposed framework includes text preprocessing, rating-based sentiment labeling, TF-IDF feature extraction, SMOTE-based class balancing, model training, and evaluation using Accuracy, Precision, Recall, F1-score, Macro-F1, Weighted-F1, and 5-fold cross-validation. Random Forest with SMOTE achieved the best performance, with an Accuracy of 84.0% and a Macro-F1 score of 80.8%, outperforming KNN with SMOTE, which achieved 73.8% Accuracy and 71.9% Macro-F1. The ablation study demonstrates that the effectiveness of SMOTE is model-dependent, improving Random Forest but degrading KNN performance. This study provides empirical evidence of SMOTE impact on different classifiers and employs cross-validation-based K selection to prevent test data leakage.