Claim Missing Document
Check
Articles

Systematic Review of Hyperparameter Adjustment and Evaluation Metrics in Bert-Based Sentiment Analysis Bahari, Aris Rifki Setiya; Utomo, Fandy Setyo; Berlilana, Berlilana
Journal La Multiapp Vol. 7 No. 2 (2026): Journal La Multiapp
Publisher : Newinera Publisher

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.37899/journallamultiapp.v7i2.3046

Abstract

The development of sentiment analysis towards Aspect-Based Sentiment Analysis (ABSA) has made significant progress thanks to deep learning technology, especially through the Bidirectional Encoder Representations from Transformers (BERT) architecture. Despite its increasing popularity, a comprehensive synthesis of global research patterns and optimal model configurations is still urgently needed. This study presents a Systematic Literature Review (SLR) combined with bibliometric analysis to examine BERT-based ABSA research indexed in Scopus. Using the PRISMA and VOSviewer frameworks for visualization, a total of 62 eligible articles up to mid-2025 were analyzed. The results of the study show a strong upward trend of publications with a peak in 2024, where China, India, and Indonesia emerged as the major contributors in this domain. Further, the review identified a critical technical standard for effective model training: the Adam optimizer was the most dominant choice, typically paired with a learning rate between 1e-5 to 2e-5 and a batch size of 16. Regarding performance evaluation, Accuracy and F1-Score are set as de facto standard metrics. These findings provide strategic guidance for researchers to optimize BERT implementation and identify future directions in more in-depth sentiment analysis tasks.
Comparative Performance Analysis of Random Forest and Logistic Regression for Sentiment Classification of the Makan Bergizi Gratis Program on Platform X Prianto, Slamet Endro; Berlilana, Berlilana; Saputro, Rujianto Eko
Journal of Information System and Informatics Vol 8 No 1 (2026): February
Publisher : Asosiasi Doktor Sistem Informasi Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.63158/journalisi.v8i1.1371

Abstract

The rapid growth of e-commerce has made personalized product recommendations a crucial aspect of enhancing customer satisfaction and boosting sales. However, many small-to-medium-sized retail businesses, like Adiva Fashion Store, still rely on manual product selection through customer searches or seller recommendations, which often leads to challenges in meeting customer preferences. This study presents a case study of Adiva Fashion Store, where the Collaborative Filtering method was implemented to develop a personalized clothing product recommendation system. The item-based Collaborative Filtering approach was employed to calculate the similarity between products based on customer ratings and transaction history. These similarity values were then used to predict customer preferences for products that had not yet been purchased. The system was developed using the Waterfall methodology, which involved needs analysis, system design, implementation, testing, and maintenance. The results show that the recommendation system significantly improved the relevance of product suggestions, helping customers make better purchasing decisions and increasing sales effectiveness. This case study illustrates how data-driven recommendation systems can be effectively integrated into small-to-medium-sized retail environments, providing valuable insights for other businesses aiming to adopt similar strategies.
A Decision Support System for Assessing High School Students' Soft Skills Using the Analytical Hierarchy Process Pramono, Yuwono Wisudo; Berlilana, Berlilana; Barkah, Azhari Shouni
Journal of Information System and Informatics Vol 8 No 1 (2026): February
Publisher : Asosiasi Doktor Sistem Informasi Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.63158/journalisi.v8i1.1420

Abstract

Assessing students' soft skills in educational settings is often challenging due to the subjectivity and inconsistency inherent in evaluating qualitative traits. This study employs the Analytical Hierarchy Process (AHP) as a decision support tool to provide a more systematic, consistent, and objective method for evaluating students' soft skills. The assessment model is based on four key criteria—critical thinking, communication, collaboration, and creativity—each further broken down into measurable subcriteria. The study was conducted at MA Mu’allimin Sruweng Kebumen, where evaluations were carried out by a guidance and counseling teacher acting as an expert evaluator, using a numerical scale ranging from 1 to 100. Pairwise comparison matrices were developed using Saaty’s fundamental scale to determine the weights for both criteria and subcriteria, followed by consistency testing using the Consistency Ratio (CR). The findings reveal that critical thinking and collaboration were assigned the highest priority weights, with all comparison matrices meeting the acceptable consistency threshold. The resulting global preference values offer a more objective, proportional representation of students’ soft skills achievements. This AHP-based model enables fairer, more consistent evaluations and provides quantitative outputs that can be utilized for student ranking and structured feedback in educational decision-making.
Modeling EMIS Adoption with PLS-SEM: Integrating the Government Adoption Model and DeLone–McLean IS Success Model Mardiyanto, Mardiyanto; Berlilana, Berlilana; Purwadi, Purwadi
Journal of Information System and Informatics Vol 8 No 1 (2026): February
Publisher : Asosiasi Doktor Sistem Informasi Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.63158/journalisi.v8i1.1445

Abstract

This study explores the key factors influencing the adoption of the Education Management Information System (EMIS) within Indonesia's Ministry of Religious Affairs (Kemenag), which is vital for managing data and distributing Teacher Professional Allowances (TPG). Data inconsistencies have been a significant challenge, leading to delays in TPG disbursement. To understand the determinants of EMIS adoption, this study integrates the Government Adoption Model (GAM) and DeLone & McLean’s (D&M) Information Systems Success Model. A quantitative approach was used, collecting data from 328 valid responses from MTsN teachers in Kebumen Regency, analyzed using Partial Least Squares Structural Equation Modeling (PLS-SEM). The results show that Perceived Uncertainty (PU), Perceived Security (PSC), and Perceived Privacy (PP) positively contribute to Perceived Trust (PT). Additionally, Information Quality (IQ) emerged as the strongest predictor of EMIS adoption, followed by System Quality (SYQ), Service Responsiveness (PSR), and Trust. The study emphasizes that improving data accuracy (IQ), ensuring system reliability (SYQ), and strengthening security measures (PSC) are critical for accelerating EMIS adoption. The findings offer practical implications for Kemenag to optimize the implementation of EMIS, ultimately improving the efficiency and timeliness of TPG disbursements for educators.
Literature Review: Comparison of Machine Learning Algorithms for Sentiment Analysis of Free Nutritious Meals Mukhlisin, Mukhlisin; Berlilana, Berlilana; Saputro, Rujiyanto Eko
Sistemasi: Jurnal Sistem Informasi Vol 15, No 3 (2026): Sistemasi: Jurnal Sistem Informasi
Publisher : Program Studi Sistem Informasi Fakultas Teknik dan Ilmu Komputer

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.32520/stmsi.v15i3.6201

Abstract

The Free Nutritious Meal (FNM) program has triggered massive public responses on social media, driving numerous machine learning–based sentiment analysis studies. However, there has been no comprehensive review comparing the effectiveness of these methods. This study adopts a Systematic Literature Review (SLR) approach on 18 studies (2024–2026) to evaluate the performance of computational algorithms and map trends in public sentiment. The main contribution of this research is to provide an empirical guide for selecting Indonesian-language text classification models, while also offering insights into shifts in public perception. Key findings indicate that Support Vector Machine (SVM) is the most frequently used method, whereas the highest accuracy (97%) was achieved by a combination of Logistic Regression, SVM, and Random Forest on large datasets. Temporally, sentiment trends shifted from budget skepticism (2024) to positive acceptance during program implementation (2025–2026). The study’s implications support policymakers in evaluating program effectiveness in real time. The scope and limitations of this research focus on literature within a specific timeframe, with performance evaluation emphasizing quantitative accuracy metrics.