Akhmad Syaifuddin
Informatics, Universitas Sebelas Maret, Indonesia

Published : 2 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 2 Documents
Search

Sentence-Level Sentiment Analysis of Indonesian App Reviews Using IndoBERTweet Inge Najwa Aqiilah; Ristu Saptono; Akhmad Syaifuddin
Journal of Computing Theories and Applications Vol. 4 No. 1 (2026): JCTA 4(1) 2026
Publisher : Universitas Dian Nuswantoro

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.62411/jcta.16240

Abstract

Document-level sentiment analysis assigns a single polarity label to an entire review, often obscuring opinion diversity within multi-sentence submissions. This limitation is particularly evident in reviews of multi-service platforms, where users frequently express heterogeneous opinions toward different aspects of the platform in the same review. To address this challenge, this study proposes a sentence-level sentiment analysis framework for Indonesian Gojek app reviews collected from the Google Play Store. The proposed framework introduces a two-stage segmentation strategy that combines punctuation-aware rules with conjunction-aware splitting based on coordinating and adversative conjunctions (e.g., tapi [but], padahal [even though]) to identify opinion boundaries and decompose mixed-sentiment reviews into independently classifiable sentence units. A total of 14,730 raw reviews collected between May and July 2025 were subjected to data cleaning and quality filtering, resulting in 7,187 valid reviews that were further segmented into 14,187 sentence-level instances. Each instance was manually annotated by three annotators using a four-class labeling scheme consisting of app-positive, app-negative, app-neutral, and service categories. Sentiment-level inter-annotator agreement, computed on the subset of instances unanimously categorized as app-related by all three annotators (n = 4,384), achieved substantial agreement (Fleiss'  = 0.636). Hyperparameter optimization was conducted using Optuna with the Tree-structured Parzen Estimator (TPE) sampler across four experimental scenarios. The best performance was achieved by IndoBERTweet under Stratified K-Fold evaluation, attaining an accuracy of 0.751 and a macro F1-score of 0.729, outperforming all IndoBERT configurations. The results demonstrate the effectiveness of domain-adaptive pre-training on informal Indonesian text and highlight the value of conjunction-aware segmentation for preserving fine-grained opinion structures in mixed-sentiment reviews. These findings suggest that domain-aligned language representations provide a practical and effective solution for sentence-level sentiment analysis of Indonesian app reviews.
Content-Based Recommendation System for Non-Textbook using TF-IDF, Cosine Similarity, and Educational Level Filtering Arif Rohmadi; Ristu Saptono; Brilyan Hendrasuryawan; Bambang Widoyono; Akhmad Syaifuddin
Jurnal Teknik Informatika (Jutif) Vol. 7 No. 4 (2026): JUTIF Volume 7, Number 4, August 2026
Publisher : Informatika, Universitas Jenderal Soedirman

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52436/1.jutif.2026.7.4.5425

Abstract

Non-textbook educational resources refer to books designed to enrich readers’ knowledge, insights, and skills, serving as complementary materials to formal textbooks. These may include fiction, non-fiction, biographies, self-help books, and other supplementary literature. However, the broad range of available non-textbooks targeting diverse educational levels often presents challenges for students in selecting materials that are appropriate to their academic stage. This study aims to develop a content-based recommendation system capable of recommending non-textbooks based on the reader's educational level. The recommendation process employs Term Frequency–Inverse Document Frequency (TF-IDF) for feature extraction and Cosine Similarity to calculate semantic similarity between user search queries and book content. To improve relevance, a filtering mechanism based on education level is introduced prior to feature extraction. Experimental results show that applying this filtering process significantly improves the recommendation's performance, yielding an average precision of 100%. In contrast, models without the filtering process achieve only 50% precision. These findings highlight the effectiveness of contextual filtering in improving the accuracy of non-textbook recommendation systems.