Journal Digital Technology Trend
Vol. 5 No. 2 (2026): December

Implementasi Machine Learning dengan Metode Text Mining dan Algoritma Naïve Bayes untuk Klasifikasi Keluhan Pelanggan pada Twitter Operator Telkomsel

Dedi Dwi Saputra (Cyber University Indonesia)
Riza Fahlapi (Universitas Bina Sarana Informatika)
Antonius Yadi Kuntoro (Universitas Bina Sarana Informatika)
Taufik Asra (Universitas Bina Sarana Informatika)
Hermanto Hermanto (Politeknik ‘Aisyiyah Pontianak)



Article Info

Publish Date
01 Dec 2026

Abstract

Twitter is one of the most widely used social media platforms in Indonesia, and telecommunication companies such as PT Telekomunikasi Seluler (Telkomsel) utilize their official account, @Telkomsel, as a primary channel for customer interaction and complaint handling. Currently, incoming complaint tweets are still classified manually by the customer service division, a procedure that is time-consuming and prone to human inconsistency. This study implements a text mining approach integrating the Naïve Bayes algorithm, Adaptive Boosting (AdaBoost), and the Synthetic Minority Over-Sampling Technique (SMOTE) to automatically classify Indonesian-language tweets mentioning @Telkomsel into two classes: "Complaint" and "Non-Complaint." A dataset of 2,000 tweets was collected through crawling in RapidMiner, followed by a two-stage text preprocessing workflow utilizing Gataframework and RapidMiner. The classification model was validated using 10-fold cross-validation. The experimental results demonstrate that the combination of Naïve Bayes, AdaBoost, and SMOTE achieves an accuracy of 78.84%, precision of 79.90%, recall of 80.51%, and an AUC of 0.809. These findings confirm that the proposed framework is capable of effectively automating complaint detection to support more responsive customer service operations.

Copyrights © 2026






Journal Info

Abbrev

jdtt

Publisher

Subject

Computer Science & IT Decision Sciences, Operations Research & Management

Description

The Journal Digital Technology Trend is an international journal that promotes the study and interest in Information Systems (IS) and Digital Technologies (DT). The journal will cover in depth and breadth the areas related to IS and digital technologies and techniques. Articles in the journal may be ...