Jurnal Computer and Technology
Vol. 4 No. 1 (2026): July 2026

A Dual-Pipeline Imbalance-Robust Framework for SMS Spam Detection: Achieving Flawless Precision via SMOTE-Augmented Ensembles with Rigorous Statistical Validation

Zulpan Hadi (Universitas Teknologi Mataram)
Selamet Riadi (Universitas Teknologi Mataram)
Supardianto (Universitas Teknologi Mataram)
Aulia Riswanti Naya (Offenburg University of Applied Sciences)
Liana Trihardianingsih (Universitas PGRI Jombang)



Article Info

Publish Date
23 Jul 2026

Abstract

The rapid proliferation of digital communication has exponentially increased the volume of Short Message Service (SMS) spam, exposing mobile users to systemic convenience disruptions, productivity drops, and severe financial losses through sophisticated fraudulent schemes. To construct a highly dependable filtering mechanism, this study presents a rigorous dual-pipeline machine learning framework that systematically addresses the challenges of class imbalance in statistical text mining. Utilizing a verified dataset of 5,572 Indonesian-context short messages, the raw textual corpus is subjected to uniform case normalization, structural URL extraction, and character filtering before feature projection via Term Frequency–Inverse Document Frequency (TF-IDF) vectorization. To overcome the inherent accuracy paradox of skewed class distributions, the experimental design evaluates a baseline pipeline (imbalanced data) against a synthetic data augmentation pipeline leveraging the Synthetic Minority Oversampling Technique (SMOTE) across four distinct classifiers: Logistic Regression, Naive Bayes, Linear Support Vector Machine (Linear SVM), and Random Forest. Empirical results demonstrate that while the baseline Linear SVM serves as the optimal standalone model for overall balance, achieving a peak accuracy of 98.11% and a dominant F1-Score of 92.83%, the SMOTE-augmented Random Forest configuration yields an exceptional high-security alternative by securing a flawless 100.00% precision envelope alongside an 83.89% recall rate. Advanced post-hoc evaluations including McNemar's statistical significance tests (,  for Random Forest), qualitative error analyses of semantic edge cases, and runtime profiling confirm that the developed architecture establishes a highly scalable, mathematically verified, and low-latency solution suitable for integration into real-time telecom filtering gateways.

Copyrights © 2026






Journal Info

Abbrev

COMTECHNO

Publisher

Subject

Computer Science & IT

Description

Jurnal Computer and Technology or abbreviated Comtechno is a national journal published by the Ninety Media Publisher since 2023 with E-ISSN : 3048-1880. Comtechno focuses on various issues spanning: Internet of Things (IoT), electronics engineering, software engineering, mobile technology and ...