Intechno Journal : Information Technology Journal
Vol. 8 No. 1 (2026): July

A Hybrid Rule-Based and Multinomial Naïve Bayes System for Sentiment and Intent Classification of Indonesian Public Reports with Sarcasm Detection

Suhendri Suhendri (Universitas Majalengka)
Sahal Ubaidillah Gunardo (Universitas Majalengka)
Kartika Dwi Mulyana (Universitas Majalengka)
Ruli Susanti (Universitas Majalengka)
Dika Alfaizal Akbar (Universitas Majalengka)
Amelia Putri (Universitas Majalengka)



Article Info

Publish Date
31 Jul 2026

Abstract

Public service reporting systems in Indonesia face significant challenges in processing large volumes of unstructured citizen feedback efficiently. This study proposes Aspiralytica, a mobile-based citizen report classification system that integrates TF-IDF feature extraction with a Multinomial Naive Bayes (MNB) classifier within a hybrid rule-based and machine learning architecture. The system simultaneously performs three-class sentiment classification (positive, negative, neutral) and five-class intent classification (complaint, appreciation, request, emergency, suggestion), with automated priority level determination and a rule-based sarcasm detection module achieving F1 of 0.8980. Evaluated on an augmented dataset of 1,137 sentiment-labeled and 2,187 intent-labeled Indonesian-language citizen report texts using Stratified 10-Fold Cross-Validation, the proposed MNB model achieved sentiment classification accuracy of 96.59% (F1: 96.59%) and intent classification accuracy of 96.97% (F1: 96.96%). An ablation study confirmed TF-IDF with MNB as the dominant performance driver, and a computational efficiency benchmark empirically justified MNB selection with mean inference latency of 0.3955 ms and throughput of 52,312 requests per second. The system is deployed as a FastAPI backend integrated with a React Native mobile frontend, delivering real-time classification through a citizen-facing interface.

Copyrights © 2026






Journal Info

Abbrev

intechno

Publisher

Subject

Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Electrical & Electronics Engineering Engineering

Description

Intechno Journal (e-ISSN 2655-1438 | p-ISSN 2655-1632) published by Universitas Amikom Yogyakarta in collaboration with Indonesian Computer, Electronics and Instrumentation Support Society (IndoCEISS) to promote high-quality Information Technology (IT) research among academics and practitioners ...