Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Jurnal Teknik Informatika (JUTIF)

Cybersecurity Risk Detection Based on Roblox User Review Analysis Using TF-IDF and Comparison of Naïve Bayes and Support Vector Machine Alam, RG Guntur; Ibrahim, Huda
Jurnal Teknik Informatika (Jutif) Vol. 7 No. 2 (2026): JUTIF Volume 7, Number 2, April 2026
Publisher : Informatika, Universitas Jenderal Soedirman

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52436/1.jutif.2026.7.2.5582

Abstract

The rapid growth of online gaming platforms increases user engagement while also exposing users to technical and cybersecurity risks. User reviews represent a rich yet underutilized textual source that can serve as early indicators of such risks. Unlike prior studies focused on sentiment polarity, this study positions user reviews as early cybersecurity risk signals by mapping complaint patterns into operational security risk categories relevant to system developers. This study compares Naïve Bayes (NB) and Support Vector Machine (SVM) in detecting cybersecurity risks from imbalanced textual data derived from Roblox user reviews. A total of 3,000 reviews were collected from the Google Play Store via web scraping and preprocessed using case folding, normalization, tokenization, stopword removal, and stemming. Reviews were classified into four cybersecurity risk categories (account access issues, suspicious behavior, connection instability, and data loss) based on rule-based security keyword mapping. Text representation employed TF-IDF with unigram and bigram features, while class imbalance was handled through undersampling. Model evaluation used three train–test splits (80:20, 70:30, and 60:40) and was assessed using Accuracy, Macro F1-score, AUC-PR, training time, and statistical testing. Results show that SVM consistently outperforms Naïve Bayes, achieving higher accuracy (0.86–0.88) and substantially better Macro F1-scores (0.73–0.77), indicating more balanced detection of minority cybersecurity risks. These differences are statistically significant (p < 0.05). The novelty of this study lies in transforming user reviews into a structured cybersecurity risk detection framework and empirically demonstrating the robustness of SVM in identifying rare but critical risks from imbalanced data.
Co-Authors AA Sudharmawan, AA Abdullah, Dedy Abid Aprialdi Adinda Trisista Akfarelta, Akfarelta Amrul Faruq Andi Lala Andilala, Andilala ANDRI KURNIAWAN Apridiansyah, Yovi Arbeiansah Pratama Putra Ariyanti, Widya Caca Andika Cahyo Prihantoro Dedy Abdullah Dia Komalla ewika dwi wulandari Fikri Agnesa Putra Fransiska, Nora Geri Rizki Ramadani Gufron, Muhammad Ale Gunawan Gunawan Gunawan Gunawan Gunawan Handayani, Sri Harianto, Ozi Harry Witriyono Hary Witriyono Helen Anggraini Heri Sulasono Hidayah, Aditia Hidayah, Agung Karisma hidayah, agung kharisma Ibrahim, Huda Jaka Rapino Juhardi, Ujang Karnedi, Gunawan Khairullah Khairullah, Khairullah Kirman Kirman Kirman Kirman, Kirman Lena Utami Lestari, Putri Dwi Lety Lestari Lingga, Ravi Putra Lorensya, Cintia Novita Machmud Effendy Mahendra, Yusril Mahfuzhi, A.R Walad Mahfuzi, AR. Walad Marissa Utami mawanti, desti melzan sabri sabri Monsya Juansen muhammad fikri Muntahanah, Muntahanah Mutiara Hikmah Nathania, Nabela Hermy Nengsi, Elta Putri Setia Netra Ayu Nita, Taura Puji Rahayu Kurniasih Putra, Arbeiansah Pratama Putra, Fikri Agnesa Rahmadani, Reza Nur Rajes Andika Putra Ramayanti, Imelia Okta Ramzi, Reja Muhamad Randi Riski Ananda Rexcy Elsan Rido Syahputra Rifqo, Muhammad Husni Rojandra, Hajar Saputra, Ahmat Fahry Saputra, Kreshna Ady Selta Jaya Putra selviani, pebi Sigit Muryono Sri Handayani Sulasono, Heri Supriadi Supriadi Surya Ade Saputera Tauhid, Muhammad Ikhsan Toyib, Rozali Tri Rahayu Trisista, Adinda ujang juhardi Vendy Handoyo Veronika, Adelia Wicaksono, Rama Iqbal Wijaya, Ardi Wulandari, Ardeya Yetman Erwadi Yunus Hidayat Yusril Mahendra Yuza Reswan Zhonata, Jerry Ario