Article Per Year (5 Year)
p-Index From 2021 - 2026
6.316
P-Index
This Author published in this journals
All Journal International Journal of Electrical and Computer Engineering Semantik Jurnal Buana Informatika Sistemasi: Jurnal Sistem Informasi Sinkron : Jurnal dan Penelitian Teknik Informatika Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) SemanTIK : Teknik Informasi JURNAL MEDIA INFORMATIKA BUDIDARMA Jurnal Sains dan Informatika JURNAL TEKNIK INFORMATIKA DAN SISTEM INFORMASI Technomedia Journal Jiko (Jurnal Informatika dan komputer) Indonesian Journal of Computing and Modeling International Journal of Natural Science and Engineering JURTEKSI Jurnal Informatika JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika) JUSIM (Jurnal Sistem Informasi Musirawas) Building of Informatics, Technology and Science Progresif: Jurnal Ilmiah Komputer Journal of Information Systems and Informatics Jurnal JTIK (Jurnal Teknologi Informasi dan Komunikasi) Aiti: Jurnal Teknologi Informasi MEANS (Media Informasi Analisa dan Sistem) Jurnal Teknik Informatika (JUTIF) Journal of Information Technology Ampera Edutik : Jurnal Pendidikan Teknologi Informasi dan Komunikasi International Journal Software Engineering and Computer Science (IJSECS) INOVTEK Polbeng - Seri Informatika
Indrastanti Ratna Widiasari
Universitas Kristen Satya Wacana
Agriculture, Biological Sciences & Forestry Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Earth & Planetary Sciences Education Electrical & Electronics Engineering Engineering Languange, Linguistic, Communication & Media Mathematics Other

Published : 51 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 51 Documents
Search

 2   3   4   5   6 
Accuracy Evaluation of the Naïve Bayes Classifier for Sentiment Classification of Diploma Authenticity Issues using Orange Eunike Loise Laapen; Indrastanti Ratna Widiasari
Sistemasi: Jurnal Sistem Informasi Vol 15, No 6 (2026): Sistemasi: Jurnal Sistem Informasi
Publisher : Universitas Islam Indragiri

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.32520/stmsi.v15i6.6585

Abstract

The rapid growth of digital text data has increased the demand for effective methods to extract meaningful information, particularly for understanding public opinion. Sentiment analysis is widely used to classify opinions into positive, negative, and neutral categories. However, challenges such as linguistic ambiguity, subjectivity, and class imbalance often degrade classification performance. This study aims to evaluate the performance of the Naïve Bayes algorithm for sentiment classification on the issue of diploma authenticity using a publicly available dataset, while examining the impact of data distribution on model performance. A quantitative experimental approach was employed using an original dataset of 1,014 instances and an oversampled dataset of 1,767 instances. The data were processed through preprocessing, Bag-of-Words feature extraction, and sentiment classification using Orange Data Mining with 10-fold cross-validation. Model performance was evaluated using accuracy and the Area Under the Receiver Operating Characteristic Curve (AUC). The results indicate that the Naïve Bayes model achieved an accuracy of 37.2% and an AUC of 0.704 on the original imbalanced dataset, reflecting relatively poor classification performance. After applying oversampling to balance the class distribution, the model's accuracy increased substantially to 82.1%, while the AUC improved to 0.970. These findings demonstrate that class distribution has a significant impact on the performance of the Naïve Bayes algorithm in sentiment classification and highlight the importance of addressing class imbalance to achieve more reliable classification results.
Co-Authors Aditya Indra Cahya Amanda Angreyni Regal Ardianto, Yeheskiel Hency Arnando, Kelvin Arya Pradana Bagus Pramono Bayu Edhi Setyawan Billy Hamsen Cahyaningrum, Yuliana Cahyaningtyas, Christian Christopher, William Cristianto, Denil Dian W Chandra Eunike Loise Laapen Fra Arsandy Kusuma Sejati Fransiskus Simson Irwan Sembiring Jonathan Liando Kendek Allo, Alvin Kevin Lala, Zefanya Loudewieq Gabriel Maay, Buyung Herfandy Maitimu, Excel Barthel Manuputty, Yandri Y Marpaung, Kristian Vieri Merryana Lestari Najoan, Patrick Nikolaus Toni Prahara, Imanuel Noval Amanda Prasetia, Rega Dhiwastu Rapawuli Eko Putro Raweyai, Soni Sampari Rezky Kristian Bangun Rissal Efendi Rissal Efendi Rissal Efendi Rissal Effendi Riyanto, Muhamad Rizal Dwi Pratomo safry pasau tangdisosang Sebayang, Andreas Setiawan, Muhamad Avif Simarmata, Hotman Samuel Sufardy, Devander Benaryanta Suwijo Danu Prasetyo T. Arie Setiawan Prasida Teguh Wahyono Theopillus J. H. Wellem Theovan Gracia Stefana Putra Ulfa Septilia Permatasari Wibowo, Gading Haryono Wisnu Widi Anggoro Yessica Nataliani Yoel Chandra Eka Paksi Yonatan Surya Kristama