Tjokro, Vinsencius Christio
Unknown Affiliation

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

Dealing imbalance dataset problem in sentiment analysis of recession in Indonesia Kristiyanti, Dinar Ajeng; Sanjaya, Samuel Ady; Tjokro, Vinsencius Christio; Suhali, Jason
IAES International Journal of Artificial Intelligence (IJ-AI) Vol 13, No 2: June 2024
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/ijai.v13.i2.pp2060-2072

Abstract

Global recession news dominates social media, particularly in Indonesia, with social news platforms on Twitter generating public responses and re-tweetings on the issue. Mining these opinions from Twitter using a sentiment analysis approach yields invaluable insights. The research stages included data collection, pre-processing, data labeling using the lexical-based method like valence aware dictionary and sentiment reasoner (VADER) and TextBlob, sampling techniques using synthetic minority oversampling technique (SMOTE) and random over sampling (ROS) before and after splitting data, and modeling using machine learning such as support vector machines (SVM), k-nearest neighbour (KNN), naive Bayes, and model evaluation. The problem is that almost 300,000 data collected from NodeXL are unbalanced. The findings show that models with balanced datasets show better model evaluation results. The sampling technique was carried out before and after splitting the data. The model evaluation results show that the Bernoulli-naive Bayes algorithm, with the VADER labeling technique, and the SMOTE sampling technique after splitting data, obtains the best accuracy of 84%, and using the ROS technique obtains an accuracy of 81%. On the other hand, with the SMOTE and ROS technique before splitting data on the SVM algorithm, it gets the best accuracy of 93% from before if only using SVM only reached 84%.