Jurnal Mantik
Vol. 8 No. 1 (2024): May: Manajemen, Teknologi Informatika dan Komunikasi (Mantik)

Performance evaluation of SVM with synthetic minority over-sampling technique in sentiment classification

Singgalen, Yerik Afrianto (Unknown)



Article Info

Publish Date
30 May 2024

Abstract

This study investigates the performance of the Support Vector Machine (SVM) algorithm in sentiment analysis tasks within the context of tourism destination branding, utilizing the Cross-Industry Standard Process for Data Mining (CRISP-DM) framework. Specifically, the research compares SVM performance with and without the Synthetic Minority Over-sampling Technique (SMOTE) across various metrics including accuracy, precision, recall, F-measure, and Area Under the Curve (AUC). The analysis is conducted on a dataset comprising textual data extracted from "Wonderful Indonesia" promotional videos featuring Labuan Bajo. Results indicate that SVM without SMOTE achieves a slightly higher accuracy of 97.79% compared to 96.61% with SMOTE. However, a closer examination reveals that SVM without SMOTE accurately classifies all positive instances, while with SMOTE, one positive instance is misclassified as negative. Precision, recall, and F-measure scores for positive instances are also higher without SMOTE, indicating better performance in classifying positive sentiment

Copyrights © 2024






Journal Info

Abbrev

mantik

Publisher

Subject

Computer Science & IT Economics, Econometrics & Finance Languange, Linguistic, Communication & Media

Description

Jurnal Mantik (Manajemen, Teknologi Informatika dan Komunikasi) is a scientific journal in information systems/informati containing the scientific literature on studies of pure and applied research in information systems/information technology,Comptuer Science and management science and public ...