International Journal of New Media Technology
Vol 7 No 1 (2020): IJNMT (International Journal of New Media Technology)

A Comparison of Traditional Machine Learning Approaches for Supervised Feedback Classification in Bahasa Indonesia

Andre Rusli (Universitas Multimedia Nusantara)
Alethea Suryadibrata (Universitas Multimedia Nusantara)
Samiaji Bintang Nusantara (Universitas Multimedia Nusantara)
Julio Christian Young (Unknown)



Article Info

Publish Date
02 Jul 2020

Abstract

The advancement of machine learning and natural language processing techniques hold essential opportunities to improve the existing software engineering activities, including the requirements engineering activity. Instead of manually reading all submitted user feedback to understand the evolving requirements of their product, developers could use the help of an automatic text classification program to reduce the required effort. Many supervised machine learning approaches have already been used in many fields of text classification and show promising results in terms of performance. This paper aims to implement NLP techniques for the basic text preprocessing, which then are followed by traditional (non-deep learning) machine learning classification algorithms, which are the Logistics Regression, Decision Tree, Multinomial Naïve Bayes, K-Nearest Neighbors, Linear SVC, and Random Forest classifier. Finally, the performance of each algorithm to classify the feedback in our dataset into several categories is evaluated using three F1 Score metrics, the macro-, micro-, and weighted-average F1 Score. Results show that generally, Logistics Regression is the most suitable classifier in most cases, followed by Linear SVC. However, the performance gap is not large, and with different configurations and requirements, other classifiers could perform equally or even better.

Copyrights © 2020






Journal Info

Abbrev

IJNMT

Publisher

Subject

Computer Science & IT Control & Systems Engineering Electrical & Electronics Engineering Engineering

Description

International Journal of New Media Technology (IJNMT) is a scholarly open access, peer-reviewed, and interdisciplinary journal focusing on theories, methods, and implementations of new media technology. IJNMT is published annually by Faculty of Engineering and Informatics, Universitas Multimedia ...