Indonesian Journal of Data and Science
Vol. 7 No. 1 (2026): Indonesian Journal of Data and Science

Handling Imbalanced Data in Concept Map Proposition Quality Classification: A Comparative Study of Resampling and Class-Weighted SVM

Nurul Rismayanti (Universitas Muslim Indonesia)
Lukman Syafie (Universiti Kuala Lumpur)
A Sinra (UPTP. Wil. Makassar 1 Badan Pendapatan Daerah Prov. Sulsel)
Rahmadani Rahmadani (Universitas Muslim Indonesia)
Roesman Ridwan Raja (Kyushu Institute of Technology)



Article Info

Publish Date
17 Mar 2026

Abstract

Introduction: Concept maps are widely used in education to represent students’ knowledge structures, while automatic proposition-level quality classification can support faster and more consistent assessment. However, imbalanced class distributions may cause classification models to favor majority classes and reduce performance on minority categories. Method: This study compared several imbalance-handling techniques for concept map proposition quality classification using Support Vector Machine (SVM) with TF-IDF features. The dataset comprised 691 propositions grouped into four quality classes, with class 3 dominating the distribution. The evaluated approaches included baseline training, Random OverSampler, SMOTE, ADASYN, SMOTE-Tomek, SMOTE-ENN, and cost-sensitive SVM with class_weight='balanced'. Data were divided using an 80:20 stratified split, with balancing applied only to the training set. Results and Discussion: The cost-sensitive SVM achieved the best overall performance with 0.8417 accuracy, 0.7098 macro precision, 0.7320 macro recall, 0.7149 macro F1-score, 0.8455 weighted F1-score, and 0.2158 MAE. Among resampling approaches, ADASYN and Random OverSampler were the most competitive, whereas SMOTE-based variants produced lower macro-level performance. Conclusion: Class-weighted SVM is more effective than the evaluated resampling techniques for sparse, imbalanced concept map proposition data, highlighting the importance of macro-level and ordinal-aware metrics in educational text classification.

Copyrights © 2026






Journal Info

Abbrev

ijodas

Publisher

Subject

Computer Science & IT Decision Sciences, Operations Research & Management Mathematics

Description

IJODAS provides online media to publish scientific articles from research in the field of Data Science, Data Mining, Data Communication, Data Security and Data ...