A Sinra
UPTP. Wil. Makassar 1 Badan Pendapatan Daerah Prov. Sulsel

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

Handling Imbalanced Data in Concept Map Proposition Quality Classification: A Comparative Study of Resampling and Class-Weighted SVM Nurul Rismayanti; Lukman Syafie; A Sinra; Rahmadani Rahmadani; Roesman Ridwan Raja
Indonesian Journal of Data and Science Vol. 7 No. 1 (2026): Indonesian Journal of Data and Science
Publisher : Yocto Brain

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.56705/ijodas.v7i1.482

Abstract

Introduction: Concept maps are widely used in education to represent students’ knowledge structures, while automatic proposition-level quality classification can support faster and more consistent assessment. However, imbalanced class distributions may cause classification models to favor majority classes and reduce performance on minority categories. Method: This study compared several imbalance-handling techniques for concept map proposition quality classification using Support Vector Machine (SVM) with TF-IDF features. The dataset comprised 691 propositions grouped into four quality classes, with class 3 dominating the distribution. The evaluated approaches included baseline training, Random OverSampler, SMOTE, ADASYN, SMOTE-Tomek, SMOTE-ENN, and cost-sensitive SVM with class_weight='balanced'. Data were divided using an 80:20 stratified split, with balancing applied only to the training set. Results and Discussion: The cost-sensitive SVM achieved the best overall performance with 0.8417 accuracy, 0.7098 macro precision, 0.7320 macro recall, 0.7149 macro F1-score, 0.8455 weighted F1-score, and 0.2158 MAE. Among resampling approaches, ADASYN and Random OverSampler were the most competitive, whereas SMOTE-based variants produced lower macro-level performance. Conclusion: Class-weighted SVM is more effective than the evaluated resampling techniques for sparse, imbalanced concept map proposition data, highlighting the importance of macro-level and ordinal-aware metrics in educational text classification.