cover
Article Per Year (5 Year)
All
Home Page
OAI Link
Editorial Team
Contact
Reviewer
Google Scholar
Contact Name
Ramdan Satra
Contact Email
Ramdan Satra
Phone
-
Journal Mail Official
ramdan@umi.ac.id
Editorial Address
-
Location
Kota makassar,
Sulawesi selatan
INDONESIA
ILKOM Jurnal Ilmiah
Published by Universitas Muslim Indonesia
ISSN : 20871716     EISSN : 25487779     DOI : -
Core Subject : Science,
Computer Science & IT
ILKOM Jurnal Ilmiah is an Indonesian scientific journal published by the Department of Information Technology, Faculty of Computer Science, Universitas Muslim Indonesia. ILKOM Jurnal Ilmiah covers all aspects of the latest outstanding research and developments in the field of Computer science, including Artificial intelligence, Computer architecture and engineering, Computer performance analysis, Computer graphics and visualization, Computer security and cryptography, Computational science, Computer networks, Concurrent, parallel and distributed systems, Databases, Human-computer interaction, Embedded system, and Software engineering.
Arjuna Subject : -
Articles 11 Documents
 1   2 
Search results for , issue "Vol 17, No 3 (2025)" : 11 Documents clear
Comparative Study of Random Forest and Ordinal Regression in Concept Map Quality Assessment: The Role of TF-IDF, BERT, and SMOTE-based Balancing Rismayanti, Nurul; Prasetya, Didik Dwi; Widiyaningtyas, Triyanna; Hirashima, Tsukasa
ILKOM Jurnal Ilmiah Vol 17, No 3 (2025)
Publisher : Prodi Teknik Informatika FIK Universitas Muslim Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.33096/ilkom.v17i3.2906.336-345

Abstract

Automatic assessment of concept map quality is an important challenge in the field of education, particularly in evaluating students' conceptual understanding objectively and efficiently. This study aims to compare the performance of two machine learning algorithms, namely Random Forest and Ordinal Regression, in classifying the quality of concept maps. The evaluation was conducted on three approaches to text feature representation: Term Frequency-Inverse Document Frequency (TF-IDF), Bidirectional Encoder Representations from Transformers (BERT), and a combination of both (TF-IDF + BERT). Additionally, this study compares the performance of the models under two dataset conditions: original data and data balanced using the Synthetic Minority Over-sampling Technique (SMOTE), to address the class imbalance that often occurs in educational data. The data used consists of a collection of propositions from students' concept maps that have been labeled with ordinal scores based on quality. Text representation is extracted using the TF-IDF and BERT approaches, and then used as input to build the classification model. Performance evaluation was conducted using the metrics of Accuracy, Precision, Recall, F1-score, Cohen’s Kappa, and MAE. The results show that the Ordinal Regression model with TF-IDF representation combined with SMOTE achieved the best performance, with an accuracy of 0.8777, an F1-score of 0.8773, and a Cohen’s Kappa of 0.7701. These results indicate that classical feature representations like TF-IDF remain effective in limited data scenarios, and that the SMOTE technique successfully improved the model's performance by reducing bias towards the majority class. This research contributes to the development of an automatic concept map assessment system and suggests optimal classification strategies for educational datasets with ordinal and imbalanced characteristics

Page 2 of 2 | Total Record : 11

 1   2 

Filter by Year

2025 2025


Reset
Filter By Issues
All Issue Vol 18, No 1 (2026) Vol 17, No 3 (2025) Vol 17, No 2 (2025) Vol 17, No 1 (2025) Vol 16, No 3 (2024) Vol 16, No 2 (2024) Vol 16, No 1 (2024) Vol 15, No 3 (2023) Vol 15, No 2 (2023) Vol 15, No 1 (2023) Vol 14, No 3 (2022) Vol 14, No 2 (2022) Vol 14, No 1 (2022) Vol 13, No 3 (2021) Vol 13, No 2 (2021) Vol 13, No 1 (2021) Vol 12, No 3 (2020) Vol 12, No 2 (2020) Vol 12, No 1 (2020) Vol 11, No 3 (2019) Vol 11, No 2 (2019) Vol 11, No 1 (2019) Vol 11, No 1 (2019) Vol 10, No 3 (2018) Vol 10, No 3 (2018) Vol 10, No 2 (2018) Vol 10, No 2 (2018) Vol 10, No 1 (2018) Vol 10, No 1 (2018) Vol 9, No 3 (2017) Vol 9, No 3 (2017) Vol 9, No 2 (2017) Vol 9, No 2 (2017) Vol 9, No 1 (2017) Vol 9, No 1 (2017) Vol 8, No 3 (2016) Vol 8, No 3 (2016) Vol 8, No 2 (2016) Vol 8, No 2 (2016) Vol 8, No 1 (2016) Vol 8, No 1 (2016) More Issue