Information Technology Education Journal
Vol. 5, No. 4, November (2026)

From Sentiment to Pedagogical Insight: Comparing SVM, Random Forest, and Multi-Task IndoBERT for Joint Sentiment–Theme Classification of Indonesian Student Feedback

Sri Mujiyono (Universitas Ngudi Waluyo)
Ucta Pradema Sanjaya (Universitas Ngudi Waluyo)



Article Info

Publish Date
01 Nov 2026

Abstract

Purpose – Student feedback in Indonesian higher education is a rich pedagogical resource that stays underused. Sentiment analysis under controlled conditions has rarely reached the Indonesian academic domain. This study compares three classification approaches on student feedback: Support Vector Machine, Random Forest, and IndoBERT.  Design/methods/approach – Unlike earlier work that splits sentiment and theme into two independent pipelines, we design a multi-task IndoBERT with one shared encoder and two classification heads, so that sentiment and instructional dimension are predicted jointly for the same response. We also build a preprocessing pipeline tuned to Indonesian academic discourse, with slang normalization and domain-specific stop-word filtering. Experiments run on a corpus of 800 annotated responses drawn from four study programs across three disciplinary clusters. Findings – Under repeated stratified 5-fold cross-validation, multi-task IndoBERT reached a mean sentiment accuracy of 77.9%, against SVM (72.8%) and Random Forest (70.1%); on the held-out test set its thematic macro F1 was 0.757. On the same test set, McNemar's test placed IndoBERT significantly ahead of both baselines at the 0.05 level (p = 0.008 against SVM and p = 0.012 against Random Forest); only the margin over SVM also clears the stricter 0.01 threshold.  Three thematic dimensions emerged: Instructional Clarity, Assessment Design, and Technological Access. Research implications/limitations – The joint model provides actionable insights for NLP research and targeted faculty development. However, the single-institution scope constrains cross-institutional generalization. Originality/value – The pedagogical contribution lies in that joint output: instead of reporting that feedback is negative, the model identifies which dimension of teaching the negativity concerns, so faculty-development programs can target where dissatisfaction actually concentrates rather than act on an aggregate satisfaction score.

Copyrights © 2026






Journal Info

Abbrev

INTEC

Publisher

Subject

Computer Science & IT Education

Description

INTEC Journal is published by the Informatics and Computer Engineering Education Study Program at Makassar State University. INTEC Journal is published periodically three times a year, containing articles on research results and / or critical studies in the field of Informatics and Computer ...