Sinergi International Journal of Education
Vol. 4 No. 3 (2026): August 2026

Development and Initial Validation of a Chatbot-Based Conversational Assessment Model for Post-Learning Reflective Affective Assessment

Fikriansyah Haikal Ramadhan (Universitas Pendidikan Indonesia)
Rizki Hikmawan (Universitas Pendidikan Indonesia)



Article Info

Publish Date
31 Aug 2026

Abstract

Affective assessment remains challenging in educational practice due to its subjective nature and the difficulty of systematically documenting students' attitudes and values. Although affective learning outcomes are essential for holistic education, assessment practices often rely on teacher observations that may be influenced by personal judgment. This study aimed to develop and conduct an initial validation of Affectra, a chatbot-based conversational assessment model for reflective affective assessment following learning activities. Unlike most educational chatbots designed for learning support or cognitive assessment, Affectra integrates conversational assessment, adaptive probing, Large Language Model (LLM)-based analysis, and Krathwohl's affective taxonomy into a unified assessment framework. A modified Research and Development (R&D) approach was adopted, consisting of needs analysis, model and instrument design, expert validation, alpha testing, and system refinement. The model was developed for secondary school learning, with validation limited to expert review and researcher-controlled alpha testing. Content validity was evaluated using the Index of Item–Objective Congruence (IOC) with six experts in educational assessment and educational technology, while system performance was assessed through functional and scenario-based testing. The instrument achieved an overall IOC score of 0.81, indicating satisfactory content validity, and demonstrated consistent classification across Krathwohl's five affective levels under predefined simulated scenarios. These findings provide preliminary evidence supporting the initial development and internal validation of Affectra. Further classroom validation involving actual students is required to evaluate its practical effectiveness.

Copyrights © 2026






Journal Info

Abbrev

Education

Publisher

Subject

Education

Description

Sinergi International Journal of Education with ISSN Number 2988-4926 (Online) published by Yayasan Sinergi Kawula Muda, published original scholarly papers across the whole spectrum of educations. The journal attempts to assist in the understanding of the present and potential ability of education ...