IPTEK The Journal for Technology and Science
Vol 33, No 1 (2022)

Adaptive Assessment and Guessing Detection Implementation

Akbar Noto Ponco Bimantoro (Dept. of Informatics, Institut Teknologi Sepuluh Nopember, Surabaya, Indonesia)
Umi Laili Yuhana (Dept. of Informatics, Institut Teknologi Sepuluh Nopember, Surabaya, Indonesia)



Article Info

Publish Date
24 May 2022

Abstract

Computerized adaptive testing (CAT) is a context-based adaptive assessment. However, the assessment result may not be valid because the examinee might cheat or guess the answers. Although there are many guessing detection methods, there are not many discussions about their implementation into CAT. Therefore, this paper presents an example of a modification of an existing software so the newly modified software can detect guessed answers and be able to select questions adaptively. The system can detect assuming behavior by recording the examinee’s answer time. Also, the designed system can like questions adaptively by connecting Fuzzy logic, which calculates what level the question should select for the next iteration. The system is responded well by elementary and college students. A total of 56.6% felt the system was straightforward to use. The detection methods can detect guessing behavior of about 73%. However, the system’s sensitivity is low if the method is forced to classify answers which answered in a long response time / general guessing. Nevertheless, when we limit the data classified within 10s response time (rapid-guessing), the method’s sensitivity rises to 68.78%.

Copyrights © 2022






Journal Info

Abbrev

jts

Publisher

Subject

Computer Science & IT

Description

IPTEK The Journal for Technology and Science (eISSN: 2088-2033; Print ISSN:0853-4098), is an academic journal on the issued related to natural science and technology. The journal initially published four issues every year, i.e. February, May, August, and November. From 2014, IPTEK the Journal for ...