JETL (Journal Of Education, Teaching and Learning)
Vol 9, No 1 (2024): Special Issue

Analyzing the Reliability of Thesis Assessment Instruments: Generalizability Theory

Handayani, Reli (Unknown)
Ernanda, Ernanda (Unknown)
Rahariyoso, Dwi (Unknown)
Falani, Ilham (Unknown)
Oktadinata, Alek (Unknown)
Daya, Wawan Junresti (Unknown)
Ockta, Yovhandra (Unknown)



Article Info

Publish Date
27 Aug 2024

Abstract

This study aims to analyze the reliability of the thesis assessment instrument using Generalizability Theory (G-Theory).  This research is a quantitative study that applies G-Theory. G-Theory is unique and useful in evaluating the sources of actual variance and error in any measurement design. Thus, G-Theory contributes to improving reliability and validity in assessment. In this study, data were collected using a thesis assessment instrument that had been tested on thesis assessments conducted at the Faculty of Teacher Training and Education, Universitas Jambi.  G-Theory analysis in this study includes several main points, namely G-Study, Optimization (D-Study), and G-facets analysis. The results of the analysis show that the assessment instrument has a fairly high level of reliability with a G coefficient of 0.78. This indicates that the instrument can be used effectively in the thesis assessment. In addition, based on the results of the analysis carried out, recommendations were obtained to reassess item number two, increase the number of raters to six people to increase the reliability of the instrument to 0.80 to meet the satisfactory category. The resulting recommendations can be used by developers to improve the reliability of instruments in future assessment activities. This research is also expected to be a reference for future researchers in applying G-Theory in analyzing the reliability of measurement instruments.

Copyrights © 2024






Journal Info

Abbrev

JETL

Publisher

Subject

Aerospace Engineering Education Social Sciences

Description

Journal of Education, Teaching and Learning is a peer-reviewed scientific open access, with e-ISSN : 2477-8478 and p-ISSN 2477-5924 published by Institute for Managing and Publishing Scientific Journals at STKIP Singkawang, Indonesia in 2015. In Last 2016 Journal of Education, Teaching and Learning ...