Journal of Applied Science, Engineering, Technology, and Education
Vol. 7 No. 1 (2025)

The Validity of the Malaysian Teachers’ Global Competency Level Instrument Using Cohen Kappa, Content Validity Ratio and Content Validity Index Analyses

Ibrahim, Siti Nurul Aqiedah (Unknown)
Mohd Matore, Mohd Effendi Ewan (Unknown)



Article Info

Publish Date
30 Apr 2025

Abstract

Highly competent teachers are vital in developing globally competent individuals. There is a lack of empirical evidence supporting the validity aspect of the Malaysian Teachers' Global Competency Level Instrument. This study aims to evaluate face and content validity. A survey research design with a quantitative approach was conducted. It involves two experts for face validity and eight experts for content validity using purposive sampling techniques. For face validity, the two experts appointed were Malay language teachers with more than five years of teaching experience. To assess content validity, eight experts, including four professionals in measurement, evaluation, and global competency, and four field practitioners: teacher educators, and outstanding teachers. The instrument consists of 73 items with four constructs: self-awareness, global awareness, attitudes & values, and skills. The analysis involved Cohen’s Kappa for face validity, while content validity involved CVR and CVI. The results showed that face validity was (N=2, k=0.640), while for content validity, (N=8, CVI=0.95, and CVR=2 items refined). This instrument demonstrates strong validity as a measurement tool for the global competency level of Malaysian teachers. Further studies are recommended to be conducted: employing an advanced statistical analysis, like the Rasch Model, to enhance higher-quality items.

Copyrights © 2025






Journal Info

Abbrev

asci

Publisher

Subject

Civil Engineering, Building, Construction & Architecture Computer Science & IT Electrical & Electronics Engineering Industrial & Manufacturing Engineering Other

Description

Journal of Applied Science, Engineering, Technology, and Education (ASCI) is an international wide scope, peer-reviewed open access journal for the publication of original papers concerned with diverse aspects of science application, technology and ...