Artificial Intelligence (AI) literacy has become an essential competency for students in responding to rapid digital transformation across various fields. However, the limited availability of valid and reliable assessment instruments constrains the comprehensive evaluation of students’ AI literacy levels. This study aims to analyze, develop, and validate an AI literacy assessment instrument based on experiential learning elements and a deep learning approach. The study employed a Research and Development (R&D) design consisting of needs analysis, instrument design, development, validation testing, and data analysis stages. The research involved 500 students selected through multistage sampling techniques. Data were collected using an AI literacy questionnaire designed to measure three main components: knowledge, affective attitudes, and critical thinking skills, which are integrated with global competencies required in the 21st century. Construct validity was examined using factor analysis, while reliability was assessed through internal consistency analysis. The findings indicate that the developed instrument demonstrates strong validity and reliability and effectively represents the multidimensional structure of AI literacy. These results suggest that the instrument can function as a reliable assessment tool for evaluating students’ readiness to understand, utilize, and critically reflect on AI technologies in an ethical and responsible manner. The study provides important implications for higher education institutions in integrating AI literacy assessment into teaching practices and curriculum development.
Copyrights © 2025