Energy: Jurnal Ilmiah Ilmu-ilmu Teknik
Vol. 16 No. 2 (2026): ENERGY: JURNAL ILMIAH ILMU-ILMU TEKNIK (July-November 2026 Edition)

Understanding Cognitive Processes Behind "I Don't Know" Responses in Sustainability Literacy Assessment Using Eye-Tracking and Usability Evaluation

Zidni Ilma Banaina (Department of Industrial and Systems Engineering, Sepuluh Nopember Institute of Technology, ITS Keputih Campus, Surabaya 60111, Indonesia.)
Maria Anityasari (Department of Industrial and Systems Engineering, Sepuluh Nopember Institute of Technology, ITS Keputih Campus, Surabaya 60111, Indonesia.)
Ratna Sari Dewi (Department of Industrial and Systems Engineering, Sepuluh Nopember Institute of Technology, ITS Keputih Campus, Surabaya 60111, Indonesia.)



Article Info

Publish Date
08 Aug 2026

Abstract

Assessing sustainability literacy is essential for ensuring that sustainability literacy tests accurately measure individuals' understanding of sustainability concepts. However, conventional evaluation methods primarily rely on test scores and response accuracy, providing limited insight into the cognitive processes underlying participants' decision-making. This study investigates the use of eye-tracking technology to analyze participants' visual attention while completing a Sustainability Literacy Test (SLT). Eye movement data, including scanpaths, were analyzed to identify user interactions with test items and determine which visual elements attracted the greatest attention, particularly when participants selected the "I Don't Know" response option. In addition, system usability was evaluated using the Hybrid System Usability Scale (H-SUS). The results indicate that participants required an average response time of more than 60 seconds for items associated with the "I Don't Know" option, suggesting increased visual attention and cognitive load in specific areas of the interface. The website achieved an average H-SUS score of 63.34, indicating an acceptable level of usability, corresponding to Grade C and an "OK" adjective rating. These findings demonstrate that eye-tracking data can reveal hidden patterns of cognitive effort and user uncertainty that cannot be captured through response accuracy alone. The proposed approach provides valuable insights for improving test design, enhancing question readability, and optimizing the user interface of web-based Sustainability Literacy Tests, thereby supporting more effective assessment of sustainability literacy.

Copyrights © 2026






Journal Info

Abbrev

energy

Publisher

Subject

Automotive Engineering Chemical Engineering, Chemistry & Bioengineering Civil Engineering, Building, Construction & Architecture Computer Science & IT Control & Systems Engineering Earth & Planetary Sciences Electrical & Electronics Engineering Energy Engineering Industrial & Manufacturing Engineering Materials Science & Nanotechnology Mechanical Engineering

Description

Energy Journal serves as a platform for information and communication of various research findings and scientific writings in the field of engineering, contributed by practitioners, researchers, and academics who are involved in and have a keen interest in the development of science and technology. ...