Kirati Wong-akharawin
Yala Rajabhat University

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

A Digital System-Based Assessment for Collaborative Problem-Solving Skills among Pre-service Science Teachers: Preliminary Evidence of Quality and Implementation Wahyu Budi Sabtiawan; An Nuril Maulida Fauziah; Wasis Wasis; Tri Rijanto; Kirati Wong-akharawin; Ahmad Fauzi Hendratmoko
Jurnal Pendidikan IPA Indonesia Vol. 15 No. 3 (2026): September 2026
Publisher : Universitas Negeri Semarang

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.15294/jpii.v15i3.54201

Abstract

Collaborative problem-solving (CPS) is central to science teacher preparation, yet existing assessments often emphasize individual outcomes or final products and provide limited evidence of how CPS develops across iterative stages of group problem-solving. This study developed and preliminarily evaluated a digital assessment system for science teachers’ CPS across four stages: identifying and representing problems, planning and developing solutions, testing and refining solutions, and communicating evidence-based results. A multiphase, quantitative-dominant mixed-methods design involved three expert validators and 118 prospective science teachers from four intact classes. Quantitative evidence included content relevance (Aiken’s V; expanded Gregory), internal structure (CFA), expert-judgment consistency (ICC), and multiclass score patterns; expert comments, revision records, and user feedback provided qualitative evidence integrated through a joint display. Content relevance was mixed, with CFA showing three dimensions loading above 0.30 and communicating results loading at 0.286. Expert-judgment consistency was inadequate, and student-score reliability was not established. Class scores differed significantly; however, intact-class observations preclude causal inference. Thus, the system provides preliminary stage-specific CPS score patterns rather than dependable individual-level profiles. Its contribution is integrating stage-specific assessment across an authentic design–test–redesign–retest cycle using analytic-rubric scoring with measurement and implementation evidence. Further refinement should prioritize communication descriptors, validator calibration, and student-score reliability.