Many studies comparing the performance of students taking 12th-grade exams assume comparable study groups. In practice, selection bias affects comparisons because these studies rely on observational data. This study compares findings from analyses of matched and unmatched datasets to demonstrate the impact of selection bias. The propensity score technique matched learners who took the 2018 Grade 12 examinations in the Western Cape and Gauteng Provinces. Based on the unpaired dataset, the probability of a student graduating in the Western Cape Province is the same as in Gauteng Province. However, analysis of the paired dataset reveals that the probability of a student graduating in the Western Cape Province is 96% lower than that of their counterparts in Gauteng Province. The paired dataset suggests that Gauteng Province provides a more favorable environment or conditions for students to complete Grade 12 than the Western Cape Province. It is concluded that pre-existing differences influence the validity and reliability of the results. Differences in findings between the unpaired and paired datasets highlight the importance of adjusting for measured baseline factors before comparing the two provinces. The implication is that baseline adjustment is essential for valid educational comparisons.
Copyrights © 2026