Taking PISA Seriously: How Accurate are Low Stakes Exams?
63 Pages Posted: 22 Aug 2018 Last revised: 13 Feb 2022
Date Written: August 2018
Abstract
PISA is seen as the gold standard for evaluating educational outcomes worldwide. Yet, being a low-stakes exam, students may not take it seriously resulting in downward biased scores and inaccurate rankings. This paper provides a method to identify and account for non-serious behavior in low-stakes exams by leveraging information in computer-based assessments in PISA 2015. We compare the score/rankings with no corrections to those generated using the PISA approach as well as our method which fully corrects for the bias. We show that the total bias is large and that the PISA approach corrects for only about half of it.
Suggested Citation: Suggested Citation