Student Sorting and Bias in Value Added Estimation: Selection on Observables and Unobservables
45 Pages Posted: 25 Jan 2009 Last revised: 30 Jul 2022
Date Written: January 2009
Abstract
Non-random assignment of students to teachers can bias value added estimates of teachers' causal effects. Rothstein (2008a, b) shows that typical value added models indicate large counter-factual effects of 5th grade teachers on students' 4th grade learning, indicating that classroom assignments are far from random. This paper quantifies the resulting biases in estimates of 5th grade teachers' causal effects from several value added models, under varying assumptions about the assignment process. If assignments are assumed to depend only on observables, the most commonly used specifications are subject to important bias but other feasible specifications are nearly free of bias. I also consider the case where assignments depend on unobserved variables. I use the across-classroom variance of observables to calibrate several models of the sorting process. Results indicate that even the best feasible value added models may be substantially biased, with the magnitude of the bias depending on the amount of information available for use in classroom assignments.
Suggested Citation: Suggested Citation
Do you have negative results from your research you’d like to share?
Recommended Papers
-
Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating
By Brian Jacob and Steven D. Levitt
-
By Paul Glewwe, Nauman Ilias, ...
-
By Brian Jacob
-
Winning Isn't Everything: Corruption in Sumo Wrestling
By Mark Duggan and Steven D. Levitt
-
The Market for Teacher Quality
By Eric A. Hanushek, John F. Kain, ...
-
Food for Thought: The Effects of School Accountability Plans on School Nutrition
By David N. Figlio and Joshua Winicki
-
The Central Role of Noise in Evaluating Interventions that Use Test Scores to Rank Schools
By Kenneth Y. Chay, Patrick J. Mcewan, ...
-
Does School Accountability Lead to Improved Student Performance?