Beyond Incentives: Do Schools Use Accountability Rewards Productively?

61 Pages Posted: 16 Mar 2009 Last revised: 16 Nov 2022

See all articles by Marigee Bacolod

Marigee Bacolod

Naval Postgraduate School

John E. DiNardo

University of Michigan at Ann Arbor - Gerald R. Ford School of Public Policy; National Bureau of Economic Research (NBER)

Mireille Jacobson

RAND Corporation

Date Written: March 2009

Abstract

"Accountability mandates" -- the explicit linking of school funding, resources, and autonomy to student performance on standardized exams -- have proliferated in the last 10 years. In this paper, we examine California's accountability system, which for several years financially rewarded schools based on a deterministic function of test scores. The sharp discontinuity in the assignment rule -- schools that barely missed their target received no funding -- generates "as good as random" assignment of awards for schools near their eligibility threshold and enables us to estimate the (local average) treatment effect of California's financial award program.This design allows us to explore an understudied aspect of accountability systems -- how schools use their financial rewards. Our findings indicate that California's accountability system significantly increased resources allocated to some schools. In the 2000 school year, the average value of the award was about 60 dollars per student and 50 dollars in 2001. Moreover, we find that the total resources flowing to districts with schools that received awards increased more than dollar for dollar. This resource shift was greatest for districts with schools that qualified for awards in the 2000 school year,the first year of the program, increasing total per pupil revenues by roughly 5 percent.Despite the increase in revenues, we find no evidence that these resources increased student achievement. Schools that won awards did not purchase more instructional material, such as computers, which may be inputs into achievement. Although the awards were likely paid out as teacher bonuses, we cannot detect any effect of these bonuses on test scores or other measures of achievement. More worrisome, we also find a practical effect of assigning the award based in part on the performance of "numerically significant subgroups" within a school was to reduce the relative resources of schools attended by traditionally disadvantaged students.

Suggested Citation

Bacolod, Marigee and DiNardo, John and Jacobson, Mireille, Beyond Incentives: Do Schools Use Accountability Rewards Productively? (March 2009). NBER Working Paper No. w14775, Available at SSRN: https://ssrn.com/abstract=1359471

Marigee Bacolod

Naval Postgraduate School ( email )

555 Dyer Road
Monterey, CA 93943
United States

John DiNardo (Contact Author)

University of Michigan at Ann Arbor - Gerald R. Ford School of Public Policy ( email )

5238 Weill Hall
735 S. State St.
Ann Arbor, MI 48109-1220
734-647-7843 (Phone)

HOME PAGE: http://www-personal.umich.edu/~jdinardo/

National Bureau of Economic Research (NBER)

1050 Massachusetts Avenue
Cambridge, MA 02138
United States

Mireille Jacobson

RAND Corporation ( email )

1776 Main Street
P.O. Box 2138
Santa Monica, CA 90407-2138
United States