Scaling Up the Success for All Model of School Reform: Final Report from the Investing in Innovation (i3) Evaluation

MDRC, New York, 2015

273 Pages Posted: 1 Oct 2015

Date Written: September 23, 2015

Abstract

Success for All (SFA) combines a challenging elementary reading program, whole-school reform elements, and an emphasis on continuous improvement. In 2010, the Success for All Foundation (SFAF) received a scale-up grant under the U.S. Department of Education’s Investing in Innovation (i3) program. This third and final report from an independent evaluation of the i3 scale-up examines the program’s implementation and impacts over three years, its incremental cost, and the scale-up process itself.

Thirty-seven evaluation schools in five school districts were randomly assigned either to a program group of 19 schools that received SFA or to a control group of 18 schools that used alternative reading programs. This design supports causal impact findings for the average school assigned to SFA. Overall, the evaluation led to several key findings:

• Although SFA was implemented with adequate fidelity at the great majority of schools that adopted it, resource constraints prevented some schools from putting in place some of its key features, including a full-time facilitator and SFA’s computerized tutoring program.

• Program group and control group schools were different in some respects (for example, SFA schools were unique in placing students in cross-grade ability groups for reading, and SFA teachers made greater use of cooperative learning) but similar in others.

• SFA is an effective vehicle for teaching phonics. In the average SFA school, the program registered a notable, statistically significant impact on a measure of phonics skills for second-graders who had been in SFA for all three years, compared with their control group counterparts. Students in the average SFA school did not outperform their counterparts in the average control group school on tests of reading fluency or comprehension.

• For a subgroup of special concern to policymakers and practitioners — students entering school with low preliteracy skills — SFA appears to be especially effective. Second-graders in the average SFA school who had started kindergarten in the bottom half of the sample in terms of their knowledge of the alphabet and their ability to sound out words registered significantly higher scores on measures of phonics skills, word recognition, and reading fluency than similar students in control group schools. The impact on comprehension for this group was also positive but not statistically significant. The program did not significantly affect outcomes for the subgroup of students who started kindergarten in the top half of the sample in terms of phonetic skills.

• In a case study district, the direct expenditures for additional reading facilitator time, after-school tutoring, materials, and professional development were estimated to cost $119 more per student per year in SFA schools than in control group schools. Including the extra time that SFA principals devoted to the program and that coaches and teachers spent in training, the extra cost of space for storing SFA materials, and other factors, program group schools spent about $227 worth of resources per student per year more than control group schools.

• Through the fourth year of the i3 grant, SFA was put in place in 447 new schools and reached an estimated 276,000 students. These numbers fell below SFAF’s ambitious goals but represent a notable achievement in a period of staff layoffs and other cutbacks in many schools and districts.

Keywords: reading, school reform, elementary schools, random assignment

JEL Classification: I20

Suggested Citation

Quint, Janet and Zhu, Pei and Balu, Rekha and Rappaport, Shelley and DeLaurentis, Micah, Scaling Up the Success for All Model of School Reform: Final Report from the Investing in Innovation (i3) Evaluation (September 23, 2015). MDRC, New York, 2015, Available at SSRN: https://ssrn.com/abstract=2667101

Janet Quint (Contact Author)

MDRC ( email )

200 Vesey Street
New York, NY 10281
United States

Pei Zhu

MDRC ( email )

200 Vesey Street
New York, NY 10281
United States

Rekha Balu

MDRC ( email )

200 Vesey Street
New York, NY 10281
United States

Shelley Rappaport

MDRC ( email )

200 Vesey Street
New York, NY 10281
United States

Micah DeLaurentis

MDRC

200 Vesey Street
New York, NY 10281
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
131
Abstract Views
821
Rank
392,634
PlumX Metrics