Predicting the Efficacy of Future Training Programs Using Past Experiences

53 Pages Posted: 29 Feb 2000 Last revised: 26 Feb 2023

See all articles by V. Joseph Hotz

V. Joseph Hotz

Duke University; National Bureau of Economic Research (NBER); IZA Institute of Labor Economics

Guido W. Imbens

Stanford Graduate School of Business

Julie H. Mortimer

Boston College; National Bureau of Economic Research (NBER)

Date Written: May 1999

Abstract

We investigate the problem of predicting the average effect of a new training program using experiences with previous implementations. There are two principal complications in doing so. First, the population in which the new program will be implemented may differ from the population in which the old program was implemented. Second, the two programs may differ in the mix of their components. With sufficient detail on characteristics of the two populations and sufficient overlap in their distributions, one may be able to adjust for differences due to the first complication. Dealing with the second difficulty requires data on the exact treatments the individuals received. However even in the presence of differences in the mix of components across training programs comparisons of controls in both populations who were excluded from participating in any of the programs should not be affected. To investigate the empirical importance of these issues, we compare four job training pro-grams implemented in the mid-eighties in different parts of the U.S. We find that adjusting for pre-training earnings and individual characteristics removes most of the differences between control units, but that even after such adjustments, post-training earnings for trainees are not comparable. We surmise that differences in treatment components across training programs are the likely cause, and that more details on the specific services provided by these programs are necessary to predict the effect of future programs. We also conclude that effect heterogeneity, it is essential, even in experimental evaluations of training programs record pre-training earnings and individual characteristics in order to render the extrapolation of the results to different locations more credible.

Suggested Citation

Hotz, V. Joseph and Imbens, Guido W. and Mortimer, Julie H., Predicting the Efficacy of Future Training Programs Using Past Experiences (May 1999). NBER Working Paper No. t0238, Available at SSRN: https://ssrn.com/abstract=205408

V. Joseph Hotz (Contact Author)

Duke University ( email )

213 Social Sciences Building
Box 90097
Durham, NC 27708
United States
919-660-1841 (Phone)
919-684-8974 (Fax)

HOME PAGE: http://www.econ.duke.edu/~vjh3

National Bureau of Economic Research (NBER)

1050 Massachusetts Avenue
Cambridge, MA 02138
United States

IZA Institute of Labor Economics ( email )

P.O. Box 7240
Bonn, D-53072
Germany

Guido W. Imbens

Stanford Graduate School of Business ( email )

655 Knight Way
Stanford, CA 94305-5015
United States

Julie H. Mortimer

Boston College ( email )

140 Commonwealth Avenue
Chestnut Hill, MA 02467
United States
617-552-3676 (Phone)

HOME PAGE: http://fmwww.bc.edu/ec/mortimer.php

National Bureau of Economic Research (NBER) ( email )

1050 Massachusetts Avenue
Cambridge, MA 02138
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
48
Abstract Views
1,182
PlumX Metrics