The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con Out of Econometrics

40 Pages Posted: 15 Mar 2010

See all articles by Joshua D. Angrist

Joshua D. Angrist

Massachusetts Institute of Technology (MIT) - Department of Economics; National Bureau of Economic Research (NBER); IZA Institute of Labor Economics

Jörn-Steffen Pischke

London School of Economics; National Bureau of Economic Research (NBER); Centre for Economic Policy Research (CEPR); IZA Institute of Labor Economics

Multiple version iconThere are 3 versions of this paper

Abstract

This essay reviews progress in empirical economics since Leamer's (1983) critique. Leamer highlighted the benefits of sensitivity analysis, a procedure in which researchers show how their results change with changes in specification or functional form. Sensitivity analysis has had a salutary but not a revolutionary effect on econometric practice. As we see it, the credibility revolution in empirical work can be traced to the rise of a design-based approach that emphasizes the identification of causal effects. Design-based studies typically feature either real or natural experiments and are distinguished by their prima facie credibility and by the attention investigators devote to making the case for a causal interpretation of the findings their designs generate. Design-based studies are most often found in the microeconomic fields of Development, Education, Environment, Labor, Health, and Public Finance, but are still rare in Industrial Organization and Macroeconomics. We explain why IO and Macro would do well to embrace a design-based approach. Finally, we respond to the charge that the design-based revolution has overreached.

Keywords: structural models, research design, natural experiments, quasi-experiments

JEL Classification: C01

Suggested Citation

Angrist, Joshua and Pischke, Jörn-Steffen (Steve), The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con Out of Econometrics. IZA Discussion Paper No. 4800, Available at SSRN: https://ssrn.com/abstract=1570398 or http://dx.doi.org/10.2139/ssrn.1570398

Joshua Angrist (Contact Author)

Massachusetts Institute of Technology (MIT) - Department of Economics ( email )

50 Memorial Drive
E52-353
Cambridge, MA 02142
United States
617-253-8909 (Phone)
617-253-1330 (Fax)

National Bureau of Economic Research (NBER)

1050 Massachusetts Avenue
Cambridge, MA 02138
United States

IZA Institute of Labor Economics

P.O. Box 7240
Bonn, D-53072
Germany

Jörn-Steffen (Steve) Pischke

London School of Economics ( email )

Houghton Street
London WC2A 2AE
+44 207 955 6509 (Phone)
+44 207 955 7595 (Fax)

National Bureau of Economic Research (NBER)

1050 Massachusetts Avenue
Cambridge, MA 02138
United States

Centre for Economic Policy Research (CEPR)

London
United Kingdom

IZA Institute of Labor Economics

P.O. Box 7240
Bonn, D-53072
Germany

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
118
Abstract Views
1,568
Rank
125,394
PlumX Metrics