Specification Curve: Descriptive and Inferential Statistics on All Reasonable Specifications
29 Pages Posted: 25 Nov 2015 Last revised: 7 Nov 2019
Date Written: October 29, 2019
Abstract
Empirical results often hinge on data analytic decisions that are simultaneously defensible, arbitrary, and motivated. To mitigate this problem we introduce Specification-Curve Analysis, which consists of three steps: (i) identifying the set of theoretically justified, statistically valid, and non-redundant analytic specifications, (ii) displaying alternative results graphically, allowing the identification of decisions producing different results, and (iii) conducting statistical tests to determine whether as a whole results are inconsistent with the null hypothesis. We illustrate its use by applying it to three published findings. One proves robust, one weak, one not robust at all.
Keywords: Specification Curve; p-hacking
Suggested Citation: Suggested Citation
0 References
0 Citations
Do you have a job opening that you would like to promote on SSRN?

- Citations
- Citation Indexes: 117
- Policy Citations: 5
- Usage
- Downloads: 10544
- Abstract Views: 23163
- Captures
- Readers: 315
- Mentions
- Blog Mentions: 4
- News Mentions: 1

- Citations
- Citation Indexes: 117
- Policy Citations: 5
- Usage
- Downloads: 10544
- Abstract Views: 23163
- Captures
- Readers: 315
- Mentions
- Blog Mentions: 4
- News Mentions: 1