The SEC's Busted Randomized Experiment: What Can and Cannot Be Learned

58 Pages Posted: 8 Aug 2016 Last revised: 9 Feb 2024

Date Written: August 8, 2016

Abstract

During 2005-2007, the US Securities and Exchange Commission ran a randomized experiment, in which it removed short sale restrictions for some “treated” firms, chosen at random, and left these restrictions in place for others. The SEC experiment has been exploited by many finance and accounting scholars, who report evidence that removing short sale restrictions affected a wide range of financial outcomes, including share prices, firm investment strategy, accounting accruals, auditor behavior, innovation, and much more. We show that the SEC busted its own randomization experiment, in a way which undermines most prior studies. The SEC in fact conducted three distinct randomized experiments; these can be examined separately but cannot be combined without further, likely unjustified assumptions. We discuss what one can and cannot learn from these three experiments.

We also develop reasons and supporting evidence for why relaxing short-sale restrictions was unlikely to affect most of the outcomes studied in recent work. We explain the need, when studying the indirect effects of the SEC experiment, to account for nonrandom choices by short sellers on which firms to “target”, and the nonrandom responses of firm managers and other market participants to removal of short sale restrictions. We then revisit selected results from prior studies (effect of the experiment on open short interest and share prices), and find no evidence that the relaxing short-sale restrictions affected either measure.

Suggested Citation

Litvak, Kate and Black, Bernard S. and Yoo, Woongsun, The SEC's Busted Randomized Experiment: What Can and Cannot Be Learned (August 8, 2016). Northwestern Law & Econ Research Paper, Forthcoming, Available at SSRN: https://ssrn.com/abstract=2820031 or http://dx.doi.org/10.2139/ssrn.2820031

Kate Litvak

Northwestern University - Pritzker School of Law ( email )

375 E. Chicago Ave
Chicago, IL 60611
United States

Bernard S. Black (Contact Author)

Northwestern University - Pritzker School of Law ( email )

375 E. Chicago Ave
Chicago, IL 60611
United States
312-503-2784 (Phone)

Woongsun Yoo

Central Michigan University ( email )

Mount Pleasant, MI 48859
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
279
Abstract Views
2,295
Rank
199,434
PlumX Metrics