Understanding Validity in Empirical Legal Research: The Case for Methodological Pluralism in Assessing the Impact of Science in Court

Hastings Law Journal, Vol. 67, 2016

20 Pages Posted: 12 May 2016

See all articles by Teneille R. Brown

Teneille R. Brown

University of Utah - S.J. Quinney College of Law

Jim Tabery

University of Utah - Department of Philosophy

Lisa Aspinwall

University of Utah

Date Written: May 11, 2016

Abstract

What makes a study valid or invalid? In 2013, the Hastings Law Journal published a law review article by law professor Deborah Denno entitled What Real-World Cases Tell Us About Genetic Evidence. This article questioned the validity of an article that we published in Science: The Double Edged-Sword: Does Biomechanism Increase or Decrease Judges’ Sentencing of Psychopaths? Denno’s trenchant critique focused on our use of experimental, rather than archival, methodology, and revealed a misunderstanding of the diverse goals of empirical legal research. One study, which in our case investigated the impact of biological explanations of criminal behavior on sentencing, is not meant to answer the universe of potentially relevant questions. This is as true in science as it is in law. Rather, experimental and archival projects complement each other by asking and answering different questions aimed at different forms of validity. We describe archival and experimental research methods, and then explain how their design impacts external validity, including concerns of ecological validity, robustness, and generalizability; internal validity; and construct validity. We appreciate Denno’s questions about external validity in particular, specifically asking how and under what conditions a particular set of experimental effects might occur in real court cases. However, the questions she poses do not challenge the internal validity of our study — that is, its ability to identify particular causal factors that influence judges’ ratings and sentencing decisions in the particular set of conditions and case features we tested. By explaining the tradeoffs between different forms of validity, this brief article may serve as a helpful tool for scholars in law, psychology, and other social sciences, as well as attorneys and judges who rely on empirical legal research in their work.

Keywords: Empirical Legal Research, Biosciences, Courtroom, Double-Edged Sword, Denno, Methodology, Law and Psychology, Law and Philosophy, External Validity, Internal Validity

Suggested Citation

Brown, Teneille R. and Tabery, Jim and Aspinwall, Lisa, Understanding Validity in Empirical Legal Research: The Case for Methodological Pluralism in Assessing the Impact of Science in Court (May 11, 2016). Hastings Law Journal, Vol. 67, 2016, Available at SSRN: https://ssrn.com/abstract=2778821

Teneille R. Brown (Contact Author)

University of Utah - S.J. Quinney College of Law ( email )

383 S. University Street
Salt Lake City, UT 84112-0730
United States

Jim Tabery

University of Utah - Department of Philosophy ( email )

215 South Central Campus Dr.
Carolyn Tanner Irish Humanities Building
Salt Lake City, UT 84112
United States

Lisa Aspinwall

University of Utah ( email )

1645 E. Campus Center
Salt Lake City, UT 84112
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
119
Abstract Views
1,095
Rank
422,206
PlumX Metrics