No System is Perfect: Understanding How Registration-Based Editorial Processes Affect Reproducibility and Investment in Research Quality--Free Responses to Survey on Author Discretion

153 Pages Posted: 13 Feb 2018

See all articles by Robert J. Bloomfield

Robert J. Bloomfield

Cornell University - Samuel Curtis Johnson Graduate School of Management

Kristina M. Rennekamp

SC Johnson Graduate School of Management; Cornell SC Johnson College of Business

Blake A. Steenhoven

Queen's University - Smith School of Business

Date Written: February 7, 2018

Abstract

This document includes the complete set of free-text responses to our survey on the 2017 Journal of Accounting Research Conference, Registered Reports of Empirical Research. We solicited responses from all authors who have published in six well-regarded accounting journals over the last decade. Respondents provide thoughts on how research quality is affected by authors’ discretion to choose: which measures and analyses to report; whether or not to report a sample or subsample; which observations to exclude from primary analyses; whether to gather additional data after observing results; to change their predictions and/or underlying theory; and to choose not to report or highlight hypotheses. Respondents also provide first-hand accounts of discretionary choices and failed replications, advice to editors and reviewers, and their thoughts on other forms of discretion, motivations for using discretion, and any insights they wish to share not covered by their previous answers.

Keywords: Registered Reports, Reproducibility, Editorial Processes, Research Discretion, Peer Review

JEL Classification: C18, I23, M40

Suggested Citation

Bloomfield, Robert J. and Rennekamp, Kristina M. and Steenhoven, Blake, No System is Perfect: Understanding How Registration-Based Editorial Processes Affect Reproducibility and Investment in Research Quality--Free Responses to Survey on Author Discretion (February 7, 2018). Available at SSRN: https://ssrn.com/abstract=3119833 or http://dx.doi.org/10.2139/ssrn.3119833

Robert J. Bloomfield (Contact Author)

Cornell University - Samuel Curtis Johnson Graduate School of Management ( email )

450 Sage Hall
Ithaca, NY 14853
United States
607-255-9407 (Phone)
607-254-4590 (Fax)

Kristina M. Rennekamp

SC Johnson Graduate School of Management ( email )

Ithaca, NY 14853
United States
607-255-0500 (Phone)

Cornell SC Johnson College of Business ( email )

Ithaca, NY 14850
United States

Blake Steenhoven

Queen's University - Smith School of Business ( email )

Smith School of Business - Queen's University
143 Union Street
Kingston, Ontario K7L 3N6
Canada

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
316
Abstract Views
2,202
Rank
175,064
PlumX Metrics