Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them

38 Pages Posted: 13 Jun 2015 Last revised: 6 Aug 2016

See all articles by Berkeley J. Dietvorst

Berkeley J. Dietvorst

The University of Chicago Booth School of Business

Joseph P. Simmons

University of Pennsylvania - The Wharton School

Cade Massey

University of Pennsylvania - The Wharton School

Date Written: April 5, 2016

Abstract

Although evidence-based algorithms consistently outperform human forecasters, people often fail to use them after learning that they are imperfect, a phenomenon known as algorithm aversion. In this paper, we present three studies investigating how to reduce algorithm aversion. In incentivized forecasting tasks, participants chose between using their own forecasts or those of an algorithm that was built by experts. Participants were considerably more likely to choose to use an imperfect algorithm when they could modify its forecasts, and they performed better as a result. Notably, the preference for modifiable algorithms held even when participants were severely restricted in the modifications they could make (Studies 1-3). In fact, our results suggest that participants’ preference for modifiable algorithms was indicative of a desire for some control over the forecasting outcome, and not for a desire for greater control over the forecasting outcome, as participants’ preference for modifiable algorithms was relatively insensitive to the magnitude of the modifications they were able to make (Study 2). Additionally, we found that giving participants the freedom to modify an imperfect algorithm made them feel more satisfied with the forecasting process, more likely to believe that the algorithm was superior, and more likely to choose to use an algorithm to make subsequent forecasts (Study 3). This research suggests that one can reduce algorithm aversion by giving people some control - even a slight amount - over an imperfect algorithm’s forecast.

Keywords: Decision making, Decision aids, Heuristics and biases, Forecasting, Confidence

Suggested Citation

Dietvorst, Berkeley and Simmons, Joseph P. and Massey, Cade, Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them (April 5, 2016). Available at SSRN: https://ssrn.com/abstract=2616787. or http://dx.doi.org/10.2139/ssrn.2616787

Berkeley Dietvorst

The University of Chicago Booth School of Business ( email )

Chicago, IL 60637
United States

Joseph P. Simmons (Contact Author)

University of Pennsylvania - The Wharton School ( email )

3733 Spruce Street
Philadelphia, PA 19104-6374
United States

Cade Massey

University of Pennsylvania - The Wharton School ( email )

3641 Locust Walk
Philadelphia, PA 19104-6365
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
3,250
Abstract Views
22,593
Rank
6,924
PlumX Metrics