A Simple Theory of Scientific Learning

45 Pages Posted: 8 Jan 2009

See all articles by E. Glen Weyl

E. Glen Weyl

Plural Technology Collaboratory, Microsoft Research Special Projects; Plurality Institute; GETTING-Plurality Research Network

Date Written: September 8, 2007

Abstract

Scientists use diverse evidence to learn about the relative validity of various broad theories. Given the lack of statistical structure in this scientific learning problem, techniques of model selection and meta-analysis are not directly useful as quantitative guides. I use five simplifying assumptions to make the problem tractable by standard statistical methods. Combining Bayesian and frequentist approaches, I derive simple, intuitive rules for updating beliefs. The theory incorporates trade-offs among seemingly incomparable dimensions often used to judge models: ex-ante plausibility, precision, empirical accuracy and general applicability. I establish necessary and sufficient conditions for the consistency of the learning procedure which provides easy robustness checks for applied analysis and a simple algorithm for choosing a robustly consistent, but efficient, trade-off between precision and accuracy. I develop the theory in the context of data collected by Charness and Rabin (2002). In contrast to the authors' analysis, I find (for a wide range of prior beliefs and parameter values) that after taking into account its greater precision, Selfishness is the best model of choice in the simple games they consider.

Keywords: model selection, machine learning, other-regarding preferences, Bayesian statistics

JEL Classification: B41. C11, C52

Suggested Citation

Weyl, Eric Glen, A Simple Theory of Scientific Learning (September 8, 2007). Available at SSRN: https://ssrn.com/abstract=1324410 or http://dx.doi.org/10.2139/ssrn.1324410

Eric Glen Weyl (Contact Author)

Plural Technology Collaboratory, Microsoft Research Special Projects ( email )

11 Ellsworth Ave, #2
Cambridge, MA 02139
United States
8579984513 (Phone)

HOME PAGE: http://www.glenweyl.com

Plurality Institute ( email )

GETTING-Plurality Research Network ( email )

124 Mount Auburn Street
Suite 520N
Cambridge, MA 02138
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
238
Abstract Views
1,958
Rank
233,596
PlumX Metrics