The Foundations of Statistics with Black Swans

9 Pages Posted: 5 Feb 2010

Date Written: February 21, 2009

Abstract

We extend the foundation of statistics to integrate rare events that are potentially catastrophic, called black swans.These include natural hazards, regime change in complex systems, market crashes, catastrophic climate change and major episodes of species extinction. Classic statistics and physics treat such events as ‘outliers’ and often disregard them. We propose a new axiomatization of subjective probability requiring equal treatment for rare and frequent events, and characterize the likelihoods or subjective probabilities that the axioms imply.These coincide with countably additive measures and yield normal distributions when the sample has no black swans. When the sample includes black swans, the new likelihoods are represented by a combination of countable and finitely additive measures with both parts present. The axioms were introduced in Chichilnisky (2000, 2002); they extend the axiomatic foundations of Savage (1954), Villegas(1964) and Arrow (1971) and they are valid for bounded and unbounded samples (Chichilnisky, 1996b). The finitely additive measures assign more weight to rare events than do standard distributions and in that sense explain the persistent observation of power laws and ‘heavy tails’ that eludes classic theory.

Suggested Citation

Chichilnisky, Graciela, The Foundations of Statistics with Black Swans (February 21, 2009). Mathematical Social Sciences, 2009, Available at SSRN: https://ssrn.com/abstract=1522276 or http://dx.doi.org/10.2139/ssrn.1522276

Graciela Chichilnisky (Contact Author)

Columbia University ( email )

3022 Broadway
New York, NY 10027
United States
212 678 1148 (Phone)
212 678 0405 (Fax)

HOME PAGE: http://www.chilchilnisky.com