Assessing Bayesian Model Comparison in Small Samples

35 Pages Posted: 23 Aug 2014

See all articles by Enrique Martínez-García

Enrique Martínez-García

Federal Reserve Bank of Dallas - Research Department

Mark A. Wynne

Federal Reserve Bank of Dallas

Multiple version iconThere are 2 versions of this paper

Date Written: August 1, 2014

Abstract

We investigate the Bayesian approach to model comparison within a two-country framework with nominal rigidities using the workhorse New Keynesian open-economy model of Martínez-García and Wynne (2010). We discuss the trade-offs that monetary policy — characterized by a Taylor-type rule — faces in an interconnected world, with perfectly flexible exchange rates. We then use posterior model probabilities to evaluate the weight of evidence in support of such a model when estimated against more parsimonious specifications that either abstract from monetary frictions or assume autarky by means of controlled experiments that employ simulated data. We argue that Bayesian model comparison with posterior odds is sensitive to sample size and the choice of observable variables for estimation. We show that posterior model probabilities strongly penalize overfitting, which can lead us to favor a less parameterized model against the true data-generating process when the two become arbitrarily close to each other. We also illustrate that the spill-overs from monetary policy across countries have an added confounding effect.

The Technical Note for this paper is available at the following URL: http://ssrn.com/abstract=2485465

Keywords: Bayesian Methods, Posterior Model Probabilities, Schwarz Criterion, New Open Economy Macro, Global Slack Hypothesis

JEL Classification: C11, C13, F41

Suggested Citation

Martinez-Garcia, Enrique and Wynne, Mark A., Assessing Bayesian Model Comparison in Small Samples (August 1, 2014). Available at SSRN: https://ssrn.com/abstract=2485463 or http://dx.doi.org/10.2139/ssrn.2485463

Enrique Martinez-Garcia (Contact Author)

Federal Reserve Bank of Dallas - Research Department ( email )

2200 North Pearl Street
PO Box 655906
Dallas, TX 75265-5906
United States
214-922-5262 (Phone)

HOME PAGE: http://sites.google.com/view/emgeconomics

Mark A. Wynne

Federal Reserve Bank of Dallas ( email )

PO Box 655906
Dallas, TX 75265-5906
United States
214-922-5159 (Phone)
214-922-5194 (Fax)

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
54
Abstract Views
468
Rank
676,215
PlumX Metrics