Forecast Evaluation of Small Nested Model Sets
46 Pages Posted: 19 Mar 2009
There are 2 versions of this paper
Forecast Evaluation of Small Nested Model Sets
Forecast Evaluation of Small Nested Model Sets
Date Written: March 18, 2009
Abstract
We propose two new procedures for comparing the mean squared prediction error (MSPE) of a benchmark model to the MSPEs of a small set of alternative models that nest the benchmark. Our procedures compare the benchmark to all the alternative models simultaneously rather than sequentially, and do not require reestimation of models as part of a bootstrap procedure. Both procedures adjust MSPE differences in accordance with Clark and West (2007); one procedure then examines the maximum t-statistic, the other computes a chi-squared statistic. Our simulations examine the proposed procedures and two existing procedures that do not adjust the MSPE differences: a chi-squared statistic, and White's (2000) reality check. In these simulations, the two statistics that adjust MSPE differences have most accurate size, and the procedure that looks at the maximum t-statistic has best power. We illustrate, our procedures by comparing forecasts of different models for U.S. inflation.
Keywords: Out-of-sample, prediction, testing, multiple model comparisons, inflation forecasting
JEL Classification: C32, C53, E37
Suggested Citation: Suggested Citation
Do you have negative results from your research you’d like to share?
Recommended Papers
-
Tests of Equal Forecast Accuracy and Encompassing for Nested Models
-
Long Swings in the Exchange Rate: are They in the Data and Do Markets Know it?
-
Exchange Rates and Fundamentals
By Charles M. Engel and Kenneth D. West
-
Exchange Rates and Fundamentals
By Charles M. Engel and Kenneth D. West
-
Empirical Exchange Rate Models of the Nineties: Are Any Fit to Survive?
-
Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?
By Lutz Kilian
-
Empirical Exchange Rate Models of the Nineties: Are Any Fit to Survive?
By Yin-wong Cheung, Menzie David Chinn, ...