1932
0
  1. Home
  2. A-Z Publications
  3. Annual Review of Economics
  4. Volume 7, 2015
  5. Article

Annual Review of Economics

Volume 7, 2015

Forecasting in Nonstationary Environments: What Works and What Doesn’t in Reduced-Form and Structural Models

Abstract

This review provides an overview of forecasting methods that can help researchers forecast in the presence of nonstationarities caused by instabilities. The emphasis of the review is both theoretical and applied, and we provide several examples of interest to economists. We show that modeling instabilities can help, but it depends on how they are modeled. We also demonstrate how to robustify a model against instabilities.

Keyword(s): instabilities, structural breaks
Loading

Article metrics loading...

/content/journals/10.1146/annurev-economics-080614-115338
2015-08-02
2024-04-26
Loading full text...

Full text loading...

/deliver/fulltext/economics/7/1/annurev-economics-080614-115338.html?itemId=/content/journals/10.1146/annurev-economics-080614-115338&mimeType=html&fmt=ahah

Literature Cited

  1. Adolfson M, Linde J, Villani M. 2007. Forecasting performance of an open economy dynamic stochastic general equilibrium model. Econom. Rev. 26:289–328 [Google Scholar]
  2. Altavilla C, Giacomini R, Ragusa G. 2013. Anchoring the yield curve using survey expectations. CeMMAP Work. Pap. 52/13, Inst. Fisc. Stud., London
  3. Amisano G, Giacomini R. 2007. Comparing density forecasts via weighted likelihood ratio tests. J. Bus. Econ. Stat. 25:177–90 [Google Scholar]
  4. Andrade P, Ghysels E, Idier J. 2012. Tails of inflation forecasts and tales of monetary policy. Work. Pap. 407, Banque France, Paris
  5. Andrews DWK. 1993. Tests for parameter instability and structural change with unknown exhange point. Econometrica 61:821–56 [Google Scholar]
  6. Andrews DWK, Ploberger W. 1994. Optimal tests when a nuisance parameter is present only under the alternative. Econometrica 62:1383–414 [Google Scholar]
  7. Bai J, Ng S. 2002. Determining the number of factors in approximate factor models. Econometrica 70:191–221 [Google Scholar]
  8. Bai J, Perron P. 1998. Estimating and testing linear models with multiple structural changes. Econometrica 66:47–78 [Google Scholar]
  9. Banbura M, Giannone D, Reichlin L. 2010. Large Bayesian vector auto regressions. J. Appl. Econ. 25:71–92 [Google Scholar]
  10. Banerjee A, Marcellino M, Masten I. 2008. Forecasting macroeconomic variables using diffusion indexes in short samples with structural change. Forecasting in the Presence of Structural Breaks and Model Uncertainty Rapach DE, Wohar ME. 149–94 Bingley, UK: Emerald [Google Scholar]
  11. Bates B, Plagborg-Moller M, Stock J, Watson MW. 2013. Consistent factor estimation in dynamic factor models with structural instability. J. Econom. 177:289–304 [Google Scholar]
  12. Berkowitz J. 2001. Testing density forecasts, with applications to risk management. J. Bus. Econ. Stat. 19:465–74 [Google Scholar]
  13. Bianchi F. 2013. Regime switches, agents’ beliefs, and post–World War II U.S. macroeconomic dynamics. Rev. Econ. Stud. 80:463–90 [Google Scholar]
  14. Billio M, Casarin R, Ravazzolo F, Van Dijk H. 2013. Time-varying combinations of predictive densities using nonlinear filtering. J. Econom. 177:153–70 [Google Scholar]
  15. Board Gov. Fed. Reserve Syst 2011. FOMC statement Press Release. http://www.federalreserve.gov/newsevents/press/monetary/20110809a.htm
  16. Breitung J, Eickmeier S. 2011. Testing for structural breaks in dynamic factor models. J. Econom. 163:71–84 [Google Scholar]
  17. Brown R, Durbin J, Evans J. 1975. Techniques for testing the constancy of regression relationships over time. J. R. Stat. Soc. B 37:149–63 [Google Scholar]
  18. Canova F. 2006. Monetary policy and the evolution of the U.S. economy. Work. Pap. 5467, Cent. Econ. Policy Res., London
  19. Canova F, Ferroni F. 2011. Multiple filtering devices for the estimation of cyclical DSGE models. J. Quant. Econ. 2:73–98 [Google Scholar]
  20. Carriero A, Clark TE, Marcellino M. 2015. Bayesian VARs: specification choices and forecast accuracy. J. Appl. Econom. 30:46–73 [Google Scholar]
  21. Chauvet M, Potter S. 2013. Forecasting output. See Elliott & Timmermann 2013, pp. 141–91
  22. Chun A. 2008. Forecasting interest rates and inflation: Blue Chip clairvoyants or econometrics? Unpublished manuscript, Rensselaer Polytech. Inst., Troy, NY
  23. Clarida R, Galí J, Gertler M. 2000. Monetary policy rules and macroeconomic stability: evidence and some theory. Q. J. Econ. 115:147–80 [Google Scholar]
  24. Clark TE. 2011. Real-time density forecasts from Bayesian vector autoregressions with stochastic volatility. J. Bus. Econ. Stat. 29:327–41 [Google Scholar]
  25. Cogley T, Sargent TJ. 2005. Drifts and volatilities: monetary policies and outcomes in the post WWII U.S. Rev. Econ. Dyn. 8:262–302 [Google Scholar]
  26. Cogley T, Sbordone A. 2006. Trend inflation and inflation persistence in the new Keynesian Phillips curve Staff Rep. 270, Fed. Reserve Bank New York
  27. Coibion O, Gorodnichenko Y. 2012. What can survey forecasts tell us about informational rigidities?. J. Polit. Econ. 120:116–59 [Google Scholar]
  28. Corradi V, Swanson NR. 2006. Predictive density evaluation. See Elliott et al. 2006, pp. 197–284 [Google Scholar]
  29. D’Agostino A, Gambetti L, Giannone D. 2013. Macroeconomic forecasting and structural change. J. Appl. Econ. 28:182–101 [Google Scholar]
  30. Davig T, Leeper EM. 2007. Generalizing the Taylor principle. Am. Econ. Rev. 97:607–35 [Google Scholar]
  31. De Mol C, Giannone D, Reichlin L. 2008. Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?. J. Econom. 146:318–28 [Google Scholar]
  32. Del Negro M, Giannoni M, Schorfheide F. 2013. Inflation in the Great Recession and New Keynesian models. Staff Rep. 618, Fed. Reserve Bank New York
  33. Del Negro M, Schorfheide F. 2012. DSGE model-based forecasting Staff Rep. 554, Fed. Reserve Bank New York
  34. Diebold FX, Gunther TA, Tay AS. 1998. Evaluating density forecasts with applications to financial risk management. Int. Econ. Rev. 39:863–83 [Google Scholar]
  35. Diebold FX, Li C. 2006. Forecasting the term structure of government bond yields. J. Econom. 130:337–64 [Google Scholar]
  36. Diebold FX, Tay AS, Wallis KF. 1999. Evaluating density forecasts of inflation: the Survey of Professional Forecasters. Cointegration, Causality, and Forecasting: A Festschrift in Honour of Clive W.J. Granger Engle RF, White H. 76–90 New York: Oxford Univ. Press [Google Scholar]
  37. Diks C, Panchenko V, Van Dijk D. 2011. Likelihood-based scoring rules for comparing density forecasts in tails. J. Econom. 163:215–30 [Google Scholar]
  38. Edge RM, Gürkaynak RS. 2010. How useful are estimated DSGE model forecasts for central bankers?. Brookings Pap. Econ. Act. 41:209–59 [Google Scholar]
  39. Eickmeier S, Lemke W, Marcellino M. 2011. Classical time-varying FAVAR models: estimation, forecasting and structural analysis. Discuss. Pap. 04-2011, Deutsche Bundesbank, Frankfurt
  40. Elliott G, Granger CWJ, Timmermann A. 2006. Handbook of Economic Forecasting Vol. 1 Amsterdam: North-Holland
  41. Elliott G, Müller U. 2006. Efficient tests for general persistent time variation in regression coefficients. Rev. Econ. Stud. 73:907–40 [Google Scholar]
  42. Elliott G, Timmermann A. 2013. Handbook of Economic Forecasting Vol. 2 Amsterdam: North-Holland
  43. Farmer R, Waggoner D, Zha T. 2009. Indeterminacy in a forward-looking regime switching model. Int. J. Econ. Theory 5:69–84 [Google Scholar]
  44. Faust J, Wright JH. 2013. Forecasting inflation. See Elliott & Timmermann 2013, pp. 2–56 [Google Scholar]
  45. Fernández-Villaverde J, Rubio-Ramírez JF. 2008. How structural are structural parameters?. NBER Macroeconomics Annual 2007 Acemoglu D, Rogoff K, Woodford M. 83–137 Chicago: Univ. Chicago Press [Google Scholar]
  46. Foerster A, Rubio-Ramírez JF, Waggoner D, Zha T. 2013. Perturbation methods for Markov-switching DSGE model. Res. Work. Pap. 13-01, Fed. Reserve Bank Kansas City
  47. Forni M, Hallin M, Lippi M, Reichlin L. 2000. The generalized dynamic-factor model: identification and estimation. Rev. Econ. Stat. 82:540–54 [Google Scholar]
  48. Giacomini R. 2014. Economic theory and forecasting: lessons from the literature. Unpublished manuscript, Univ. Coll. London
  49. Giacomini R, Ragusa G. 2014. Theory-coherent forecasting. J. Econom. 182:145–55 [Google Scholar]
  50. Giacomini R, Rossi B. 2006. How stable is the forecasting performance of the yield curve for output growth?. Oxf. Bull. Econ. Stat. 68:Suppl. 1783–95 [Google Scholar]
  51. Giacomini R, Rossi B. 2009. Detecting and predicting forecast breakdown. Rev. Econ. Stud. 76:669–705 [Google Scholar]
  52. Giacomini R, Rossi B. 2010. Forecast comparisons in unstable environments. J. Appl. Econ. 25:595–620 [Google Scholar]
  53. Giacomini R, Rossi B. 2014. Model comparisons in unstable environments. Work. Pap. 784, Barcelona Grad. Sch. Econ.
  54. Giacomini R, White H. 2006. Tests of conditional predictive ability. Econometrica 74:1545–78 [Google Scholar]
  55. Giannone D, Lenza M, Primiceri G. 2015. Prior selection for vector autoregressions. Rev. Econ. Stat. In press [Google Scholar]
  56. Giraitis L, Kapetanios G, Price S. 2013. Adaptive forecasting in the presence of recent and ongoing structural change. J. Econom. 177:153–70 [Google Scholar]
  57. Groen JJJ, Paap R, Ravazzolo F. 2013. Real-time inflation forecasting in a changing world. J. Bus. Econ. Stat. 31:29–44 [Google Scholar]
  58. Gürkaynak R, Kisacikoğlu B, Rossi B. 2013. Do DSGE models forecast more accurately out-of-sample than reduced-form models?. VAR Models in Macroeconomics, Financial Econometrics, and Forecasting: New Developments and Applications; Essays in Honor of Christopher A. Sims Fomby T, Kilian L, Murphy A. 27–80 Bingley, UK: Emerald [Google Scholar]
  59. Hurwicz L. 1962. On the structural form of interdependent systems. Methodology and Philosophy of Science: Proceedings of the 1960 International Congress Nagel L, Suppes P, Tarski A. 232–39 Stanford, CA: Stanford Univ. Press [Google Scholar]
  60. Ilut C, Schneider M. 2014. Ambiguous business cycles. Am. Econ. Rev. 104:2368–99 [Google Scholar]
  61. Inoue A. 2001. Testing for distributional change in time series. Econom. Theory 17:156–87 [Google Scholar]
  62. Inoue A, Kuo CH, Rossi B. 2014. Identifying the sources of model misspecification. Work. Pap. 10140, Cent. Econ. Policy Res., London
  63. Inoue A, Rossi B. 2011. Identifying the sources of instabilities in macroeconomic fluctuations. Rev. Econ. Stat. 93:1186–204 [Google Scholar]
  64. Inoue A, Rossi B. 2012. Out-of-sample forecast tests robust to the choice of window size. J. Bus. Econ. Stat. 30:432–53 [Google Scholar]
  65. Jore AS, Mitchell J, Vahey SP. 2010. Combining forecast densities from VARs with uncertain instabilities. J. Appl. Econ. 25:621–34 [Google Scholar]
  66. Justiniano A, Primiceri G. 2008. The time-varying volatility of macroeconomic fluctuations. Am. Econ. Rev. 98:604–41 [Google Scholar]
  67. Kim CJ, Nelson CR. 1999. Has the U.S. economy become more stable? A Bayesian approach based on a Markov-switching model of the business cycle. Rev. Econ. Stat. 81:608–16 [Google Scholar]
  68. Koop G. 2013. Forecasting with medium and large Bayesian VARs. J. Appl. Econ. 28:177–203 [Google Scholar]
  69. Koop G, Korobilis D. 2013. Large time-varying parameter VARs. J. Econom. 177:185–98 [Google Scholar]
  70. Korobilis D. 2013. Assessing the transmission of monetary policy using time-varying parameter dynamic factor models. Oxf. Bull. Econ. Stat. 75:2157–79 [Google Scholar]
  71. Manzan S, Zerom D. 2013. Are macroeconomic variables useful for forecasting the distribution of U.S. inflation?. Int. J. Forecast. 29:469–78 [Google Scholar]
  72. McConnell MM, Pérez-Quirós G. 2000. Output fluctuations in the United States: What has changed since the early 1980s?. Am. Econ. Rev. 90:1464–76 [Google Scholar]
  73. Mitchell J, Wallis KF. 2011. Evaluating density forecasts: forecast combinations, model mixtures, calibration and sharpness. J. Appl. Econ. 26:1023–40 [Google Scholar]
  74. Monti F. 2010. Combining judgment and models. J. Money Credit Bank. 42:1641–62 [Google Scholar]
  75. Müller U, Petalas PE. 2010. Efficient estimation of the parameter path in unstable time series models. Rev. Econ. Stud. 77:1508–39 [Google Scholar]
  76. Ng S, Wright JH. 2013. Facts and challenges from the Great Recession for forecasting and macroeconomic modeling. J. Econ. Lit. 51:1120–54 [Google Scholar]
  77. Nyblom J. 1989. Testing for the constancy of parameters over time. J. Am. Stat. Assoc. 84:223–30 [Google Scholar]
  78. Pesaran MH, Pettenuzzo D, Timmermann A. 2006. Forecasting time series subject to multiple structural breaks. Rev. Econ. Stud. 73:1057–84 [Google Scholar]
  79. Pesaran MH, Pick A, Pranovich M. 2013. Optimal forecasts in the presence of structural breaks. J. Econom. 177:134–52 [Google Scholar]
  80. Pesaran MH, Timmermann A. 2002. Market timing and return prediction under model instability. J. Empir. Finance 9:495–510 [Google Scholar]
  81. Pesaran MH, Timmermann A. 2007. Selection of estimation window in the presence of breaks. J. Econom. 137:134–61 [Google Scholar]
  82. Ploberger W, Krämer W. 1992. The CUSUM test with OLS residuals. Econometrica 60:271–85 [Google Scholar]
  83. Ploberger W, Krämer W, Kontrus K. 1989. A new test for structural stability in the linear regression model. J. Econom. 40:307–18 [Google Scholar]
  84. Primiceri G. 2005. Time varying structural vector autoregressions and monetary policy. Rev. Econ. Stud. 72:821–52 [Google Scholar]
  85. Robertson JC, Tallman EW, Whiteman CH. 2005. Forecasting using relative entropy. J. Money Credit Bank. 37:383–401 [Google Scholar]
  86. Rossi B. 2013. Advances in forecasting under instability. See Elliott & Timmermann 2013, pp. 1203–324 [Google Scholar]
  87. Rossi B, Sekhposyan T. 2010. Have economic models’ forecasting performance for US output growth and inflation changed over time, and when?. Int. J. Forecast. 26:808–35 [Google Scholar]
  88. Rossi B, Sekhposyan T. 2013. Conditional predictive density evaluation in the presence of instabilities. J. Econom. 177:199–212 [Google Scholar]
  89. Rossi B, Sekhposyan T. 2014. Evaluating predictive densities of US output growth and inflation in a large macroeconomic data set. Int. J. Forecast. 30:662–82 [Google Scholar]
  90. Rossi B, Sekhposyan T. 2015. Forecast rationality tests in the presence of instabilities, with applications to Federal Reserve and survey forecasts. J. Appl. Econ. In press [Google Scholar]
  91. Sims C. 2003. Comments on Smets and Wouters. Unpublished manuscript, Princeton Univ., Princeton, NJ. http://sims.princeton.edu/yftp/Ottawa/SWcommentSlides.pdf
  92. Sims C, Zha T. 2006. Were there regime switches in U.S. monetary policy?. Am. Econ. Rev. 96:54–81 [Google Scholar]
  93. Smets F, Wouters R. 2007. Shocks and frictions in US business cycles: a Bayesian DSGE approach. Am. Econ. Rev. 97:586–606 [Google Scholar]
  94. Stock JH, Watson MW. 1996. Evidence on structural instability in macroeconomic time series relations. J. Bus. Econ. Stat. 14:11–30 [Google Scholar]
  95. Stock JH, Watson MW. 2002. Forecasting using principal components from a large number of predictors. J. Am. Stat. Assoc. 97:1167–79 [Google Scholar]
  96. Stock JH, Watson MW. 2003a. Forecasting output and inflation: the role of asset prices. J. Econ. Lit. 41:788–829 [Google Scholar]
  97. Stock JH, Watson MW. 2003b. Has the business cycle changed and why?. NBER Macroeconomics Annual 2002 Gertler M, Rogoff K. 159–230 Cambridge, MA: Natl. Bur. Econ. Res. [Google Scholar]
  98. Stock JH, Watson MW. 2004. Combination forecasts of output growth in a seven country data set. J. Forecast. 23:405–30 [Google Scholar]
  99. Stock JH, Watson MW. 2006. Forecasting with many predictors. See Elliott et al. 2006, pp. 515–54 [Google Scholar]
  100. Stock JH, Watson MW. 2007. Has inflation become harder to forecast?. J. Money Credit Bank. 39:3–33 [Google Scholar]
  101. Stock JH, Watson MW. 2009. Forecasting in dynamic factor models subject to structural instability. The Methodology and Practice of Econometrics: A Festschrift in Honour of David F. Hendry Hendry DF, Castle J, Shephard N. 173–205 New York: Oxford Univ. Press [Google Scholar]
  102. Timmermann A. 2006. Forecast combinations. See Elliott et al. 2006, pp. 135–96 [Google Scholar]
  103. Wieland V, Cwik T, Müller GJ, Schmidt S, Wolters MH. 2012. A new comparative approach to macroeconomic modelling and policy analysis Unpublished manuscript, Cent. Financ. Stud., Frankfurt
  104. Wright JH. 2009. Forecasting US inflation by Bayesian model averaging. J. Forecast. 28:131–44 [Google Scholar]
  105. Wolden Bache I, Sofie Jore A, Mitchell J, Vahey SP. 2011. Combining VAR and DSGE forecast densities. J. Econ. Dyn. Control 3:1659–70 [Google Scholar]
/content/journals/10.1146/annurev-economics-080614-115338
Loading
Forecasting in Nonstationary Environments: What Works and What Doesn’t in Reduced-Form and Structural Models
Annual Review of Economics 7, 207 (2015); https://doi.org/10.1146/annurev-economics-080614-115338
/content/journals/10.1146/annurev-economics-080614-115338
/content/journals/10.1146/annurev-economics-080614-115338
Loading

Data & Media loading...

  • Article Type: Review Article

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error