1932

Abstract

Data, data, data…. Economists know their importance well, especially when it comes to monitoring macroeconomic conditions—the basis for making informed economic and policy decisions. Handling large and complex data sets was a challenge that macroeconomists engaged in real-time analysis faced long before so-called big data became pervasive in other disciplines. We review how methods for tracking economic conditions using big data have evolved over time and explain how econometric techniques have advanced to mimic and automate best practices of forecasters on trading desks, at central banks, and in other market-monitoring roles. We present in detail the methodology underlying the New York Fed Staff Nowcast, which employs these innovative techniques to produce early estimates of GDP growth, synthesizing a wide range of macroeconomic data as they become available.

Loading

Article metrics loading...

/content/journals/10.1146/annurev-economics-080217-053214
2018-08-02
2024-04-16
Loading full text...

Full text loading...

/deliver/fulltext/economics/10/1/annurev-economics-080217-053214.html?itemId=/content/journals/10.1146/annurev-economics-080217-053214&mimeType=html&fmt=ahah

Literature Cited

  1. Aarons G, Caratelli D, Cocci M, Giannone D, Sbordone A, Tambalotti A 2016. Just released: introducing the New York Fed Staff Nowcast. Liberty Street Economics Apr 12
  2. Aastveit K, Trovik T 2012. Nowcasting Norwegian GDP: the role of asset prices in a small open economy. Empir. Econ. 42:95–119
    [Google Scholar]
  3. Adrian T, Boyarchenko N, Giannone D 2016. Vulnerable growth Staff Rep. 794, Fed. Reserve Bank N. Y.
  4. Aladangady A, Aron-Dine S, Dunn W, Feiveson L, Lengermann P, Sahm C 2016. The effect of Hurricane Matthew on consumer spending FEDS Note Board Gov. Fed. Reserve Syst. Washington, DC:
  5. Altavilla C, Giannone D, Modugno M 2017. Low frequency effects of macroeconomic news on government bond yields. J. Monet. Econ. 92:31–46
    [Google Scholar]
  6. Anderson BD, Deistler M, Felsenstein E, Funovits B, Koelbl L, Zamani M 2016.a Multivariate AR systems and mixed frequency data: G-identifiability and estimation. Econom. Theory 32:793–826
    [Google Scholar]
  7. Anderson BD, Deistler M, Felsenstein E, Koelbl L 2016.b The structure of multivariate AR and ARMA systems: regular and singular systems; the single and the mixed frequency case. J. Econom. 192:366–73
    [Google Scholar]
  8. Andreou E, Ghysels E, Kourtellos A 2013. Should macroeconomic forecasters use daily financial data and how. J. Bus. Econ. Stat. 31:240–51
    [Google Scholar]
  9. Anesti N, Galvao A, Miranda-Agrippino S 2017. Uncertain kingdom: a new framework to nowcast GDP and its revisions Unpublished manuscript, Bank Engl. London:
  10. Angelini E, Camba-Mendez G, Giannone D, Reichlin L, Rünstler G 2011. Short-term forecasts of euro area GDP growth. Econom. J. 14:C25–44
    [Google Scholar]
  11. Antolin-Diaz J, Drechsel T, Petrella I 2017. Tracking the slowdown in long-run GDP growth. Rev. Econ. Stat. 99:343–56
    [Google Scholar]
  12. Aruoba SB, Diebold FX, Scotti C 2009. Real-time measurement of business conditions. J. Bus. Econ. Stat. 27:417–27
    [Google Scholar]
  13. Askitas N 2015. Google search activity data and breaking trends. IZA World Labor 2015:206
    [Google Scholar]
  14. Bańbura M, Giannone D, Modugno M, Reichlin L 2013. Now-casting and the real-time data flow. Handbook of Economic Forecasting 2 G Elliott, A Timmermann 195–237 Amserdam: Elsevier
    [Google Scholar]
  15. Bańbura M, Giannone D, Reichlin L 2010. Large Bayesian vector auto regressions. J. Appl. Econom. 25:71–92
    [Google Scholar]
  16. Bańbura M, Giannone D, Reichlin L 2011. Nowcasting. The Oxford Handbook of Economic Forecasting MP Clements, DF Hendry 193–224 Oxford, UK: Oxford Univ. Press
    [Google Scholar]
  17. Bańbura M, Modugno M 2014. Maximum likelihood estimation of factor models on datasets with arbitrary pattern of missing data. J. Appl. Econom. 29:133–60
    [Google Scholar]
  18. Barigozzi M, Luciani M 2018. Do national account statistics underestimate US real output growth? FEDS Note Board Gov. Fed. Reserve Syst. Washington, DC:
  19. Bartolini L, Goldberg LS, Sacarny A 2008. How economic news moves markets. Curr. Issues Econ. Finance 14:6
    [Google Scholar]
  20. Bragoli D 2017. Now-casting the Japanese economy. Int. J. Forecast. 33:390–402
    [Google Scholar]
  21. Bragoli D, Fosten J 2017. Nowcasting Indian GDP. Oxf. Bull. Econ. Stat. 80:259–82
    [Google Scholar]
  22. Bragoli D, Metelli L, Modugno M 2015. The importance of updating: evidence from a Brazilian nowcasting model. J. Bus. Cycle Meas. Anal. 2015:5–22
    [Google Scholar]
  23. Brave S, Butters RA, Justiniano A 2016. Forecasting economic activity with mixed frequency Bayesian VARs Work. Pap 2016–05 Fed. Reserve Bank Chicago
  24. Bry G, Boschan C 1971. Cyclical Analysis of Time Series: Selected Procedures and Computer Programs Cambridge, MA: NBER
  25. Burns AF, Mitchell WC 1946. Measuring Business Cycles Cambridge, MA: NBER
  26. Carriero A, Clark TE, Marcellino M 2015. Bayesian VARs: specification choices and forecast accuracy. J. Appl. Econom. 30:46–73
    [Google Scholar]
  27. Caruso A 2015. Nowcasting Mexican GDP Work. Pap 2015–40 Eur. Cent. Adv. Res. Econ. Stat. Brussels:
  28. Cavallo A, Rigobon R 2016. The Billion Prices Project: using online prices for measurement and research. J. Econ. Perspect. 30:151–78
    [Google Scholar]
  29. Chernis T, Sekkel R 2017. A dynamic factor model for nowcasting Canadian GDP growth. Empir. Econ. 53:217–34
    [Google Scholar]
  30. Choi H, Varian H 2012. Predicting the present with Google Trends. Econ. Rec. 88:2–9
    [Google Scholar]
  31. Coroneo L, Giannone D, Modugno M 2016. Unspanned macroeconomic factors in the yield curve. J. Bus. Econ. Stat. 34:472–85
    [Google Scholar]
  32. Dahlhaus T, Guénette JD, Vasishtha G 2017. Nowcasting BRIC+M in real time. Int. J. Forecast. 33:915–35
    [Google Scholar]
  33. D'Agostino A, Giannone D, Lenza M, Modugno M 2016. Nowcasting business cycles: a Bayesian approach to dynamic heterogeneous factor models. Dynamic Factor Models E Hillebrand, SJ Koopman 569–94 Bingley, UK: Emerald Group Publ.
    [Google Scholar]
  34. De Mol C, Giannone D, Reichlin L 2008. Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components. J. Econom. 146:318–28
    [Google Scholar]
  35. Diebold FX 2012. The origin(s) and development of “big data”: the phenomenon, the term, and the discipline Unpublished manuscript, Dep. Econ., Univ. Penn. Philadelphia. https://www.sas.upenn.edu/∼fdiebold/papers/paper112/Diebold_Big_Data.pdf
  36. Doan T, Litterman R, Sims C 1984. Forecasting and conditional projection using realistic prior distributions. Econom. Rev. 3:1–100
    [Google Scholar]
  37. Doz C, Giannone D, Reichlin L 2011. A two-step estimator for large approximate dynamic factor models based on Kalman filtering. J. Econom. 164:188–205
    [Google Scholar]
  38. Doz C, Giannone D, Reichlin L 2012. A quasi-maximum likelihood approach for large, approximate dynamic factor models. Rev. Econ. Stat. 94:1014–24
    [Google Scholar]
  39. Forni M, Hallin M, Lippi M, Reichlin L 2000. The generalized dynamic-factor model: identification and estimation. Rev. Econ. Stat. 82:540–54
    [Google Scholar]
  40. Ghysels E, Sinko A, Valkanov R 2007. MIDAS regressions: further results and new directions. Econom. Rev. 26:53–90
    [Google Scholar]
  41. Giannone D, Lenza M, Primiceri GE 2015. Prior selection for vector autoregressions. Rev. Econ. Stat. 97:436–51
    [Google Scholar]
  42. Giannone D, Monti F, Reichlin L 2010. Incorporating conjunctural analysis in structural models. The Science and Practice of Monetary Policy Today V Wieland 41–57 Berlin: Springer
    [Google Scholar]
  43. Giannone D, Monti F, Reichlin L 2016. Exploiting the monthly data flow in structural forecasting. J. Monet. Econ. 84:201–15
    [Google Scholar]
  44. Giannone D, Reichlin L, Sala L 2004. Monetary policy in real time. NBER Macroecon. Annu. 19:161–200
    [Google Scholar]
  45. Giannone D, Reichlin L, Simonelli S 2009. Nowcasting euro area economic activity in real time: the role of confidence indicators. Natl. Inst. Econ. Rev. 210:90–97
    [Google Scholar]
  46. Giannone D, Reichlin L, Small D 2008. Nowcasting: the real-time informational content of macroeconomic data. J. Monet. Econ. 55:665–76
    [Google Scholar]
  47. Gil M, Pérez JJ, Sánchez AJ, Urtasun A 2017. Nowcasting private consumption: indicators, uncertainty and the role of Internet search query data Unpublished manuscript, Bank Spain Madrid:
  48. Gilbert CE, Morin NJ, Paciorek AD, Sahm CR 2015. Residual seasonality in GDP FEDS Note Board Gov. Fed. Reserve Syst. Washington, DC:
  49. Golinelli R, Parigi G 2007. The use of monthly indicators to forecast quarterly GDP in the short run: an application to the G7 countries. J. Forecast. 26:77–94
    [Google Scholar]
  50. Groen J, Russo P 2015. The myth of first-quarter residual seasonality. Liberty Street Economics June 8
  51. Gürkaynak RS, Sack B, Swanson E 2005. The sensitivity of long-term interest rates to economic news: evidence and implications for macroeconomic models. Am. Econ. Rev. 95:425–36
    [Google Scholar]
  52. Gürkaynak RS, Wright JH 2013. Identification and inference using event studies. Manch. School 81:48–65
    [Google Scholar]
  53. Hamilton JD 1989. A new approach to the economic analysis of nonstationary time series and the business cycle. Econometrica 57:357–84
    [Google Scholar]
  54. Harding D, Pagan A 2002. Dissecting the cycle: a methodological investigation. J. Monet. Econ. 49:365–81
    [Google Scholar]
  55. Harding D, Pagan A 2006. Synchronization of cycles. J. Econom. 132:59–79
    [Google Scholar]
  56. Harding D, Pagan A 2016. The Econometric Analysis of Recurrent Events in Macroeconomics and Finance Princeton, NJ: Princeton Univ. Press
  57. Higgins PC 2014. GDPNow: a model for GDP “nowcasting” Work. Pap 2014–7 Fed. Reserve Bank Atlanta
  58. Kabundi A, Nel E, Ruch F 2016. Nowcasting real GDP growth in South Africa Work. Pap 16–01 S. Afr. Reserve Bank Pretoria:
  59. Karlsson S 2013. Forecasting with Bayesian vector autoregression. Handbook of Economic Forecasting 2 G Elliott, A Timmermann 791–897 Amsterdam: Elsevier
    [Google Scholar]
  60. Kim CJ, Nelson CR 2001. A Bayesian approach to testing for Markov-switching in univariate and dynamic factor models. Int. Econ. Rev. 42:989–1013
    [Google Scholar]
  61. Kitchen J, Monaco R 2003. Real-time forecasting in practice: the U.S. Treasury staff's real-time GDP forecast system. Bus. Econ. 38:10–19
    [Google Scholar]
  62. Kliesen KL 2017. Residual seasonality: the return of an old first-quarter friend. On the Economy Blog Mar 27
  63. Knotek ES, Zaman S 2017. Financial nowcasts and their usefulness in macroeconomic forecasting Work. Pap 17–02 Fed. Reserve Bank Cleveland OH:
  64. Koop G 2012. Using VARs and TVP-VARs with many macroeconomic variables. Cent. Eur. J. Econ. Model. Econom. 4:143–67
    [Google Scholar]
  65. Koop G 2017. Bayesian methods for empirical macroeconomics with big data. Rev. Econ. Anal. 9:33–56
    [Google Scholar]
  66. Lahiri K, Monokroussos G 2013. Nowcasting US GDP: the role of ISM business surveys. Int. J. Forecast. 29:644–58
    [Google Scholar]
  67. Landefeld JS, Seskin EP, Fraumeni BM 2008. Taking the pulse of the economy: measuring GDP. J. Econ. Perspect. 22:193–216
    [Google Scholar]
  68. Lazer D, Kennedy R, King G, Vespignani A 2014. The parable of Google Flu: traps in big data analysis. Science 343:1203–5
    [Google Scholar]
  69. Li X 2016. Nowcasting with big data: Is Google useful in the presence of other information? Unpublished manuscript, London Bus. School
  70. Liebermann J 2014. Real-time nowcasting of GDP: a factor model versus professional forecasters. Oxf. Bull. Econ. Stat. 76:783–811
    [Google Scholar]
  71. Luciani M 2017. Large-dimensional dynamic factor models in real-time: a survey. Handbook on Cyclical Composite Indicators GL Mazzi, A Ozyildirim 429–59 Luxembourg: Eurostat
    [Google Scholar]
  72. Luciani M, Pundit M, Ramayandi A, Veronese G 2015. Nowcasting Indonesia Discuss. Pap 2015–100 Finance Econ. Discuss. Ser., Board Gov. Fed. Reserve Syst. Washington, DC:
  73. Luciani M, Ricci L 2014. Nowcasting Norway. Int. J. Cent. Bank. 10:215–48
    [Google Scholar]
  74. Lunsford KG 2017. Lingering residual seasonality in GDP growth Econ. Comment 2017–06 Fed. Reserve Bank Cleveland OH:
  75. Marcellino M 2006. Leading indicators. Handbook of Economic Forecasting 1 G Elliott, CWJ Granger, A Timmermann 879–960 Amsterdam: Elsevier
    [Google Scholar]
  76. Marcellino M, Porqueddu M, Venditti F 2016. Short-term GDP forecasting with a mixed-frequency dynamic factor model with stochastic volatility. J. Bus. Econ. Stat. 34:118–27
    [Google Scholar]
  77. Marcellino M, Schumacher C 2010. Factor MIDAS for nowcasting and forecasting with ragged-edge data: a model comparison for German GDP. Oxf. Bull. Econ. Stat. 72:518–50
    [Google Scholar]
  78. Mariano RS, Murasawa Y 2003. A new coincident index of business cycles based on monthly and quarterly series. J. Appl. Econom. 18:427–43
    [Google Scholar]
  79. Matheson TD 2010. An analysis of the informational content of New Zealand data releases: the importance of business opinion surveys. Econ. Model. 27:304–14
    [Google Scholar]
  80. McCracken MW, Owyang MT, Sekhposyan T 2015. Real-time forecasting with a large, mixed frequency, Bayesian VAR Work. Pap 2015–30 Fed. Reserve Bank St. Louis MO:
  81. Mitchell WC, Burns AF 1938. Statistical indicators of cyclical revivals NBER Bull 69
  82. Mittnik S, Zadrozny P 2005. Forecasting quarterly German GDP at monthly intervals using monthly Ifo business conditions data. Ifo Survey Data in Business Cycle and Monetary Policy Analysis JE Sturm, T Wollmershäuser 19–48 Berlin: Springer
    [Google Scholar]
  83. Moulton BR, Cowan BD 2016. Residual seasonality in GDP and GDI: findings and next steps. Survey of Current Business July
  84. Nakamura L, Samuels J, Soloveichik R 2017. Measuring the “free” digital economy within the GDP and productivity accounts Work. Pap 17–37 Fed. Reserve Bank Philadelphia
  85. OECD (Organ. Econ. Co-op. Dev.). 2012. Business cycle indicators handbook Rep. Organ. Econ. Co-op. Dev. Paris:
  86. Off. Natl. Stat. 2017. Changes to ONS gross domestic product (GDP) release schedule Rep. Off. Natl. Stat. London:
  87. Parigi G, Schlitzer G 1995. Quarterly forecasts of the Italian business cycle by means of monthly economic indicators. J. Forecast. 14:117–41
    [Google Scholar]
  88. Phillips KR, Wang J 2016. Residual seasonality in U.S. GDP data. Work. Pap 1608 Fed. Reserve Bank Dallas
  89. Rudebusch GD, Wilson D, Mahedy T 2015. The puzzle of weak first-quarter GDP growth Econ. Lett 16 Fed. Reserve Bank San Francisco
  90. Runstler G, Barhoumi K, Benk S, Cristadoro R, Reijer AD et al. 2009. Short-term forecasting of GDP using large datasets: a pseudo real-time forecast evaluation exercise. J. Forecast. 28:595–611
    [Google Scholar]
  91. Sargent TJ, Sims CA 1977. Business cycle modeling without pretending to have too much a priori economic theory. New Methods in Business Cycle Research CA Sims 45–109 Minneapolis, MN: Fed. Reserve Bank Minneapolis
    [Google Scholar]
  92. Sims CA 1980. Macroeconomics and reality. Econometrica 48:1–48
    [Google Scholar]
  93. Sims CA 2002. The role of models and probabilities in the monetary policy process. Brookings Pap. Econ. Act. 2002:1–40
    [Google Scholar]
  94. Stark T 2015. First quarters in the national income and product accounts Res. Rep., Fed. Reserve Bank Philadelphia
  95. Stock JH, Watson MW 1989. New indexes of coincident and leading economic indicators. NBER Macroecon. Annu. 4:351–409
    [Google Scholar]
  96. Stock JH, Watson MW 2002.a Forecasting using principal components from a large number of predictors. J. Am. Stat. Assoc. 97:1167–79
    [Google Scholar]
  97. Stock JH, Watson MW 2002.b Macroeconomic forecasting using diffusion indexes. J. Bus. Econ. Stat. 20:147–62
    [Google Scholar]
  98. Stock JH, Watson MW 2010. Indicators for dating business cycles: cross-history selection and comparisons. Am. Econ. Rev. 100:16–19
    [Google Scholar]
  99. Stock JH, Watson MW 2014. Estimating turning points using large data sets. J. Econom. 178:368–81
    [Google Scholar]
  100. Stock JH, Watson MW 2016. Dynamic factor models, factor-augmented vector autoregressions, and structural vector autoregressions in macroeconomics. Handbook of Macroeconomics 2 JB Taylor, H Uhlig 415–525 Amsterdam: Elsevier
    [Google Scholar]
  101. Stock JH, Watson MW 2017. Twenty years of time series econometrics in ten pictures. J. Econ. Perspect. 31:59–86
    [Google Scholar]
  102. Watson MW 2004. Monetary policy in real time: comment. NBER Macroecon. Annu. 19:216–21
    [Google Scholar]
  103. West M 2003. Bayesian factor regression models in the large p, small paradigm. Bayesian Statistics 7 J Bernardo, M Bayarri, J Berger, A Dawid, D Heckerman, A Smith, M West 733–42 Oxford, UK: Oxford Univ. Press
    [Google Scholar]
  104. White H 1982. Maximum likelihood estimation of misspecified models. Econometrica 50:1–25
    [Google Scholar]
  105. Yiu MS, Chow KK 2010. Nowcasting Chinese GDP: information content of economic and financial data. China Econ. J. 3:223–40
    [Google Scholar]
  106. Zadrozny PA 1990. Forecasting U.S. GNP at monthly intervals with an estimated bivariate time series model. Econ. Rev. 75:2–15
    [Google Scholar]
  107. Zarnowitz V 1969. The new ASA/NBER survey of forecasts by economic statisticians Supp. Rep. 4, NBER
/content/journals/10.1146/annurev-economics-080217-053214
Loading
/content/journals/10.1146/annurev-economics-080217-053214
Loading

Data & Media loading...

  • Article Type: Review Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error