A recession is a period of high uncertainty: how much will demand, activity, employment, and corporate profits decline? How long will it last? For economic forecasters, it is a stressful period: the pressure to produce good forecasts rises proportionally to the difficulty of doing so because during a recession, the economy is in a state of flux. The relationships between the components of final demand -consumption, capital formation, exports- and their drivers become less predictable due to confidence effects, financial constraints, non-linearities, etc. In 2018, a working paper of the IMF concluded that “while forecasts in recession years are revised each month, they do not capture the onset of recessions in a timely way and the extent of output decline during recessions is missed by a wide margin.”[1] This result held for private as well as public sector forecasts.

REAL GDP GROWTH: FORECAST ERROR (FORECAST MINUS REALISED)

Capturing the onset of a recession is particularly difficult: when will the tipping point be reached whereby an economy reacts to recent shocks in such a way that it corresponds to a recession? The IMF paper gives a sobering conclusion for advanced and emerging economies, but what about forecasts for the US specifically? The question is important given the weight of the US in the world. Chart 1 shows the forecast errors of the Survey of Professional Forecasters (SPF) conducted by the Federal Reserve Bank of Philadelphia.[2][3] The forecasts concern those made in the current quarter for the next quarter (henceforth labeled as Q-1). At first glance it seems that recessions tend to be marked by large positive forecast errors, which implies that the depth of the recessions was underestimated. To analyse this in detail, chart 2 distinguishes between recession and non-recession periods and shows the results for various forecast horizons.[4] The metric that is used is the root mean squared error (RMSE).[5] One would expect an improvement of the forecast quality -a decline in the RMSE- when the forecast horizon shortens. This is indeed the case during recession periods, but outside these, the RMSE is stable across the different forecast horizons. The forecast errors for periods when the US was in recession are also considerably higher compared to non-recession periods. For longer forecast horizons -four or three quarters ahead-, this could reflect that recessions come as a surprise. For shorter horizons, including quarters when the economy was already in recession when the forecasts were made, it could be the result of new shocks and hard to anticipate dynamics during the recession. Another interpretation is that it is extremely difficult to anticipate the contraction of GDP during recessions. Finally, as shown by the table, forecasts covering periods when the US was in recession, are too optimistic by a wide margin: this is the case for 70% of the forecasts for the next quarter and the number increases to 89% for the four quarters ahead forecast. At the current juncture, there is broad consensus, if not unanimity, amongst forecasters that downside risks to growth dominate due to the multiple headwinds and uncertainties. The historical forecast record also underpins this distribution of risks.

REAL GDP GROWTH: AVERAGE FORECAST ERROR (FORECAST MINUS REALISED)

 

US REAL GDP GROWTH: FORECAST ERROR DURING RECESSION QUARTERS (FORECAST MINUS REALISED)

[1] Zidong An, João Tovar Jalles, and Prakash Loungani, How Well Do Economists Forecast Recessions?, IMF working paper 18/39, March 2018. The authors analyse GDP forecasts for 63 countries for the years 1992 to 2014.  The private sector forecasts are taken from Consensus Economics and the public sector forecasts are from the IMF.

[2] “The Survey of Professional Forecasters is the oldest quarterly survey of macroeconomic forecasts in the United States. The survey began in 1968 and was conducted by the American Statistical Association and the National Bureau of Economic Research. The Federal Reserve Bank of Philadelphia took over the survey in 1990.” (Source: Federal Reserve Bank of Philadelphia).

[3] The forecasts concern the growth of real GDP versus the previous quarter on a seasonally adjusted annualized rate.

[4] Q-4 refers to the forecast made for the quarter under review 4 quarters ago. Data for 2020 have been excluded, considering the extreme swings related to the Covid-19 pandemic. Data start in 1968 Q4 but some data for Q-4 forecasts are missing in the early years of the survey. Data are available for all forecast horizons as of 1973 Q4.

[5] Given that some forecast errors are positive and others negative, they are first squared before calculating the average, after which the square root of the average is calculated.