It is standard in applied work to select forecasting models by ranking candidate models by their prediction mean square error (PMSE) in simulated ou-of-sample (SOOS) forecasts. Alternatively, forecast models may be selected using information criteria (IC). We compare the asymptotic and...

We evaluate residual projection strategies in the context of a large-scale macro model of the euro area and smaller benchmark time-series models. The exercises attempt to measure the accuracy of model-based forecasts simulated both out-of-sample and in-sample. Both exercises incorporate...

The Eurosystem/ECB staff macroeconomic projection exercises constitute an important input to the ECB's monetary policy. This work marks a thorough analysis of the Eurosystem/ECB projection errors by looking at criteria of optimality and rationality using techniques widely employed in the applied...

We analyse the performance of budgetary and growth forecasts of all stability and convergence programmes submitted by EU member states over the last decade. Differences emerge for the bias in budgetary projections across countries. As a second step we explore whether economic, political and...

We propose a theoretical framework for assessing whether a forecast model estimated over one period can provide good forecasts over a subsequent period. We formalize this idea by defining a forecast breakdown as a situation in which the out-of-sample performance of the model, judged by some loss...

In this paper, we propose a framework to evaluate the subjective density forecasts of macroeconomists using micro data from the euro area Survey of Professional Forecasters (SPF). A key aspect of our analysis is the evaluation of the entire predictive densities, including an evaluation of the...

We propose methods to evaluate the risk assessments collected as part of the ECB Survey of Professional Forecasters (SPF). Our approach focuses on direction-of-change predictions as well as the prediction of relatively more extreme macroeconomic outcomes located in the upper and lower regions of...

In this paper, we exploit micro data from the ECB Survey of Professional Forecasters (SPF) to examine the link between the characteristics of macroeconomic density forecasts (such as their location, spread, skewness and tail risk) and density forecast performance. Controlling for the effects of...

This paper documents macroeconomic forecasting during the global financial crisis by two key central banks: the European Central Bank and the Federal Reserve Bank of New York. The paper is the result of a collaborative effort between staff at the two institutions, allowing us to study the...

The period of extraordinary volatility in euro area headline inflation starting in 2007 raised the question whether forecast combination methods can be used to hedge against bad forecast performance of single models during such periods and provide more robust forecasts. We investigate this issue...