Evaluating forecasts: a look at aggregate bias and accuracy measures

Evaluating forecasts: a look at aggregate bias and accuracy measures

0.00 Avg rating0 Votes
Article ID: iaor20081030
Country: United Kingdom
Volume: 24
Issue: 6
Start Page Number: 433
End Page Number: 451
Publication Date: Sep 2005
Journal: International Journal of Forecasting
Authors: ,
Abstract:

In this paper an investigation is made of the properties and use of two aggregate measures of forecast bias and accuracy. These are metrics used in business to calculate aggregate forecasting performance for a family (group) of products. We find that the aggregate measures are not particularly informative if some of the one-step-ahead forecasts are biased. This is likely to be the case in practice if frequently employed forecasting methods are used to generate a large number of individual forecasts. In the paper, examples are constructed to illustrate some potential problems in the use of the metrics. We propose a simple graphical display of forecast bias and accuracy to supplement the information yielded by the accuracy measures. This support includes relevant boxplots of measures of individual forecasting success. This tool is simple but helpful as the graphic display has the potential to indicate forecast deterioration that can be masked by one or both of the aggregate metrics. The procedures are illustrated with data representing sales of food items.

Reviews

Required fields are marked *. Your email address will not be published.