On Forecast Stability

📅 2023-10-26
🏛️ International Journal of Forecasting
📈 Citations: 2
Influential: 0
📄 PDF
🤖 AI Summary
Commercial forecasting requires simultaneous stability across time points (vertical stability) and across sequences (horizontal stability), yet existing methods are limited to specific base models, achieve only vertical stability, and lack generalizability. This paper formally unifies the definitions of both stability types and proposes the first model-agnostic post-hoc linear interpolation framework that jointly optimizes them. Compatible with arbitrary base forecasting models—including N-BEATS, LightGBM, and others—the framework requires no architectural modifications or retraining. Evaluated on four public benchmarks, it consistently outperforms state-of-the-art stabilization methods: it significantly improves prediction accuracy across three error metrics (e.g., MAE, RMSE, MAPE) and simultaneously enhances both vertical and horizontal stability across six stability metrics. The approach is particularly effective for high-frequency, strongly interdependent business forecasting scenarios demanding robust and consistent predictions.
📝 Abstract
Forecasts are typically not produced in a vacuum but in a business context, where forecasts are generated on a regular basis and interact with each other. For decisions, it may be important that forecasts do not change arbitrarily, and are stable in some sense. However, this area has received only limited attention in the forecasting literature. In this paper, we explore two types of forecast stability that we call vertical stability and horizontal stability. The existing works in the literature are only applicable to certain base models and extending these frameworks to be compatible with any base model is not straightforward. Furthermore, these frameworks can only stabilise the forecasts vertically. To fill this gap, we propose a simple linear-interpolation-based approach that is applicable to stabilise the forecasts provided by any base model vertically and horizontally. The approach can produce both accurate and stable forecasts. Using N-BEATS, Pooled Regression and LightGBM as the base models, in our evaluation on four publicly available datasets, the proposed framework is able to achieve significantly higher stability and/or accuracy compared to a set of benchmarks including a state-of-the-art forecast stabilisation method across three error metrics and six stability metrics.
Problem

Research questions and friction points this paper is trying to address.

Explores vertical and horizontal forecast stability.
Proposes a linear-interpolation-based approach for stability.
Enhances forecast accuracy and stability across models.
Innovation

Methods, ideas, or system contributions that make the work stand out.

Linear-interpolation stabilizes forecasts vertically and horizontally.
Compatible with any base model for forecast stabilization.
Improves accuracy and stability across multiple metrics.
🔎 Similar Papers
No similar papers found.
R
Rakshitha Godahewa
Department of Data Science and Artificial Intelligence, Monash University, Australia
Christoph Bergmeir
Christoph Bergmeir
University of Granada
Artificial IntelligenceMachine LearningTime Series Forecasting
Z
Zeynep Erkin Baz
Meta Inc., California, USA
C
Chengjun Zhu
Meta Inc., California, USA
Z
Zhangdi Song
Department of Data Science and Artificial Intelligence, Monash University, Australia
S
Salvador García
Department of Computer Science and Artificial Intelligence, University of Granada, Spain
D
Dario Benavides
Meta Inc., California, USA