End-to-End Modeling of Hierarchical Time Series Using Autoregressive Transformer and Conditional Normalizing Flow-based Reconciliation

📅 2022-11-01
🏛️ 2022 IEEE International Conference on Data Mining Workshops (ICDMW)
📈 Citations: 7
Influential: 0
📄 PDF
🤖 AI Summary
Hierarchical forecasting of multivariate time series must jointly satisfy both accuracy requirements across all levels and aggregation consistency constraints; however, statistical heterogeneity across levels—such as non-Gaussian marginal distributions and strong nonlinear inter-level dependencies—severely limits conventional methods that rely on post-hoc reconciliation or assumptions of Gaussianity/unbiasedness. This paper proposes the first end-to-end joint modeling framework: a conditional normalizing flow (CNF)-driven autoregressive Transformer, which intrinsically embeds hierarchical constraints into its architecture to enable differentiable, post-processing-free consistent forecasting. The model unifies the representation of cross-level nonlinear dependencies, non-Gaussian distributions, and statistical heterogeneity. Evaluated on four real-world industrial datasets—including Alipay server logs—the method achieves significant improvements over state-of-the-art approaches in both forecast accuracy and aggregation consistency.
📝 Abstract
Multivariate time series forecasting with hierarchi-cal structure is pervasive in real-world applications, demanding not only predicting each level of the hierarchy, but also recon-ciling all forecasts to ensure coherency, i.e., the forecasts should satisfy the hierarchical aggregation constraints. Moreover, the disparities of statistical characteristics between levels can be huge, worsened by non-Gaussian distributions and non-linear correlations. To this extent, we propose a novel end-to-end hierarchical time series forecasting model, based on conditioned normalizing flow-based autoregressive transformer reconciliation, to represent complex data distribution while simultaneously reconciling the forecasts to ensure coherency. Unlike other state-of-the-art methods, we achieve the forecasting and reconciliation simultaneously without requiring any explicit post-processing step. In addition, by harnessing the power of deep model, we do not rely on any assumption such as unbiased estimates or Gaussian distribution. Our evaluation experiments are conducted on four real-world hierarchical datasets from different industrial domains (three public ones and a dataset from the application servers of Alipay11Alipay is the world's leading company in payment technology. https:/len.wikipedia.org/wiki/Alipay) and the preliminary results demonstrate efficacy of our proposed method.
Problem

Research questions and friction points this paper is trying to address.

Reconcile hierarchical forecasts to ensure coherency without post-processing
Model complex non-Gaussian distributions and non-linear correlations
Simultaneously forecast all hierarchy levels while satisfying aggregation constraints
Innovation

Methods, ideas, or system contributions that make the work stand out.

Autoregressive transformer for hierarchical time series forecasting
Conditional normalizing flow for reconciliation without post-processing
End-to-end deep learning without Gaussian distribution assumptions
🔎 Similar Papers
No similar papers found.
S
Shiyu Wang
Ant Group, Hangzhou, China
F
Fan Zhou
Ant Group, Hangzhou, China
Y
Yinbo Sun
Ant Group, Hangzhou, China
Lintao Ma
Lintao Ma
Ant Group
bayesian learningtime series analysisgenerative models
J
James Zhang
Ant Group, Hangzhou, China
Y
Yangfei Zheng
Ant Group, Hangzhou, China
L
Lei Lei
Y
Yun Hu