🤖 AI Summary
This study addresses the limitations of traditional linear dynamic factor models under nonlinear, non-Gaussian, and small-sample conditions. It proposes a novel nonlinear dynamic factor model by integrating the Transformer architecture into dynamic factor analysis. To enhance estimation stability in small samples, the approach incorporates a conventional factor model as a prior regularizer. The model leverages attention mechanisms to capture the time-varying contributions of individual variables and their lags to latent factors, thereby enabling the identification of economic regime shifts. Empirical results demonstrate that the proposed framework substantially outperforms standard methods in settings that deviate from linearity and Gaussianity, and it successfully constructs a coincident index of U.S. real economic activity.
📝 Abstract
The paper develops a Transformer architecture for estimating dynamic factors from multivariate time series data under flexible identification assumptions. Performance on small datasets is improved substantially by using a conventional factor model as prior information via a regularization term in the training objective. The results are interpreted with Attention matrices that quantify the relative importance of variables and their lags for the factor estimate. Time variation in Attention patterns can help detect regime switches and evaluate narratives. Monte Carlo experiments suggest that the Transformer is more accurate than the linear factor model, when the data deviate from linear-Gaussian assumptions. An empirical application uses the Transformer to construct a coincident index of U.S. real economic activity.