🤖 AI Summary
This work addresses the challenge of learning from small-sample, irregular, and non-stationary streaming multimodal time series—such as financial tick data, motion capture, and handwriting trajectories. Methodologically, it introduces a universal feature representation framework grounded in the path signature, leveraging iterative integrals and tensor algebra from control theory to extract robust, model-free, and sampling-invariant temporal features directly from raw trajectories; this effectively mitigates the exponential noise amplification induced by irregular sampling. Its key contribution is the first systematic signature-based framework explicitly designed for interpretable machine learning applications, bridging mathematical rigor with practical engineering deployment. Experiments demonstrate that the approach significantly enhances generalization and stability—even when paired with shallow classifiers—outperforming conventional time-series feature engineering. All code, reproducible experiments, and pedagogical Jupyter notebooks are publicly released.
📝 Abstract
Signature-based techniques give mathematical insight into the interactions between complex streams of evolving data. These insights can be quite naturally translated into numerical approaches to understanding streamed data, and perhaps because of their mathematical precision, have proved useful in analysing streamed data in situations where the data is irregular, and not stationary, and the dimension of the data and the sample sizes are both moderate. Understanding streamed multi-modal data is exponential: a word in $n$ letters from an alphabet of size $d$ can be any one of $d^n$ messages. Signatures remove the exponential amount of noise that arises from sampling irregularity, but an exponential amount of information still remain. This survey aims to stay in the domain where that exponential scaling can be managed directly. Scalability issues are an important challenge in many problems but would require another survey article and further ideas. This survey describes a range of contexts where the data sets are small enough to remove the possibility of massive machine learning, and the existence of small sets of context free and principled features can be used effectively. The mathematical nature of the tools can make their use intimidating to non-mathematicians. The examples presented in this article are intended to bridge this communication gap and provide tractable working examples drawn from the machine learning context. Notebooks are available online for several of these examples. This survey builds on the earlier paper of Ilya Chevryev and Andrey Kormilitzin which had broadly similar aims at an earlier point in the development of this machinery. This article illustrates how the theoretical insights offered by signatures are simply realised in the analysis of application data in a way that is largely agnostic to the data type.