Is Flow Matching Just Trajectory Replay for Sequential Data?

2026-02-09

AI Summary

This work investigates whether flow matching in temporal generation learns a universal dynamical structure or merely reproduces historical trajectories. By analyzing the empirical flow matching objective under Gaussian conditional paths, we derive—for the first time—a closed-form expression for its optimal velocity field, revealing it to be a similarity-weighted mixture of historical instantaneous velocities. This formulation constitutes a nonparametric, memory-augmented continuous-time dynamical system. Building on this insight, we propose a training-free closed-form sampler that directly generates high-quality probabilistic forecasts from historical transitions. Evaluated on nonlinear dynamical system benchmarks, our method substantially improves sampling efficiency and numerical stability while offering an explicit, interpretable mechanism for data-dependent dynamics.

Technology Category

• Search and Optimization: Sampling/Simulation-based Search
• Machine Learning: Deep Generative Models & Autoencoders
• Planning, Routing, and Scheduling: Temporal Planning

Application Category

• Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphs
• Web Mining and Content Analysis: Web data generation and simulation
• User Modeling, Personalization and Recommendation: User modeling and simulation for interactive and conversational systems

Abstract

Flow matching (FM) is increasingly used for time-series generation, but it is not well understood whether it learns a general dynamical structure or simply performs an effective"trajectory replay". We study this question by deriving the velocity field targeted by the empirical FM objective on sequential data, in the limit of perfect function approximation. For the Gaussian conditional paths commonly used in practice, we show that the implied sampler is an ODE whose dynamics constitutes a nonparametric, memory-augmented continuous-time dynamical system. The optimal field admits a closed-form expression as a similarity-weighted mixture of instantaneous velocities induced by past transitions, making the dataset dependence explicit and interpretable. This perspective positions neural FM models trained by stochastic optimization as parametric surrogates of an ideal nonparametric solution. Using the structure of the optimal field, we study sampling and approximation schemes that improve the efficiency and numerical robustness of ODE-based generation. On nonlinear dynamical system benchmarks, the resulting closed-form sampler yields strong probabilistic forecasts directly from historical transitions, without training.

Problem

• Flow Matching
• trajectory replay
• time-series generation
• dynamical structure
• sequential data

Innovation

• flow matching
• nonparametric dynamics
• trajectory replay
• closed-form velocity field
• continuous-time dynamical system