FlowCast: Trajectory Forecasting for Scalable Zero-Cost Speculative Flow Matching

2026-02-01

AI Summary

Flow Matching models suffer from slow inference due to the need for numerous denoising steps, hindering their applicability in real-time scenarios; existing acceleration methods often compromise generation quality, require retraining, or exhibit poor generalization. This work proposes FlowCast, a training-free, plug-and-play speculative acceleration framework that exploits the constant velocity field property inherent in Flow Matching. By extrapolating the current trajectory to predict future states and employing a mean squared error threshold to govern prediction acceptance, FlowCast enables large step sizes in stable regions while preserving accuracy in complex areas. Theoretical analysis provides bounds on trajectory deviation. Experiments on image and video generation and editing tasks demonstrate that FlowCast achieves over 2.5× speedup without any loss in output quality, significantly outperforming existing baselines.

Technology Category

• Computer Vision: Diffusion Models for Vision
• Machine Learning: Large Multimodal Models (LMMs)
• Search and Optimization: Learning to Search

Application Category

• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
• Graph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphs
• Social Networks and Social Media: Generative AI / large language models and their impact on social systems

Abstract

Flow Matching (FM) has recently emerged as a powerful approach for high-quality visual generation. However, their prohibitively slow inference due to a large number of denoising steps limits their potential use in real-time or interactive applications. Existing acceleration methods, like distillation, truncation, or consistency training, either degrade quality, incur costly retraining, or lack generalization. We propose FlowCast, a training-free speculative generation framework that accelerates inference by exploiting the fact that FM models are trained to preserve constant velocity. FlowCast speculates future velocity by extrapolating current velocity without incurring additional time cost, and accepts it if it is within a mean-squared error threshold. This constant-velocity forecasting allows redundant steps in stable regions to be aggressively skipped while retaining precision in complex ones. FlowCast is a plug-and-play framework that integrates seamlessly with any FM model and requires no auxiliary networks. We also present a theoretical analysis and bound the worst-case deviation between speculative and full FM trajectories. Empirical evaluations demonstrate that FlowCast achieves $>2.5\times$ speedup in image generation, video generation, and editing tasks, outperforming existing baselines with no quality loss as compared to standard full generation.

Problem

• Flow Matching
• trajectory forecasting
• inference acceleration
• real-time generation
• speculative execution

Innovation

• Flow Matching
• speculative generation
• training-free acceleration
• trajectory forecasting
• constant-velocity extrapolation