ANVIL: Accelerator-Native Video Interpolation via Codec Motion Vector Priors
This work addresses the challenges of deploying optical flow–based video frame interpolation on mobile devices, where incompatibility of sampling operators, iterative refinement failure under 8-bit quantization, and memory constraints hinder practicality. The authors propose a novel architecture that eliminates learned optical flow estimation by repurposing motion vectors from an H.264 decoder to pre-align input frames. By discarding spatial sampling and iterative accumulation, the method relies solely on a convolutional network to refine residual details, yielding a fully compute-intensive inference graph. This approach pioneers the use of codec-derived motion vectors as priors for real-time mobile interpolation, enabling a low-latency design fully compatible with neural processing units (NPUs) and uncovering the causal mechanism behind iterative optical flow failure under quantization. On a Snapdragon 8 Gen 3 platform, it achieves 12.8 ms latency for 1080p interpolation, with an end-to-end median latency of 28.4 ms in an open-source Android player, validated over 54,623 samples across 30 minutes of continuous playback.