Consistent Video Colorization via Palette Guidance
🤖 AI Summary
提出稳定视频扩散技术结合调色盘的新方法，解决电脑给老电影上色时颜色不鲜艳、不稳定的问题，实验证明颜色更生动稳定。
Application Category
📝 Abstract
Colorization is a traditional computer vision task and it plays an important role in many time-consuming tasks, such as old film restoration. Existing methods suffer from unsaturated color and temporally inconsistency. In this paper, we propose a novel pipeline to overcome the challenges. We regard the colorization task as a generative task and introduce Stable Video Diffusion (SVD) as our base model. We design a palette-based color guider to assist the model in generating vivid and consistent colors. The color context introduced by the palette not only provides guidance for color generation, but also enhances the stability of the generated colors through a unified color context across multiple sequences. Experiments demonstrate that the proposed method can provide vivid and stable colors for videos, surpassing previous methods.
Problem
Research questions and friction points this paper is trying to address.
Colorization
Stability
Vividness
Innovation
Methods, ideas, or system contributions that make the work stand out.
Stable Video Diffusion
Color Palette Utilization
Enhanced Color Vividity and Stability
🔎 Similar Papers
No similar papers found.
