Optimize Your Sampling: Tuned Diffusion Sampling with Bayesian Optimization

2026-08-18

AI Summary

该研究通过贝叶斯优化直接优化目标指标，解决了扩散模型采样时间步选择问题，提高了文本到图像生成等任务的质量和效率。

Abstract

Sampling from a diffusion model typically requires many forward passes through a large neural network, making generation computationally expensive. While much work has focused on efficient solvers and samplers, comparatively little attention has been paid to selecting the sampling timesteps themselves. A recent line of work optimizes theoretically derived surrogates for sample quality rather than the quality metric itself. We propose Optimizing Your Sampling (OYS), which instead treats timestep selection as a black-box optimization problem, optimizing the target metric directly with Bayesian optimization. OYS outperforms both the default schedules and those of Align Your Steps on text-to-image generation, and improves over the default schedules on inpainting and other image tasks, in both quantitative and human evaluations. OYS requires no additional training, is applicable even to distilled models, and improves both simple and sophisticated samplers such as Euler and DPM-Solver++. A 5-step OYS schedule retains 89%-94% of the quality of a 50-step schedule while reducing inference cost by 10x.

Problem

• diffusion model
• sampling timesteps
• computationally expensive

Innovation

• Bayesian Optimization
• Diffusion Models
• Timestep Selection
• Text-to-Image Generation