Diffusion Image Editing via Asynchronous Token Decoding
This work addresses the challenge of global semantic drift in text-guided diffusion-based image editing, which often compromises the identity and background of unedited regions. To mitigate this issue, the authors propose ATDEdit, a novel framework that treats each sampling step during inference as a globally coupled token matrix, enabling simultaneous local editing and background preservation. ATDEdit introduces an asynchronous token decoding mechanism that dynamically identifies editable positions based on conditional surprise, applies conditional corrections to target tokens, and reuses source key/value memories while back-projecting latent representations in preserved regions—eliminating the need for spatial masks or model fine-tuning. Experiments demonstrate that ATDEdit achieves state-of-the-art fidelity on PIE-Bench (PSNR 27.44 dB, LPIPS 0.055) while maintaining strong semantic alignment.