IP-Bench: Benchmark for Image Protection Methods in Image-to-Video Generation Scenarios

2026-03-27

AI Summary

This work addresses the lack of a unified benchmark for evaluating image protection methods in the context of image-to-video (I2V) generation and preprocessing-based attacks. To this end, we present the first comprehensive evaluation benchmark tailored to I2V misuse scenarios, integrating six representative image protection techniques and five state-of-the-art I2V models within a reproducible and extensible framework. We further introduce practical robustness-oriented attack strategies to simulate real-world adversarial conditions. Through extensive cross-model and cross-modal transfer analyses, we systematically quantify the effectiveness and limitations of existing protection approaches under I2V settings, thereby establishing a reliable foundation for the future development and assessment of image protection technologies.

Abstract

With the rapid advancement of image-to-video (I2V) generation models, their potential for misuse in creating malicious content has become a significant concern. For instance, a single image can be exploited to generate a fake video, which can be used to attract attention and gain benefits. This phenomenon is referred to as an I2V generation misuse. Existing image protection methods suffer from the absence of a unified benchmark, leading to an incomplete evaluation framework. Furthermore, these methods have not been systematically assessed in I2V generation scenarios and against preprocessing attacks, which complicates the evaluation of their effectiveness in real-world deployment scenarios.To address this challenge, we propose IP-Bench (Image Protection Bench), the first systematic benchmark designed to evaluate protection methods in I2V generation scenarios. This benchmark examines 6 representative protection methods and 5 state-of-the-art I2V models. Furthermore, our work systematically evaluates protection methods' robustness with two robustness attack strategies under practical scenarios and analyzes their cross-model & cross-modality transferability. Overall, IP-Bench establishes a systematic, reproducible, and extensible evaluation framework for image protection methods in I2V generation scenarios.

Problem

• image protection
• image-to-video generation
• benchmark
• misuse prevention
• robustness evaluation

Innovation

• image protection
• image-to-video generation
• benchmark
• robustness evaluation
• cross-modality transferability