PIVOT: Physics-Grounded Verification for AI-Generated Audio-Video Detection

📅 2026-09-14
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究通过评估事件是否满足物理定律的可测量约束来检测AI生成的内容,提出基于物理的检测器PIVOT,并在音频-视频数据上进行验证。
📝 Abstract
As generative models continue to advance, AI-generated content (AIGC) is becoming increasingly realistic, weakening the artifact cues commonly exploited by existing detectors. Nevertheless, faithfully reproducing the physical behavior of real-world events remains challenging for current generators. We therefore explore detecting AIGC by assessing whether the depicted event satisfies measurable constraints derived from physical laws. We introduce PIVOT, a physics-grounded AIGC detector, instantiated here for audio-video clips, that estimates physical quantities from video and audio, selects physical laws relevant to each clip, and verifies their measurable constraints. Beyond a real/fake decision, PIVOT returns supporting evidence that records the verification outcome, relevant time window, and supporting quantities for each applicable law. Although instantiated and evaluated here on audio-video data, the framework can, in principle, extend to other AIGC modalities whenever the physical quantities required for verification can be estimated reliably. We also introduce PhysForensics-Bench, comprising paired real and generated audio-video clips from nine event-centric scene families and two recent audio-video generators. On PhysForensics-Bench, PIVOT achieves 70.30% accuracy and 64.29% F1 score on Real+Seedance, and 72.16% accuracy and 65.82% F1 on Real+VEO. In comparison, direct inspection with Gemini 3.1 Pro obtains 53.96% accuracy and 60.09% F1 on Real+Seedance, and 57.22% accuracy and 63.44% F1 on Real+Veo. These results demonstrate the practical promise of physical-consistency verification as a structured and inspectable source of evidence that complements artifact-based AIGC detection.
Problem

Research questions and friction points this paper is trying to address.

AI-Generated Content
Physical Laws
Detection
Innovation

Methods, ideas, or system contributions that make the work stand out.

Physics-Grounded Verification
Physical Laws
AIGC Detection
Measurable Constraints
PhysForensics-Bench
🔎 Similar Papers
No similar papers found.
Bo Zheng
Bo Zheng
School of Artificial Intelligence, Chinese University of Hong Kong, Shenzhen, Shenzhen 518172, China
K
Kangran Zhao
School of Artificial Intelligence, Chinese University of Hong Kong, Shenzhen, Shenzhen 518172, China
X
Xiaoyu Zhang
School of Artificial Intelligence, Chinese University of Hong Kong, Shenzhen, Shenzhen 518172, China
W
Weinan Guan
School of Artificial Intelligence, Chinese University of Hong Kong, Shenzhen, Shenzhen 518172, China
Z
Zhiheng Li
School of Artificial Intelligence, Chinese University of Hong Kong, Shenzhen, Shenzhen 518172, China
Yize Chen
Yize Chen
Assistant Professor, University of Alberta
Machine LearningPower SystemsOptimizationControl
Haizhou Li
Haizhou Li
The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen), China; NUS, Singapore
Automatic Speech RecognitionSpeaker RecognitionLanguage RecognitionVoice ConversionMachine Translation
Qingshan Liu
Qingshan Liu
Nanjing University of Posts and Telecommunications
Image and Video AnalysisComputer VisionPattern Recognition
S
Siwei Lyu
University at Buffalo, State University of New York, New York 14260, USA
Baoyuan Wu
Baoyuan Wu
Associate Professor, CUHK-SZ
AI Security and PrivacyMachine LearningComputer VisionOptimization