🤖 AI Summary
This work addresses critical quality challenges in large-scale AI video generation—namely hallucination, motion distortion, and aesthetic inconsistency—by introducing the first end-to-end automated quality control system. The system integrates a video assessment module that evaluates frame-level aesthetics, temporal motion fidelity, and fine-grained hallucination risk, coupled with an intelligent regeneration agent to iteratively refine outputs. Innovatively aligning fine-grained hallucination awareness with machine-enforceable creative guidelines, it establishes a closed-loop audit-and-regeneration pipeline that preserves input image fidelity, ensures brand safety, and maintains visual realism while enabling scalable production. Experimental results demonstrate that the system consistently generates hyper-realistic, production-grade videos, significantly enhancing both perceptual quality and reliability as validated by human expert evaluations.
📝 Abstract
AI-generated video is increasingly used across marketing, product storytelling, and creative workflows, yet automated; high-precision quality control remains a major constraint to scaling production. We present HALLELUAI, an end-to-end system that moderates and regenerates image-to-video outputs to meet expert-level creative standards and deliver ultra-realistic videos with consistent end-user quality of experience (QoE) at scale. The system integrates a video moderation module that evaluates frame-level aesthetics, temporal motion fidelity, and fine-grained hallucination risks relative to the source image, with an agentic regeneration module that iteratively fixes failures through prompt refinement, controlled camera adjustments, targeted model or image switching, and structured retry strategies. The moderation logic is aligned with domain-specific creative guidelines and produces granular, machine-actionable feedback that directly drives regeneration. In human-in-the-loop evaluations with creative experts, HALLELUAI shows strong alignment and reliably outputs ultra-realistic, production-grade videos suitable for product and marketing placements at scale. This framework advances trustworthy AI generated video content by enforcing visual realism, brand safety, and strict input-image fidelity while enabling image-to-video generation at scale.