Vidmento: Creating Video Stories Through Context-Aware Expansion With Generative Video

2026-01-29

AI Summary

This work proposes a hybrid video creation paradigm that integrates cinematic production principles with generative AI to overcome limitations imposed by existing footage, which often lead to narrative discontinuities and constrained expression. By leveraging context-aware generative video extension, the approach seamlessly blends captured and synthesized content, enabling creators to systematically expand initial素材 and fill narrative gaps. The method combines generative video models, contextual semantic analysis, and a user-controllable fine-editing interface. In evaluations involving twelve creators, it significantly enhanced narrative coherence and facilitated creative exploration, effectively bridging story discontinuities and expanding expressive freedom.

Technology Category

• Humans and AI: Game Design — Procedural Content Generation & Storytelling
• Computer Vision: Computational Photography, Image & Video Synthesis
• Cognitive Modeling & Cognitive Systems: Computational Creativity

Application Category

• Social Networks and Social Media: Generative AI / large language models and their impact on social systems
• Economics, Online Markets and Human Computation: Economic ramifications for generative AI infrastructure and applications
• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs

Abstract

Video storytelling is often constrained by available material, limiting creative expression and leaving undesired narrative gaps. Generative video offers a new way to address these limitations by augmenting captured media with tailored visuals. To explore this potential, we interviewed eight video creators to identify opportunities and challenges in integrating generative video into their workflows. Building on these insights and established filmmaking principles, we developed Vidmento, a tool for authoring hybrid video stories that combine captured and generated media through context-aware expansion. Vidmento surfaces opportunities for story development, generates clips that blend stylistically and narratively with surrounding media, and provides controls for refinement. In a study with 12 creators, Vidmento supported narrative development and exploration by systematically expanding initial materials with generative media, enabling expressive video storytelling aligned with creative intent. We highlight how creators bridge story gaps with generative content and where they find this blending capability most valuable.

Problem

• video storytelling
• narrative gaps
• generative video
• creative expression
• context-aware expansion

Innovation

• generative video
• context-aware expansion
• video storytelling
• hybrid media authoring
• narrative gap filling