LogoMotion: Visually-Grounded Code Synthesis for Creating and Editing Animation

2024-05-11

AI Summary

To address the challenge novice users face in creating semantically coherent logo animations, this paper introduces VisuLogo—a vision-anchored framework for code synthesis and program repair. Methodologically, it integrates visual understanding, design-concept instantiation, and closed-loop visual verification, establishing the first “vision → code → animation → vision” bidirectional feedback paradigm. It incorporates a code-connected AI editor enabling intuitive, controllable, and iterative adjustments of motion, grouping, and timeline properties. Technically, it unifies program synthesis, constraint-based program repair, and bidirectional code–animation binding. In comparative evaluations across 276 animations, VisuLogo achieves significantly higher content-awareness than state-of-the-art tools. A user study (n=16) demonstrates substantial improvements in editing efficiency, control precision, and creative expressiveness.

Technology Category

• Computer Vision: Visual Reasoning & Symbolic Representations
• Natural Language Processing: Code Generation / Program Synthesis from Natural Language
• Humans and AI: Human-Aware Planning and Behavior Prediction

Application Category

• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
• Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphs
• Web Mining and Content Analysis: Web data visualization

Abstract

Creating animation takes time, effort, and technical expertise. To help novices with animation, we present LogoMotion, an AI code generation approach that helps users create semantically meaningful animation for logos. LogoMotion automatically generates animation code with a method called visually-grounded code synthesis and program repair. This method performs visual analysis, instantiates a design concept, and conducts visual checking to generate animation code. LogoMotion provides novices with code-connected AI editing widgets that help them edit the motion, grouping, and timing of their animation. In a comparison study on 276 animations, LogoMotion was found to produce more content-aware animation than an industry-leading tool. In a user evaluation (n=16) comparing against a prompt-only baseline, these code-connected widgets helped users edit animations with control, iteration, and creative expression.

Problem

• AI-assisted logo animation creation
• Visually-grounded code synthesis method
• Code-connected AI editing widgets

Innovation

• Visually-grounded code synthesis
• AI code generation
• Code-connected AI editing