MultiVerse: A Creator-Centered Approach to Steering Context-Adaptive Lyrics

2026-08-19

AI Summary

本文提出MultiVerse系统，通过创作者中心的方法解决AI生成歌词时忽视艺术家意图的问题，允许创作者根据意图和听众情境自定义控制规则。

Abstract

Generative AI may enable new forms of context-aware creative expression by dynamically tailoring media content to its consumption context. For instance, AI systems could adapt song lyrics to the listener and their current activity. However, existing media adaptation systems primarily optimize for audience experience, often neglecting artists' intent, style, and preference. We address this challenge by introducing a novel creator-centered approach to adaptive media authoring and present MultiVerse, a system that instantiates this approach for steering adaptive lyrics. Our approach allows creators to explicitly author controls based on their intent, lyric structure, and audience context, and uses rule-based validations to ensure controls are followed. We conducted a study with 10 songwriters, comparing MultiVerse with a prompting-based workflow for composing adaptive lyrics. The comparison revealed that creators preferred to author how lyrics adapt by explicitly specifying relevant context and adaptation constraints, while recognizing trade-offs in flexibility and iteration speed. Interviews further revealed that creators viewed adaptive media as enabling new forms of audience connection, introducing a distinct creative process, favoring new compositional strategies, and reshaping notions of authorship.

Problem

• context-aware
• creative expression
• artist intent
• adaptive lyrics
• media adaptation

Innovation

• creator-centered approach
• context-adaptive lyrics
• rule-based validations