GlyphWeaver: Unlocking Glyph Design Creativity with Uniform Glyph DSL and AI

2025-09-10

AI Summary

To address the high barrier to custom glyph visualization for designers lacking programming expertise, this paper proposes a low-code glyph design framework. Methodologically, it (1) introduces a hierarchical, composable Glyph Domain-Specific Language (GDSL) enabling semantic glyph modeling; (2) designs an atomic operation management mechanism that unifies natural language commands, direct drag-and-drop interaction, and parameter tuning in a multimodal interface; and (3) integrates a multimodal large language model to drive semantic parsing and glyph generation. This framework achieves, for the first time, high-quality glyph visualization without any coding. A user study (n=13) demonstrates significant improvements: average task completion time reduced by 72%, enhanced creative expressiveness, and complex glyph generation accomplished within minutes by non-programmer designers.

Technology Category

• Natural Language Processing: Code Generation / Program Synthesis from Natural Language
• Cognitive Modeling & Cognitive Systems: Computational Creativity
• Humans and AI: Game Design — Procedural Content Generation & Storytelling

Application Category

• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions
• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Economics, Online Markets and Human Computation: Economic aspects and information design of Web, GenAI, and cloud computing

Abstract

Expressive glyph visualizations provide a powerful and versatile means to represent complex multivariate data through compact visual encodings, but creating custom glyphs remains challenging due to the gap between design creativity and technical implementation. We present GlyphWeaver, a novel interactive system to enable an easy creation of expressive glyph visualizations. Our system comprises three key components: a glyph domain-specific language (GDSL), a GDSL operation management mechanism, and a multimodal interaction interface. The GDSL is a hierarchical container model, where each container is independent and composable, providing a rigorous yet practical foundation for complex glyph visualizations. The operation management mechanism restricts modifications of the GDSL to atomic operations, making it accessible without requiring direct coding. The multimodal interaction interface enables direct manipulation, natural language commands, and parameter adjustments. A multimodal large language model acts as a translator, converting these inputs into GDSL operations. GlyphWeaver significantly lowers the barrier for designers, who often do not have extensive programming skills, to create sophisticated glyph visualizations. A case study and user interviews with 13 participants confirm its substantial gains in design efficiency and effectiveness of producing creative glyph visualizations.

Problem

• Bridging design creativity and technical implementation for glyphs
• Lowering barrier for non-programmers to create glyph visualizations
• Enabling easy creation of expressive multivariate data glyphs

Innovation

• Hierarchical container model DSL
• Atomic operation management mechanism
• Multimodal LLM translation interface