🤖 AI Summary
This study addresses the fragmented workflow experienced by UI/UX designers due to the lack of seamless integration between paper-based and digital prototyping. Through semi-structured interviews with 19 professional designers and nine mixed reality (MR) concept probe experiments, the research systematically investigates how MR can bridge these two media to create a continuous, collaborative, and spatially anchored hybrid design environment. The work proposes four key dimensions for future MR design systems, revealing for the first time MR’s potential to reconcile the divide between analog sketching and digital prototyping. It further envisions innovative capabilities such as AI-augmented assistance, dynamic content synchronization, and unified artifact management. Findings indicate that MR significantly reduces manual reconstruction efforts, enables real-time cross-medium collaboration, and elicits strong designer enthusiasm for integrated MR authoring tools.
📝 Abstract
UI/UX designers work with both paper-based and digital artifacts but lack tools that seamlessly integrate the two. Mixed Reality (MR) offers under-explored opportunities to combine the strengths of both design environments. To examine these opportunities, we first conducted interviews with 19 professional UI/UX designers to understand their current experiences using paper and digital artifacts. Motivated and informed by the interview insights, we organized nine conceptual-probe user study sessions in which designers engaged with a MR-probe that combined paper and digital prototyping processes and brainstormed MR's potential in UI/UX design. We found that participants valued MR for enabling continuous hybrid design workflows, reducing manual reconstruction, supporting spatially anchored workspaces, and facilitating real-time cross-medium collaboration. They also envisioned future MR tools with AI assistance, richer interactive and dynamic content, and the ability to manage diverse design artifacts within a unified environment. From these findings, we derive four design dimensions for future MR systems that could enable more fluid, creative, and collaborative design practices.