As Content and Layout Co-Evolve: TangibleSite for Scaffolding Blind People's Webpage Design through Multimodal Interaction

2026-02-22

AI Summary

This study addresses the challenge blind web designers face in synchronously coordinating content and layout, which often results in inconsistent visual structures. To overcome this barrier, the authors conducted two rounds of co-design and introduced the core concept of “co-evolution of content and layout.” They developed TangibleSite, a multimodal authoring tool that integrates tangible interaction, auditory cues, and speech feedback to provide real-time, context-aware support during web construction. A formative evaluation with six blind participants demonstrated that users could independently create webpages using TangibleSite, effectively achieving synergistic optimization of content and layout and substantially reducing the obstacles to attaining visual consistency.

Technology Category

• Humans and AI: Interaction Techniques and Devices
• Cognitive Modeling & Cognitive Systems: Adaptive Behavior
• Search and Optimization: Other Foundations of Search & Optimization

Application Category

• Web Mining and Content Analysis: Models for Web evolution
• Responsible Web: Algorithmic accountability and transparency on the web
• Economics, Online Markets and Human Computation: Incentives in network design for Web infrastructures and ecosystems

Abstract

Creating webpages requires generating content and arranging layout while iteratively refining both to achieve a coherent design, a process that can be challenging for blind individuals. To understand how blind designers navigate this process, we conducted two rounds of co-design sessions with blind participants, using design probes to elicit their strategies and support needs. Our findings reveal a preference for content and layout to co-evolve, but this process requires external support through cues that situate local elements within the broader page structure as well as multimodal interactions. Building on these insights, we developed TangibleSite, an accessible web design tool that provides real-time multimodal feedback through tangible, auditory, and speech-based interactions. TangibleSite enables blind individuals to create, edit, and reposition webpage elements while integrating content and layout decisions. A formative evaluation with six blind participants demonstrated that TangibleSite enabled independent webpage creation, supported refinement across content and layout, and reduced barriers to achieving visually consistent designs.

Problem

• webpage design
• blind users
• content and layout co-evolution
• accessibility
• multimodal interaction

Innovation

• multimodal interaction
• tangible interface
• accessible web design
• co-evolution of content and layout
• blind users