Of Affordance Opportunism in AR: Its Fallacies and Discussing Ways Forward

2025-03-26

AI Summary

This paper identifies four cognitive fallacies in augmented reality (AR) arising from the misuse of ecological affordances: subjective projection, prescriptive design, neglect of environmental dynamics, and inappropriate photorealistic mimicry—leading to user confusion and degraded experience. Drawing on Gibson’s ecological psychology and human–computer interaction theory, we conduct critical case analysis and conceptual modeling to systematically identify and define these opportunistic design biases for the first time. We then propose a reflective design framework centered on three core principles: perceptibility, cross-reality fit, and environmental sensitivity. This framework advances AR interaction design beyond intuition-driven “use-as-available” practices toward rigorous, context-aware affordance mapping. The work delivers theoretical caution for academia and actionable design guidelines—including concrete mitigation strategies—for industry practitioners.

Technology Category

• Cognitive Modeling & Cognitive Systems: Affective Computing
• Humans and AI: Game Design — Virtual Humans, NPCs and Autonomous Characters
• Knowledge Representation and Reasoning: Argumentation

Application Category

• User Modeling, Personalization and Recommendation: Accountability, Transparency, and Ethics for personalization
• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Search and Retrieval-Augmented AI: Assisted, interactive, and conversational search

Abstract

This position paper addresses the fallacies associated with the improper use of affordances in the opportunistic design of augmented reality (AR) applications. While opportunistic design leverages existing physical affordances for content placement and for creating tangible feedback in AR environments, their misuse can lead to confusion, errors, and poor user experiences. The paper emphasizes the importance of perceptible affordances and properly mapping virtual controls to appropriate physical features in AR applications by critically reflecting on four fallacies of facilitating affordances, namely, the subjectiveness of affordances, affordance imposition and reappropriation, properties and dynamicity of environments, and mimicking the real world. By highlighting these potential pitfalls and proposing a possible path forward, we aim to raise awareness and encourage more deliberate and thoughtful use of affordances in the design of AR applications.

Problem

• Addresses fallacies in AR affordance misuse
• Highlights poor user experiences from improper design
• Proposes solutions for better affordance mapping in AR

Innovation

• Critically reflects on four affordance fallacies
• Emphasizes perceptible affordances in AR
• Proposes deliberate affordance use in AR