Why So Serious? Exploring Timely Humorous Comments in AAC Through AI-Powered Interfaces

2024-10-22

AI Summary

This study addresses the critical limitation of augmentative and alternative communication (AAC) devices—namely, their inability to convey humor and support real-time, socially contingent interactions. We conduct the first systematic investigation into “timely humor” in AAC, employing qualitative interviews and thematic analysis to identify five categories of expressive barriers and three patterns of temporal sensitivity in humorous exchanges. Based on these findings, we propose a user-centered framework for modeling humor timing and design a lightweight, embeddable AI interface paradigm for speech-generating devices (SGDs), integrating rule-based and template-driven text generation. In field-based user studies with individuals with speech impairments, four instantiated interfaces significantly improved both the success rate and naturalness of humor initiation, receiving strong endorsement from end users. Our work advances AAC systems toward socially intelligent, embodied, and affective human–machine collaboration.

Technology Category

• Humans and AI: Interaction Techniques and Devices
• Cognitive Modeling & Cognitive Systems: Affective Computing
• Intelligent Robots: Human-Robot Interaction

Application Category

• Search and Retrieval-Augmented AI: Assisted, interactive, and conversational search
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions
• Social Networks and Social Media: Generative AI / large language models and their impact on social systems

Abstract

People with disabilities that affect their speech, often use speech-generating devices (SGD), commonly referred to as Augmentative and Alternative Communication (AAC) technology. This technology enables practical conversation; however, there has been a growing interest in extending AAC to support more expressive forms of conversation such as humor. In this paper, we study how to extend AAC technology to support a subset of humorous expression: delivering timely humorous comments -- witty remarks -- through AI-powered interfaces. We conducted seven qualitative interviews with AAC users and performed thematic analysis to gain in-depth insights about their experiences and challenges with AAC technology, and the role humor plays for them. We developed four simple AI-powered interfaces designed to support users in creating timely humorous comments during real-time conversations. Through a user study with five AAC users, we explored how to effectively support the delivery of well-timed humorous remarks. We conclude with a discussion of recommendations for interface design based on both studies.

Problem

• AAC Devices
• Humor Incorporation
• Real-time Conversation

Innovation

• Artificial Intelligence
• Augmentative and Alternative Communication
• Humor Interaction