The Moment of Capture: How the First Seconds of a Speaker's Nonverbal and Verbal Performance Shapes Audience Judgments

2026-02-27

AI Summary

This study investigates how observers rapidly form social impressions of speakers based solely on nonverbal behavior within the first few seconds of a presentation. By employing motion-capture–generated animations to isolate nonverbal cues from linguistic content and integrating continuous response measurement (CRM) for high temporal resolution, the research tracks the dynamic relationship between real-time audience engagement and final evaluations. The findings reveal, for the first time, that viewers can form dominant social judgments from nonverbal signals alone within five seconds, with these impressions stabilizing by ten seconds. Building on this, the study introduces the concept of a “capture moment” and presents the first high-temporal-resolution model of social impression formation, offering critical empirical foundations for AI-driven speech feedback systems and virtual avatar design.

Technology Category

• Cognitive Modeling & Cognitive Systems: Social Cognition And Interaction
• Computer Vision: Motion & Tracking
• Humans and AI: Interaction Techniques and Devices

Application Category

• User Modeling, Personalization and Recommendation: Metrics for user behavior and evaluating success
• Social Networks and Social Media: Generative AI / large language models and their impact on social systems
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics

Abstract

Why do some speakers capture a room almost instantly while others fail to connect? The real-time architecture of audience engagement remains largely a black box. Here, we used motion-captured animations to present the pure nonverbal performance of public speakers to audiences - either in silence (nonverbal-only) or paired with the verbal content (nonverbal-plus-verbal). Using continuous response measurement (CRM), we find that audience judgments solidify with remarkable speed: Moment-to-moment engagement ratings become highly predictive of subsequent evaluations within the initial 10 seconds of the performance. Most notably, this predictive relationship emerged faster and slightly stronger in the nonverbal-only condition, with predictive information being present already after less than 5 seconds. These findings elucidate the social impact a speaker's nonverbal performance has on audience impressions, even when dissociated from the verbal content of the speech. Our approach provides a high-resolution temporal map of social impression formation, pointing to an early"moment of capture"that appears to set the stage for the reception of the following message. On a broader scale, this research validates a powerful new method to isolate different communicative channels, to scientifically deconstruct rhetorical skill, and to study the pervasive impact of nonverbal behavior more broadly. It also enables us to translate the ancient art of rhetoric into a modern science of social impression formation, yielding an empirical basis that can inform human-centered feedback, develop AI-based augmentation tools, and guide the design of engaging, socially present avatars in an increasingly AI-mediated and virtual world.

Problem

• nonverbal behavior
• audience judgment
• impression formation
• public speaking
• social perception

Innovation

• nonverbal communication
• continuous response measurement
• motion-captured animation
• social impression formation
• moment of capture