Delegating or Doing? Understanding User Behavior in Hybrid Human-Agent Interfaces

2026-08-19

AI Summary

研究通过对比传统、AI优先和混合三种模式下用户在嵌入LLM的内容管理系统中的行为，发现AI辅助主要减少了交互努力而非提高速度，并且用户的委托行为更多取决于个人差异。

Abstract

Large Language Models (LLMs) are increasingly embedded into applications, allowing users to complete tasks either through direct manipulation or by delegating actions to conversational agents. However, little is known about how users balance these modalities when both are available. We present a web-based content management system augmented with an LLM agent through the Model Context Protocol (MCP), enabling users to perform CRUD tasks through a graphical interface, a conversational agent, or both. We conducted a between-subjects study (N=73) comparing three interaction modes: Traditional-Only, AI-First, and Hybrid. Across sixteen scenarios, we analyzed task completion time, interaction logs, and delegation behavior. AI-assisted interaction significantly reduced clicks, page navigations, and scrolling indicating lower interaction effort. Surprisingly, these reductions did not translate into faster task completion, as task duration did not differ significantly across conditions. We also found no significant relationship between CRUD operation type and delegation, suggesting that users did not systematically avoid delegating higher-risk actions. Instead, delegation varied far more between participants than between tasks, with individual differences accounting for roughly half the variance in assistant use (ICC = .50). Our findings suggest that the primary benefit of human--agent interfaces may be reducing interaction effort rather than improving speed, and that delegation reflects who the user is more than what the task demands.

Problem

• User Behavior
• Hybrid Human-Agent Interfaces
• Delegation

Innovation

• Model Context Protocol
• Large Language Models
• Hybrid Interaction
• User Delegation Behavior
• Interaction Effort