🤖 AI Summary
Existing human-agent collaboration often relies on users’ reactive interventions to an agent’s immediate actions, lacking foresight into long-term consequences and thereby imposing heavy cognitive loads and limiting effectiveness. This work proposes a “simulation-in-the-loop” interaction paradigm that enables proactive, exploratory decision-making by generating and examining simulated future trajectories prior to action execution. Leveraging large language models to drive agent behavior, the approach integrates contextualized trajectory simulation with an interactive framework, shifting collaboration from passive reaction to anticipatory co-exploration. This allows users to uncover implicit constraints and preferences during the decision process. We formulate a conceptual framework for simulation-driven collaboration and demonstrate through multi-scenario examples its efficacy in enhancing both decision quality and users’ cognitive efficiency.
📝 Abstract
Large Language Models (LLMs) are increasingly used to power autonomous agents for complex, multi-step tasks. However, human-agent interaction remains pointwise and reactive: users approve or correct individual actions to mitigate immediate risks, without visibility into subsequent consequences. This forces users to mentally simulate long-term effects, a cognitively demanding and often inaccurate process. Users have control over individual steps but lack the foresight to make informed decisions. We argue that effective collaboration requires foresight, not just control. We propose simulation-in-the-loop, an interaction paradigm that enables users and agents to explore simulated future trajectories before committing to decisions. Simulation transforms intervention from reactive guesswork into informed exploration, while helping users discover latent constraints and preferences along the way. This perspective paper characterizes the limitations of current paradigms, introduces a conceptual framework for simulation-based collaboration, and illustrates its potential through concrete human-agent collaboration scenarios.