Engagement Process: Rethinking the Temporal Interface of Action and Observation

2026-05-12

AI Summary

Traditional agent models are constrained by synchronous action–observation interfaces operating at fixed time steps, making it difficult to capture the asynchronous, multi-scale temporal interactions prevalent in real-world environments. This work proposes the Engagement Process (EP) framework, which decouples actions and observations into independent temporal event streams while preserving the theoretical foundations of POMDPs, thereby explicitly incorporating time as a first-class dimension. The framework naturally supports modeling complex behaviors such as delayed feedback, continuous actions, multi-rate coordination, and compositional interactions among subsystems. Empirical evaluations demonstrate that EP effectively uncovers temporal dynamics obscured by conventional step-based interfaces across toy tasks, large language model agents, and learning scenarios, enabling efficient policy adaptation under explicit time-cost constraints.

Abstract

Task completion in digital and physical environments increasingly involves complex temporal interaction, where actions and observations unfold over different time scales rather than align with fixed observation--action steps. To model such interactions, we propose \emph{Engagement Process} (EP), an interaction formalism that inherits the decision-theoretic structure of POMDPs while making time explicit in the action--observation interface. EP represents actions and observations as decoupled event streams along time, rather than updates paired at fixed decision steps. This interface captures single-agent timing issues such as deliberation latency, delayed feedback, and persistent actions, while supporting richer agent-side organization, multi-rate coordination, and compositional interaction among subsystems. Across toy, LLM-agent, and learning experiments, EP exposes temporal behaviors hidden by step-based interfaces and enables policies to adapt under explicit time costs.

Problem

• temporal interaction
• action-observation interface
• time scales
• delayed feedback
• persistent actions

Innovation

• Engagement Process
• temporal interaction
• decoupled event streams
• time-aware decision making
• multi-rate coordination