A Schema Bounded Language Model for Refining Robot Policies Without Destabilizing Local Learning

📅 2026-09-04
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文针对异构机器人在不同更新层级下导航的问题,提出了一种结合大语言模型、UCB算法和双深度Q网络的方法,并通过实验验证了其有效性。
📝 Abstract
This paper addresses navigation by composite heterogeneous robots in a decentralized system when policy reasoning and local control operate at different update levels. In a NetLogo--Python implementation, three robots share motion dynamics but use different LLM backends. Each robot independently combines a large language model (LLM) policy agent, an Upper Confidence Bound (UCB) bandit, and a Double Deep Q-Network (Double DQN) controller; no central LLM generates team actions. LLM inference is confined to round-level policy generation and refinement rather than tick-level action selection. The robots perform cross-LLM communication through a shared round summary containing policies, outcomes, and learning feedback. UCB performs refinement-mode selection, and the policy-conditioned Double DQN performs tick-level action selection from navigation variables, active policy parameters, and the LLM action prior. Each of the four configurations was evaluated over 30 rounds. In the fixed simulation, the complete configuration reached the goal in all 90 correlated robot--round records and achieved the lowest median completion time (42 ticks) and P90 (73.2 ticks); its median was 25.0--39.1\% lower than those of the other configurations. These observations provide descriptive, configuration-level evidence from the evaluated configurations.
Problem

Research questions and friction points this paper is trying to address.

navigation
composite heterogeneous robots
decentralized system
policy reasoning
local control
Innovation

Methods, ideas, or system contributions that make the work stand out.

Schema Bounded Language Model
LLM Policy Agent
Cross-LLM Communication
Upper Confidence Bound Bandit
Double DQN Controller
C
Chongwen Dong
Department of Mechanical Engineering, Northern Arizona University
M
Mithun Paul Saint-Germain
School of Informatics, Computing, and Cyber Systems, Northern Arizona University
P
Pinjari Asif
School of Informatics, Computing, and Cyber Systems, Northern Arizona University
C
Carlo R. daCunha
Helen and John C. Hartmann Department of Electrical Engineering and School of Applied Engineering and Technology, New Jersey Institute of Technology