Behavior Quotient Learning for Low-Rank Adaptation of LLM Agents

2026-09-11

AI Summary

论文提出BQ-LoRA框架，通过行为商数平衡和决策保持压缩解决LLM代理在低秩适应中存储需求大及更新冗余问题。

Abstract

LLM-based agents rely on heterogeneous interaction capabilities to accomplish complex tasks. Existing approaches often distribute these capabilities across multiple LoRA adapters, which increases adapter storage requirements and introduces routing overhead during inference. A single LoRA avoids this overhead, but learning from diverse agent trajectories under a fixed rank budget presents two challenges. First, trajectories with different interaction traces and parameter gradients can induce equivalent changes in decision distributions, causing repeated updates to overemphasize redundant behavioral changes. Second, an aggregated update may exceed the rank budget of the adapter, and approximating it in weight space can distort the decision changes that it is intended to produce. We propose BQ-LoRA, a low-rank adaptation framework that organizes trajectory updates through a local behavior quotient manifold. It contains two modules, i.e., behavior quotient balancing (BQB) and decision preserving compression (DPC). BQB constructs the quotient manifold from decision distributions and reweights trajectory update directions according to their local density in the quotient tangent space. DPC projects the balanced gradient onto the intrinsic fixed rank tangent space and refactorizes the resulting target by jointly controlling effective weight error and distortion of decision distributions. Experiments on AppWorld and BrowseComp-Plus compare BQ-LoRA with standard LoRA and recent low-rank adaptation methods, while separate ablations evaluate the complementary contributions of both components.

Problem

• Behavior Quotient
• Low-Rank Adaptation
• LLM Agents
• Trajectory Learning
• Rank Budget

Innovation

• Behavior Quotient Learning
• Low-Rank Adaptation
• Decision Preserving Compression
• Behavior Quotient Balancing