Trace2Tower: Transition-Aware EigenTrace Induction of Multi-Level Skills for LLM Agents

2026-09-04

AI Summary

针对大语言模型代理在执行复杂任务时的瓶颈，提出Trace2Tower框架，通过转换感知和对比谱分解方法构建技能层次结构，提高任务成功率。

Abstract

Large language model agents increasingly rely on execution traces to master complex interactive tasks. However, current paradigms are bottlenecked by shallow trajectory retrieval and flat skill summarization, fundamentally ignoring the temporal dependencies and outcome-conditioned topology of agent behavior. We introduce Trace2Tower, a transition-aware EigenTrace framework that distills raw trajectories into a robust skill hierarchy. Trace2Tower abstracts step-level interactions into canonical events, constructing a unified graph governed by semantic compatibility, transition dynamics, and outcome evidence. Through a novel contrastive spectral decomposition, it isolates stable, success-aligned behavioral modes while rigorously suppressing failure-prone shortcuts. These modes organically populate a dynamic skill tower of action templates, procedural routines, and overarching task strategies, continuously refined via verifier-guided feedback. On ALFWorld, Trace2Tower achieves 87.31% success requiring only 10.35 steps and 0.26 invalid actions; on WebShop, it reaches 50.67% exact success. Across both benchmarks, Trace2Tower significantly outperforms existing baselines in task mastery and context-efficient experience reuse.

Problem

• execution traces
• shallow trajectory retrieval
• flat skill summarization
• temporal dependencies
• outcome-conditioned topology

Innovation

• transition-aware
• EigenTrace
• contrastive spectral decomposition
• skill hierarchy
• verifier-guided feedback