Problem
Research questions and friction points this paper is trying to address.
agentic AI
edge-cloud continuum
energy cost
multi-agent workflows
5G-Advanced and 6G
Where Should Agents Live? Energy-Memory Characterization of Agentic AI for the Edge-Cloud Continuum
🤖 AI Summary
研究解决了边缘云连续体中代理AI的能效问题，通过引入agentic-eCAL指标来评估多代理工作流的能耗，从而优化代理位置。
📝 Abstract
As telecommunication networks evolve toward autonomous 5G-Advanced and 6G operations, agentic artificial intelligence (AI) workflows, where large language models (LLMs) execute multi-step reasoning, invoke diagnostic tools, retrieve domain knowledge, and coordinate across agent teams, are increasingly embedded across the edge-cloud continuum. While the biological brain accomplishes complex cognition on an exceptionally modest metabolic power budget of approximately 20W contemporary LLMs are profoundly energy- and memory-intensive, making sustainable lifecycle orchestration a critical operational priority. However, existing AI lifecycle metrics evaluate only isolated, single-model inferences or overlook multi-agent execution graphs entirely. Consequently, network operators lack foundational models to determine whether distributed agent communication incurs meaningful energy costs and where across edge-cloud tiers agent teams should physically reside. To address this gap, we introduce agentic-eCAL, generalizing the Energy Cost of AI Lifecycle (eCAL) metric to directed multi-agent workflows by coupling a closed-form two-rate single-call energy model (compute-bound prefill and memory-bound decode) with 7-layer OSI data transport. Grounded in hundreds of GPU benchmark configurations on NVIDIA A100 and H100, 16 open-weight models and 8 orchestration topologies, we validate components of the metric and study workflow placement implications. Our findings demonstrate that inter-agent text transport incurs 0.25% of workflow energy across 5G RAN, metro, and optical links. Therefore in edge-cloud agent placement the dominant energy cost of distribution is often not the transmission of inter-agent text itself, but the additional inference and context processing induced by that communication.
Innovation
Methods, ideas, or system contributions that make the work stand out.
agentic-eCAL
multi-agent workflows
energy cost of AI lifecycle
edge-cloud continuum
inter-agent communication
🔎 Similar Papers
No similar papers found.
