LLM-Powered Predictive Decision-Making for Sustainable Data Center Operations

2026-08-18

AI Summary

本文提出了一种基于大型语言模型的预测调度系统，用于优化数据中心的能源消耗和排队延迟，从而提高可持续性。通过与数据中心合作，实现了32%的能耗减少和30%的等待时间缩短。

Abstract

The growing demand for AI-driven workloads, particularly from Large Language Models (LLMs), has raised concerns about the significant energy and resource consumption in data centers. This work introduces a novel LLM-based predictive scheduling system designed to enhance operational efficiency while reducing the environmental impact of data centers. Our system utilizes an LLM to predict key metrics such as execution time and energy consumption from source code, and it has the potential to extend to other sustainability-focused metrics like water usage for cooling and carbon emissions, provided the data center can track such data. The predictive model is followed by a real-time scheduling algorithm that allocates GPU resources, aiming to improve sustainability by optimizing both energy consumption and queuing delays. With fast inference times, the ability to generalize across diverse task types, and minimal data requirements for training, our approach offers a practical solution for data center scheduling. This framework demonstrates strong potential for advancing sustainability objectives in AI-driven infrastructure. Through our collaboration with a data center, we achieved a 32% reduction in energy consumption and a 30% decrease in waiting time.

Problem

• Large Language Models
• Data Centers
• Energy Consumption
• Sustainability
• Operational Efficiency

Innovation

• LLM-based predictive scheduling
• sustainability in data centers
• real-time scheduling algorithm
• energy consumption reduction