🤖 AI Summary
In high-density Wi-Fi scenarios, the Distributed Coordination Function (DCF) suffers from severe throughput degradation and increased latency due to user proliferation. To address this, we propose D3PG—a novel reinforcement learning framework for Wi-Fi MAC-layer control that integrates Generative Diffusion Models (GDMs) with Deterministic Policy Gradient (DPG) optimization. D3PG jointly adapts the contention window size and frame aggregation length, leveraging GDMs’ capability to model non-stationary channel dynamics and DPG’s stability in policy optimization. Evaluated in NS-3 dense-network simulations against IEEE 802.11ac/ax baselines, D3PG achieves a 42% throughput gain and a 37% reduction in end-to-end latency, while demonstrating strong scalability and robustness. Its core innovation lies in being the first to apply GDMs to joint MAC-parameter control—overcoming two fundamental limitations of conventional RL approaches: inadequate modeling of time-varying wireless channels and poor policy convergence under non-stationarity.
📝 Abstract
Generative Diffusion Models (GDMs), have made significant strides in modeling complex data distributions across diverse domains. Meanwhile, Deep Reinforcement Learning (DRL) has demonstrated substantial improvements in optimizing Wi-Fi network performance. Wi-Fi optimization problems are highly challenging to model mathematically, and DRL methods can bypass complex mathematical modeling, while GDMs excel in handling complex data modeling. Therefore, combining DRL with GDMs can mutually enhance their capabilities. The current MAC layer access mechanism in Wi-Fi networks is the Distributed Coordination Function (DCF), which dramatically decreases in performance with a high number of terminals. In this study, we propose the Deep Diffusion Deterministic Policy Gradient (D3PG) algorithm, which integrates diffusion models with the Deep Deterministic Policy Gradient (DDPG) framework to optimize Wi-Fi network performance. To the best of our knowledge, this is the first work to apply such an integration in Wi-Fi performance optimization. We propose an access mechanism that jointly adjusts the contention window and the aggregation frame length based on the D3PG algorithm. Through simulations, we have demonstrated that this mechanism significantly outperforms existing Wi-Fi standards in dense Wi-Fi scenarios, maintaining performance even as the number of users increases sharply.