🤖 AI Summary
This work addresses the challenge of optimal power allocation in stochastic wireless networks without requiring an accurate system model. By formulating resource scheduling as a Markov decision process, the authors employ a deep Q-network (DQN) to learn an adaptive power control policy directly from observed channel states. As the first model-free approach leveraging deep reinforcement learning to achieve performance close to the theoretical optimum, the proposed method attains a system throughput of 3.88 Mbps—nearly matching the water-filling algorithm’s upper bound—and improves upon random and fixed allocation strategies by 73% and 27%, respectively. Moreover, the solution maintains high fairness and energy efficiency, achieving a Jain’s fairness index of 0.91.
📝 Abstract
This study addresses the challenge of optimal power allocation in stochastic wireless networks by employing a Deep Reinforcement Learning (DRL) framework. Specifically, we design a Deep Q-Network (DQN) agent capable of learning adaptive power control policies directly from channel state observations, effectively bypassing the need for explicit system models. We formulate the resource allocation problem as a Markov Decision Process (MDP) and benchmark the proposed approach against classical heuristics, including fixed allocation, random assignment, and the theoretical water-filling algorithm. Empirical results demonstrate that the DQN agent achieves a system throughput of 3.88 Mbps, effectively matching the upper limit of the water fill, while outperforming the random and fixed allocation strategies by approximately 73% and 27%, respectively. Moreover, the agent exhibits emergent fairness, maintaining a Jain's Index of 0.91, and successfully optimizes the trade-off between spectral efficiency and energy consumption. These findings substantiate the efficacy of model-free DRL as a robust and scalable solution for resource management in next-generation communication systems.