Game-Combined Multi-Agent DRL for Tasks Offloading in Wireless Powered MEC Networks

Ang Gao, Shuai Zhang, Yansu Hu, Wei Liang, Soon Xin Ng

科研成果: 期刊稿件文章同行评审

26 引用 (Scopus)

摘要

Wireless powered mobile edge computing (MEC) networks have been envisaged as a promising technology to ensure the ultra-low-power requirement and enhance the continuous work capacity of wireless devices (WDs). However, when multiple WDs coexist in the network, it is non-trivial to minimize the total tasks delay since the optimization variables are intrinsically coupled. Even more, channels are dynamically varying from time to time and the tasks are unpredictable, which aggravates the difficulty to obtain the closed-form solution. This paper considers a challenging hybrid tasks offloading scenario, where offloading tasks can be partially executed locally and remotely in parallel, and each WD is endowed to take both the active RF-transmission and passive backscatter communication (BackCom) for remote tasks offloading. Furthermore, a game-combined multi-agent deep deterministic policy gradient (MADDPG) algorithm is proposed to minimize the total tasks delay with the fairness consideration of multiple WDs, i.e., potential game for offloading decision and MADDPG for time scheduling and harvested energy splitting. Equipped with the feature of 'centralized training with decentralized execution', once well trained, each agent in MADDPG can figure out the proper time scheduling and harvested energy splitting independently without sharing information with others. Besides the unilateral contention among WDs for the offloading decision by potential game, a fully decentralized framework is finally designed for the proposed algorithm. Numerical results demonstrate that the game-combined MADDPG algorithm can achieve the near-optimal performance compared with existing centralized approaches, and reduce the convergence time compared with other no-game learning approaches.

源语言英语
页(从-至)9131-9144
页数14
期刊IEEE Transactions on Vehicular Technology
72
7
DOI
出版状态已出版 - 1 7月 2023

指纹

探究 'Game-Combined Multi-Agent DRL for Tasks Offloading in Wireless Powered MEC Networks' 的科研主题。它们共同构成独一无二的指纹。

引用此