A Multi-agent Reinforcement Learning based Offloading Strategy for Multi-access Edge Computing

Li Ma, Haobin Shi, Jingchen Li, Kao Shing Hwang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

As a front-end distributed computing paradigm, Multi-access edge computing (MEC) requires an efficient offloading strategy in the case of computation-intensive tasks. Traditional heuristic and reinforcement learning-based methods are limited by the number of edge serves. In this work, the task offloading in MEC is regarded as a multi-agent reinforcement learning (MARL) scenario, and an end-to-end model is developed to train the offloading strategy. The proposal is a decentralized framework, which is consistent with the edge computing servers. We fully consider the state sequences for edge servers and limited communication abilities, proposing a recurrent neural network as the communication module. Using a gating mechanism, we design a dual-recurrent network for combining the state sequences and historical communication results. Several experiments show that our method can achieve low latency and distributed data processing, and it outperforms heuristic methods and other reinforcement learning-based frameworks.

Original languageEnglish
Title of host publication2021 International Automatic Control Conference, CACS 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665444125
DOIs
StatePublished - 2021
Event2021 International Automatic Control Conference, CACS 2021 - Chiayi, Taiwan, Province of China
Duration: 3 Nov 20216 Nov 2021

Publication series

Name2021 International Automatic Control Conference, CACS 2021

Conference

Conference2021 International Automatic Control Conference, CACS 2021
Country/TerritoryTaiwan, Province of China
CityChiayi
Period3/11/216/11/21

Keywords

  • Edge computing
  • Multi-agent reinforcement learning
  • Reinforcement learning

Fingerprint

Dive into the research topics of 'A Multi-agent Reinforcement Learning based Offloading Strategy for Multi-access Edge Computing'. Together they form a unique fingerprint.

Cite this