Multi-Agent Deep Reinforcement Learning based Collaborative Computation Offloading in Vehicular Edge Networks

Hao Wang, Huan Zhou, Liang Zhao, Xuxun Liu, Victor C.M. Leung

科研成果: 书/报告/会议事项章节会议稿件同行评审

1 引用 (Scopus)

摘要

Recently, to cope with the long communication distance and unreliability of cloud-based computing architectures, mobile edge computing has emerged as a solution with great promise. This pattern extends cloud-based services towards the vehicular edge network and enables vehicular tasks to be offloaded to intermediate Roadside Units (RSUs) directly. However, as more and more tasks are offloaded to RSUs, the computation capacity of a single RSU becomes insufficient. Without edge cooperation, overall resource utilization and effectiveness are prone to being underutilized. To address this issue, this paper investigates a collaborative computation offloading scheme where adjacent RSUs can process offloaded tasks collaboratively rather than individually. First, we explore a vehicular edge network where the bilateral synergy between RSUs is leveraged. In particular, we incorporate a price-based incentive mechanism into the resource allocation process to promote overall resource utilization. Second, considering the time-varying system conditions and uncertain resource requirements, the optimization problem is approximated as a Markov Decision Process (MDP) and extended to a multi-agent system. Finally, we propose a Multi-agent Deep deterministic policy gradient-based computation Offloading and resource Allocation scheme (MDOA) to solve the corresponding problem. Simulation results show that the proposed MDOA can not only achieve a higher long-term utility of RSUs but also have better performance than other baselines in different scenarios.

源语言英语
主期刊名Proceedings - 2023 IEEE 43rd International Conference on Distributed Computing Systems Workshops, ICDCSW 2023
出版商Institute of Electrical and Electronics Engineers Inc.
151-156
页数6
ISBN(电子版)9798350328127
DOI
出版状态已出版 - 2023
已对外发布
活动43rd IEEE International Conference on Distributed Computing Systems Workshops, ICDCSW 2023 - Hong Kong, 中国
期限: 18 7月 202321 7月 2023

出版系列

姓名Proceedings - 2023 IEEE 43rd International Conference on Distributed Computing Systems Workshops, ICDCSW 2023

会议

会议43rd IEEE International Conference on Distributed Computing Systems Workshops, ICDCSW 2023
国家/地区中国
Hong Kong
时期18/07/2321/07/23

指纹

探究 'Multi-Agent Deep Reinforcement Learning based Collaborative Computation Offloading in Vehicular Edge Networks' 的科研主题。它们共同构成独一无二的指纹。

引用此