Federated Distributed Deep Reinforcement Learning for Recommendation-enabled Edge Caching

Hao Wang, Huan Zhou, Mingze Lit, Liang Zhao, Victor C.M. Leung

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Scopus citations

Abstract

This paper investigates a content recommendation-based edge caching method in multi-tier edge-cloud networks while considering content delivery and cache replacement decisions as well as bandwidth allocation strategies. First, we formu-late the optimization problem with the goal of minimizing long-term content delivery delay. Second, we model the optimization problem as a Partially Observable Markov Decision Process, and propose a Federated Distributed Deep Deterministic Policy Gradient-based method (FD3PG) to solve the corresponding problem. In conclusion, simulation results demonstrate that the proposed FD3PG achieves not only a much lower content delivery delay but also a higher cache hit rate compared with other baselines in various scenarios.

Original languageEnglish
Title of host publicationIEEE INFOCOM 2024 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350384475
DOIs
StatePublished - 2024
Event2024 IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2024 - Vancouver, Canada
Duration: 20 May 2024 → …

Publication series

NameIEEE INFOCOM 2024 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2024

Conference

Conference2024 IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2024
Country/TerritoryCanada
CityVancouver
Period20/05/24 → …

Keywords

  • content recommendation
  • deep reinforcement learning
  • dis-tributed training
  • edge caching
  • federated learning

Fingerprint

Dive into the research topics of 'Federated Distributed Deep Reinforcement Learning for Recommendation-enabled Edge Caching'. Together they form a unique fingerprint.

Cite this