Container Workload Prediction Using Deep Domain Adaptation in Transfer Learning

Yunlan Wang, Yutong Liu, Tianhai Zhao, Mingxuan Liu, Jianhua Gu, Zhengxiong Hou, Chengwen Zhong

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Containers are the primary deployment method for cloud applications, and accurate workload prediction is essential for resource allocation and energy optimization. Traditional statistical models struggle to capture complex workload variations, while classical neural network models require extensive historical data, which is challenging due to containers’ short lifespan. This paper proposes a container workload prediction model based on deep domain adaptation in transfer learning (CWPDDA). The model includes a feature extractor with self-attention and cross-attention mechanisms to extract private and shared features, a domain adversarial adapter to reduce distribution differences, and a workload predictor to directly apply source-target data for prediction, avoiding performance degradation from domain shift. To validate the accuracy of the proposed model, this study utilized the Alibaba cluster-trace-v2017 dataset as the target domain and the Google cluster-usage traces v3 dataset as the source domain. Experimental results showed that the proposed model achieved a substantial improvement in prediction accuracy compared to the Autoregressive Integrated Moving Average (ARIMA), Long Short-Term Memory (LSTM), Autoregressive Recurrent Neural Network (DeepAR), Deep Renewal Processes (DRP), and Multivariate Quantile Function Forecaster (MQF2) models.

Original languageEnglish
Title of host publicationEuro-Par 2025
Subtitle of host publicationParallel Processing - 31st European Conference on Parallel and Distributed Processing, 2025, Proceedings
EditorsWolfgang E. Nagel, Diana Goehringer, Pedro C. Diniz
PublisherSpringer Science and Business Media Deutschland GmbH
Pages322-336
Number of pages15
ISBN (Print)9783031998539
DOIs
StatePublished - 2026
Event31st European Conference on Parallel and Distributed Processing, Euro-Par 2025 - Dresden, Germany
Duration: 25 Apr 202529 Apr 2025

Publication series

NameLecture Notes in Computer Science
Volume15900 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference31st European Conference on Parallel and Distributed Processing, Euro-Par 2025
Country/TerritoryGermany
CityDresden
Period25/04/2529/04/25

Keywords

  • Docker containers
  • deep domain adaptation
  • transfer learning
  • workload prediction

Fingerprint

Dive into the research topics of 'Container Workload Prediction Using Deep Domain Adaptation in Transfer Learning'. Together they form a unique fingerprint.

Cite this