Personalized Federated Contrastive Learning

Yupei Zhang, Yunan Xu, Shuangshuang Wei, Yifei Wang, Yuxin Li, Xuequn Shang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

This paper studies the problem of developing contrastive learning into the privacy-protected federated learning (FL), which is to achieve more data samples for model training. The existing methods usually encourage the global model and local models in FL to be the same one, often ignoring the data heterogeneity of the clients. In this paper, we proposed a method of personalized federated contrastive learning to improve the FL model performance for each client's task, by learning a global representation and a local representation simultaneously. Our method is a novel FL framework that borrows the scheme of contrastive learning (CL), where one CL branch is the global model while the other branch is the local model divided into a share part and a personalized part. The proposed model is then trained by maximizing the agreement between the global model and the sharing part of the local model and meanwhile minimizing the agreement between the global model and the personalized part. We conducted evaluations on three public datasets for federated image classification. The results show that the proposed method can benefit from the personalization of local models and thus achieve better accuracy in comparison with the state-of-the-art FL models.

Original languageEnglish
Title of host publicationProceedings - 2022 IEEE International Conference on Big Data, Big Data 2022
EditorsShusaku Tsumoto, Yukio Ohsawa, Lei Chen, Dirk Van den Poel, Xiaohua Hu, Yoichi Motomura, Takuya Takagi, Lingfei Wu, Ying Xie, Akihiro Abe, Vijay Raghavan
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages4218-4225
Number of pages8
ISBN (Electronic)9781665480451
DOIs
StatePublished - 2022
Event2022 IEEE International Conference on Big Data, Big Data 2022 - Osaka, Japan
Duration: 17 Dec 202220 Dec 2022

Publication series

NameProceedings - 2022 IEEE International Conference on Big Data, Big Data 2022

Conference

Conference2022 IEEE International Conference on Big Data, Big Data 2022
Country/TerritoryJapan
CityOsaka
Period17/12/2220/12/22

Keywords

  • Contrastive learning
  • Federated learning
  • Image classification
  • Personalization
  • Representation Learning

Fingerprint

Dive into the research topics of 'Personalized Federated Contrastive Learning'. Together they form a unique fingerprint.

Cite this