Skip to main navigation Skip to search Skip to main content

DETER: Streaming Graph Partitioning via Combined Degree and Cluster Information

  • Cong Hu
  • , Jiang Zhong
  • , Qi Li
  • , Qing Li
  • Chongqing University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Scopus citations

Abstract

Efficient graph partitioning plays an important role in distributed graph processing systems with the rapid growth of the scale of graph data. The quality of partitioning affects the performance of systems greatly. However, most existing vertex-cut graph partitioning algorithms only focused on degree information and ignored the cluster information of a coming edge when assigning edges. It is beneficial to assign an edge to a partition with more neighbors because keeping a dense subgraph in one partition would reduce the communication cost. In this paper, we propose DETER, an efficient vertex-cut streaming graph partitioning algorithm that takes both degree and cluster information into account when assigning an edge to one partition. Our evaluations suggest that DETER algorithm owns the ability to efficiently partition large graphs and reduce communication cost significantly compared to state-of-the-art graph partitioning algorithms.

Original languageEnglish
Title of host publicationAlgorithms and Architectures for Parallel Processing - 19th International Conference, ICA3PP 2019, Proceedings
EditorsSheng Wen, Albert Zomaya, Laurence T. Yang
PublisherSpringer
Pages242-255
Number of pages14
ISBN (Print)9783030389901
DOIs
StatePublished - 2020
Externally publishedYes
Event19th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2019 - Melbourne, Australia
Duration: 9 Dec 201911 Dec 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11944 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference19th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2019
Country/TerritoryAustralia
CityMelbourne
Period9/12/1911/12/19

Keywords

  • Distributed graph computing
  • Graph partitioning
  • Streaming
  • Vertex-cut

Fingerprint

Dive into the research topics of 'DETER: Streaming Graph Partitioning via Combined Degree and Cluster Information'. Together they form a unique fingerprint.

Cite this