Brief Announcement: Deterministic Lower Bound for Dynamic Balanced Graph Partitioning

Brief Announcement: Deterministic Lower Bound for Dynamic Balanced Graph Partitioning

Abstract

Distributed applications, including batch processing, streaming, scale-out databases, or machine learning, generate a significant amount of network traffic. By collocating frequently communicat- ing nodes (e.g., virtual machines) on the same clusters (e.g., server or rack), we can reduce the network load and improve application performance. However, the communication pattern of different ap- plications is often unknown a priori and may change over time, hence it needs to be learned in an online manner. This paper revisits the online balanced partitioning problem (introduced by Avin et al. at DISC 2016) that asks for an algorithm that strikes an optimal tradeoff between the benefits of collocation (i.e., lower network load) and its costs (i.e., migrations). Our first contribution is a sig- nificantly improved deterministic lower bound of Ω(k · l) on the competitive ratio, where l is the number of clusters and k is the cluster size, even for a scenario in which the communication pat- tern is static and can be perfectly partitioned; we also provide an asymptotically tight upper bound of O(k · l) for this scenario. For k = 3, we contribute an asymptotically tight upper bound of Θ(l) for the general model in which the communication pattern can change arbitrarily over time. In contrast to most prior work, our algorithms respect all capacity constraints and do not require resource augmentation.

Grafik Top
Authors
  • Pacut, Maciej
  • Parham, Mahmoud
  • Schmid, Stefan
Grafik Top
Shortfacts
Category
Paper in Conference Proceedings or in Workshop Proceedings (Paper)
Event Title
ACM Symposium on Principles of Distributed Computing 2020
Divisions
Communication Technologies
Subjects
Theoretische Informatik
Parallele Datenverarbeitung
Event Location
Salerno
Event Type
Conference
Event Dates
03.08.2020-07.08.2020
Date
3 August 2020
Export
Grafik Top