Hash & Adjust: Competitive Demand-Aware Consistent Hashing

Arash Pourdamghani, Chen Avin, Robert Sama, Maryam Shiran, Stefan Schmid

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Distributed systems often serve dynamic workloads and resource demands evolve over time. Such a temporal behavior stands in contrast to the static and demand-oblivious nature of most data structures used by these systems. In this paper, we are particularly interested in consistent hashing, a fundamental building block in many large distributed systems. Our work is motivated by the hypothesis that a more adaptive approach to consistent hashing can leverage structure in the demand, and hence improve storage utilization and reduce access time. We initiate the study of demand-aware consistent hashing. Our main contribution is H&A, a constant-competitive online algorithm (i.e., it comes with provable performance guarantees over time). H&A is demand-aware and optimizes its internal structure to enable faster access times, while offering a high utilization of storage. We further evaluate H&A empirically.

Original languageEnglish
Title of host publication28th International Conference on Principles of Distributed Systems, OPODIS 2024
EditorsSilvia Bonomi, Letterio Galletta, Etienne Riviere, Valerio Schiavoni
PublisherSchloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing
ISBN (Electronic)9783959773607
DOIs
StatePublished - 8 Jan 2025
Event28th International Conference on Principles of Distributed Systems, OPODIS 2024 - Lucca, Italy
Duration: 11 Dec 202413 Dec 2024

Publication series

NameLeibniz International Proceedings in Informatics, LIPIcs
Volume324
ISSN (Print)1868-8969

Conference

Conference28th International Conference on Principles of Distributed Systems, OPODIS 2024
Country/TerritoryItaly
CityLucca
Period11/12/2413/12/24

Keywords

  • Consistent hashing
  • demand-awareness
  • online algorithms

ASJC Scopus subject areas

  • Software

Fingerprint

Dive into the research topics of 'Hash & Adjust: Competitive Demand-Aware Consistent Hashing'. Together they form a unique fingerprint.

Cite this