Lightweight Robust Size Aware Cache Management

Gil Einziger, Ohad Eytan, Roy Friedman, Benjamin Manes

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Modern key-value stores, object stores, Internet proxy caches, and Content Delivery Networks (CDN) often manage objects of diverse sizes, e.g., blobs, video files of different lengths, images with varying resolutions, and small documents. In such workloads, size-aware cache policies outperform size-oblivious algorithms. Unfortunately, existing size-aware algorithms tend to be overly complicated and computationally expensive.Our work follows a more approachable pattern; we extend the prevalent (size-oblivious) TinyLFU cache admission policy to handle variable-sized items. Implementing our approach inside two popular caching libraries only requires minor changes. We show that our algorithms yield competitive or better hit-ratios and byte hit-ratios compared to the state-of-the-art size-aware algorithms such as AdaptSize, LHD, LRB, and GDSF. Further, a runtime comparison indicates that our implementation is faster by up to 3× compared to the best alternative, i.e., it imposes a much lower CPU overhead.

Original languageEnglish
Article number27
JournalACM Transactions on Storage
Volume18
Issue number3
DOIs
StatePublished - 25 Aug 2022

Keywords

  • CDN
  • Software cache management
  • size aware caching
  • storage

ASJC Scopus subject areas

  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'Lightweight Robust Size Aware Cache Management'. Together they form a unique fingerprint.

Cite this