Capacity and Construction of Recoverable Systems

Ohad Elishco, Alexander Barg

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations


Motivated by the established notion of storage codes, we consider sets of infinite sequences over a finite alphabet such that every k-tuple of consecutive entries is uniquely recoverable from its l-neighborhood in the sequence. In the first part of the paper we address the problem of finding the maximum growth rate of the set as well as constructions of explicit families (based on constrained coding) that approach the optimal rate. In the second part we consider a modification of the problem wherein the entries in the sequence are viewed as random variables over a finite alphabet, and the recovery condition requires that the Shannon entropy of the k-tuple conditioned on its l-neighborhood be bounded above by some \epsilon > 0. We study properties of measures on infinite sequences that maximize the metric entropy under the recoverability condition. Drawing on tools from ergodic theory, we prove some properties of entropy-maximizing measures. We also suggest a procedure of constructing an \epsilon-recoverable measure from a corresponding deterministic system, and prove that for small \epsilon the constructed measure is a maximizer of the metric entropy.

Original languageEnglish
Title of host publication2021 IEEE International Symposium on Information Theory, ISIT 2021 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers
Number of pages6
ISBN (Electronic)9781538682098
StatePublished - 12 Jul 2021
Event2021 IEEE International Symposium on Information Theory, ISIT 2021 - Virtual, Melbourne, Australia
Duration: 12 Jul 202120 Jul 2021

Publication series

NameIEEE International Symposium on Information Theory - Proceedings
ISSN (Print)2157-8095


Conference2021 IEEE International Symposium on Information Theory, ISIT 2021
CityVirtual, Melbourne

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Information Systems
  • Modeling and Simulation
  • Applied Mathematics


Dive into the research topics of 'Capacity and Construction of Recoverable Systems'. Together they form a unique fingerprint.

Cite this