Correlated Binomial Process

Moïse Blanchard, Doron Cohen, Aryeh Kontorovich

Research output: Contribution to journalConference articlepeer-review

Abstract

Cohen and Kontorovich (COLT 2023) initiated the study of what we call here the Binomial Empirical Process: the maximal empirical mean deviation for sequences of binary random variables (up to rescaling, the empirical mean of each entry of the random sequence is a binomial hence the naming). They almost fully analyzed the case where the binomials are independent, which corresponds to all random variable entries from the sequence being independent. The remaining gap was closed by Blanchard and Voráček (ALT 2024). In this work, we study the much more general and challenging case with correlations. In contradistinction to Gaussian processes, whose behavior is characterized by the covariance structure, we discover that, at least somewhat surprisingly, for binomial processes covariance does not even characterize convergence. Although a full characterization remains out of reach, we take the first steps with nontrivial upper and lower bounds in terms of covering numbers.

Original languageEnglish
Pages (from-to)551-595
Number of pages45
JournalProceedings of Machine Learning Research
Volume247
StatePublished - 1 Jan 2024
Event37th Annual Conference on Learning Theory, COLT 2024 - Edmonton, Canada
Duration: 30 Jun 20243 Jul 2024

Keywords

  • concentration
  • convergence
  • empirical process
  • high dimension
  • subgaussian

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software
  • Control and Systems Engineering
  • Statistics and Probability

Fingerprint

Dive into the research topics of 'Correlated Binomial Process'. Together they form a unique fingerprint.

Cite this