Interactive algorithms: Pool, stream and precognitive stream

Sivan Sabato, Tom Hess

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

We consider interactive algorithms in the pool-based setting, and in the stream-based setting. Interactive algorithms observe suggested elements (representing actions or queries), and interactively select some of them and receive responses. Pool-based algorithms can select elements at any order, while stream-based algorithms observe elements in sequence, and can only select elements immediately after observing them. We further consider an intermediate setting, which we term precognitive stream, in which the algorithm knows in advance the identity of all the elements in the sequence, but can select them only in the order of their appearance. For all settings, we assume that the suggested elements are generated independently from some source distribution, and ask what is the stream size required for emulating a pool algorithm with a given pool size, in the stream-based setting and in the precognitive stream setting. We provide algorithms and matching lower bounds for general pool algorithms, and for utility-based pool algorithms. We further derive nearly matching upper and lower bounds on the gap between the two settings for the special case of active learning for binary classification.

Original languageEnglish
Pages (from-to)1-39
Number of pages39
JournalJournal of Machine Learning Research
Volume18
StatePublished - 1 Jan 2018

Keywords

  • Active learning
  • Interactive algorithms
  • Pool-based
  • Stream-based

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Statistics and Probability
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Interactive algorithms: Pool, stream and precognitive stream'. Together they form a unique fingerprint.

Cite this