Semimyopic measurement selection for optimization under uncertainty

David Tolpin, Solomon Eyal Shimony

Research output: Contribution to journalArticlepeer-review

6 Scopus citations

Abstract

The following sequential decision problem is considered: given a set of items of unknown utility, an item with as high a utility as possible must be selected ("the selection problem"). Measurements (possibly noisy) of item features prior to selection are allowed at known costs. The goal is to optimize the overall sequential decision process of measurements and selection. Value of information (VOI) is a well-known scheme for selecting measurements, but the intractability of the problem typically leads to using myopic VOI estimates. In the selection problem, myopic VOI frequently badly underestimates the VOI, leading to inferior measurement policies. In this paper, the strict myopic assumption is relaxed into a scheme termed semimyopic, providing a spectrum of methods that can improve the performance of measurement policies. In particular, the efficiently computable method of blinkered VOI is proposed, and theoretical bounds for important special cases are examined. Empirical evaluation of blinkered VOI in the selection problem with normally distributed item values shows that it performs much better than pure myopic VOI.

Original languageEnglish
Article number6056578
Pages (from-to)565-579
Number of pages15
JournalIEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Volume42
Issue number2
DOIs
StatePublished - 1 Apr 2012

Keywords

  • Computational and artificial intelligence
  • computational intelligence
  • greedy algorithms
  • measurement
  • myopic
  • non-myopic
  • optimization
  • uncertainty
  • utility
  • value of information

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Information Systems
  • Human-Computer Interaction
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Semimyopic measurement selection for optimization under uncertainty'. Together they form a unique fingerprint.

Cite this