Bandit problems with lévy processes

Asaf Cohen; Eilon Solan

doi:10.1287/moor.1120.0564

Bandit problems with lévy processes

Asaf Cohen, Eilon Solan

Research output: Contribution to journal › Article › peer-review

17 Scopus citations

Abstract

Bandit problems model the trade-off between exploration and exploitation in various decision problems. We study two-armed bandit problems in continuous time, where the risky arm can have two types: High or Low; both types yield stochastic payoffs generated by a Lévy process. We show that the optimal strategy is a cut-off strategy and we provide an explicit expression for the cut-off and for the optimal payoff.

Original language	English
Pages (from-to)	92-107
Number of pages	16
Journal	Mathematics of Operations Research
Volume	38
Issue number	1
DOIs	https://doi.org/10.1287/moor.1120.0564
State	Published - 1 Feb 2013
Externally published	Yes

Keywords

Cut-off strategies
Lévy processes
Two-armed bandit

ASJC Scopus subject areas

General Mathematics
Computer Science Applications
Management Science and Operations Research

Access to Document

10.1287/moor.1120.0564

Cite this

@article{b55f77d5d39343a8b5205cc241f79fb0,

title = "Bandit problems with l{\'e}vy processes",

abstract = "Bandit problems model the trade-off between exploration and exploitation in various decision problems. We study two-armed bandit problems in continuous time, where the risky arm can have two types: High or Low; both types yield stochastic payoffs generated by a L{\'e}vy process. We show that the optimal strategy is a cut-off strategy and we provide an explicit expression for the cut-off and for the optimal payoff.",

keywords = "Cut-off strategies, L{\'e}vy processes, Two-armed bandit",

author = "Asaf Cohen and Eilon Solan",

year = "2013",

month = feb,

day = "1",

doi = "10.1287/moor.1120.0564",

language = "English",

volume = "38",

pages = "92--107",

journal = "Mathematics of Operations Research",

issn = "0364-765X",

publisher = "INFORMS Institute for Operations Research and the Management Sciences",

number = "1",

}

TY - JOUR

T1 - Bandit problems with lévy processes

AU - Cohen, Asaf

AU - Solan, Eilon

PY - 2013/2/1

Y1 - 2013/2/1

N2 - Bandit problems model the trade-off between exploration and exploitation in various decision problems. We study two-armed bandit problems in continuous time, where the risky arm can have two types: High or Low; both types yield stochastic payoffs generated by a Lévy process. We show that the optimal strategy is a cut-off strategy and we provide an explicit expression for the cut-off and for the optimal payoff.

AB - Bandit problems model the trade-off between exploration and exploitation in various decision problems. We study two-armed bandit problems in continuous time, where the risky arm can have two types: High or Low; both types yield stochastic payoffs generated by a Lévy process. We show that the optimal strategy is a cut-off strategy and we provide an explicit expression for the cut-off and for the optimal payoff.

KW - Cut-off strategies

KW - Lévy processes

KW - Two-armed bandit

UR - http://www.scopus.com/inward/record.url?scp=84875456198&partnerID=8YFLogxK

U2 - 10.1287/moor.1120.0564

DO - 10.1287/moor.1120.0564

M3 - Article

AN - SCOPUS:84875456198

SN - 0364-765X

VL - 38

SP - 92

EP - 107

JO - Mathematics of Operations Research

JF - Mathematics of Operations Research

IS - 1

ER -

Bandit problems with lévy processes

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this