Analysis of a finite state many player game using its master equation

Erhan Bayraktar, Asaf Cohen

Research output: Contribution to journalArticlepeer-review

52 Scopus citations

Abstract

We consider an n-player symmetric stochastic game with weak interactions between the players. Time is continuous, and the horizon and the number of states are finite. We show that the value function of each of the players can be approximated by the solution of a partial differential equation called the master equation. Moreover, we analyze the fluctuations of the empirical measure of the states of the players in the game and show that it is governed by a solution to a stochastic differential equation. Finally, we prove the regularity of the master equation, which is required for the above results.

Original languageEnglish
Pages (from-to)3538-3568
Number of pages31
JournalSIAM Journal on Control and Optimization
Volume56
Issue number5
DOIs
StatePublished - 1 Jan 2018
Externally publishedYes

Keywords

  • Finite state control problem
  • Fluctuations
  • Markov chains
  • Master equation
  • Mean field games

ASJC Scopus subject areas

  • Control and Optimization
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Analysis of a finite state many player game using its master equation'. Together they form a unique fingerprint.

Cite this