Continuity of the value of competitive Markov decision processes

Eilon Solan*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

27 Scopus citations

Abstract

We provide a bound for the variation of the function that assigns to every competitive Markov decision process and every discount factor its discounted value. This bound implies that the undiscounted value of a competitive Markov decision process is continuous in the relative interior of the space of transition rules.

Original languageEnglish
Pages (from-to)831-845
Number of pages15
JournalJournal of Theoretical Probability
Volume16
Issue number4
DOIs
StatePublished - Oct 2003

Keywords

  • Competitive Markov decision process
  • Sensitivity analysis
  • Stochastic games
  • Value

Fingerprint

Dive into the research topics of 'Continuity of the value of competitive Markov decision processes'. Together they form a unique fingerprint.

Cite this