Monotone optimal control for a class of Markov decision processes

Monotone optimal control for a class of Markov decision processes

0.00 Avg rating0 Votes
Article ID: iaor201111023
Volume: 217
Issue: 2
Start Page Number: 342
End Page Number: 350
Publication Date: Mar 2012
Journal: European Journal of Operational Research
Authors: ,
Keywords: programming: markov decision, optimization, stochastic processes
Abstract:

This paper provides a unified framework to study monotone optimal control for a class of Markov decision processes through D‐multimodularity. We demonstrate that each system in this class can be classified as either a substitution‐type or a complement‐type system according to the possible transition set, which can be used as a classification mechanism that integrates a variety of models in the literature. We develop a generic proof of the structural properties of both types of system. In particular, we show that D‐multimodularity is a generally sufficient condition for monotone optimal control of different types of system in this class. With this unified theory, there is no need to pursue each problem ad hoc and the structural properties of this class of MDPs follow with ease.

Reviews

Required fields are marked *. Your email address will not be published.