Average cost Markov control processes: stability with respect to the Kantorovich metric

Average cost Markov control processes: stability with respect to the Kantorovich metric

0.00 Avg rating0 Votes
Article ID: iaor200971586
Country: Germany
Volume: 70
Issue: 1
Start Page Number: 13
End Page Number: 33
Publication Date: Aug 2009
Journal: Mathematical Methods of Operations Research
Authors: , ,
Abstract:

We study perturbations of a discrete-time Markov control process on a general state space. The amount of perturbation is measured by means of the Kantorovich distance. We assume that an average (per unit of time on the infinite horizon) optimal control policy can be found for the perturbed (supposedly known) process, and that it is used to control the original (unperturbed) process. The one-stage cost is not assumed to be bounded. Under Lyapunov-like conditions we find upper bounds for the average cost excess when such an approximation is used in place of the optimal (unknown) control policy. As an application of the found inequalities we consider the approximation by relevant empirical distributions. We illustrate our results by estimating the stability of a simple autoregressive control process. Also examples of unstable processes are provided.

Reviews

Required fields are marked *. Your email address will not be published.