Article ID: | iaor200971586 |
Country: | Germany |
Volume: | 70 |
Issue: | 1 |
Start Page Number: | 13 |
End Page Number: | 33 |
Publication Date: | Aug 2009 |
Journal: | Mathematical Methods of Operations Research |
Authors: | Gordienko Evgueni, Lemus-Rodrguez Enrique, Montes-de-Oca Ral |
We study perturbations of a discrete-time Markov control process on a general state space. The amount of perturbation is measured by means of the Kantorovich distance. We assume that an average (per unit of time on the infinite horizon) optimal control policy can be found for the perturbed (supposedly known) process, and that it is used to control the original (unperturbed) process. The one-stage cost is not assumed to be bounded. Under Lyapunov-like conditions we find upper bounds for the average cost excess when such an approximation is used in place of the optimal (unknown) control policy. As an application of the found inequalities we consider the approximation by relevant empirical distributions. We illustrate our results by estimating the stability of a simple autoregressive control process. Also examples of unstable processes are provided.