Series expansions for continuous-time Markov processes

Series expansions for continuous-time Markov processes

0.00 Avg rating0 Votes
Article ID: iaor20104789
Volume: 58
Issue: 3
Start Page Number: 756
End Page Number: 767
Publication Date: May 2010
Journal: Operations Research
Authors: , ,
Abstract:

We present update formulas that allow us to express the stationary distribution of a continuous-time Markov process with denumerable state space having generator matrix Q* through a continuous-time Markov process with generator matrix Q. Under suitable stability conditions, numerical approximations can be derived from the update formulas, and we show that the algorithms converge at a geometric rate. Applications to sensitivity analysis and bounds on perturbations are discussed as well. Numerical examples are presented to illustrate the efficiency of the proposed algorithm.

Reviews

Required fields are marked *. Your email address will not be published.