Stability of piecewise-deterministic Markov processes

Stability of piecewise-deterministic Markov processes

0.00 Avg rating0 Votes
Article ID: iaor20011479
Country: United States
Volume: 37
Issue: 5
Start Page Number: 1483
End Page Number: 1502
Publication Date: Aug 1999
Journal: SIAM Journal on Control and Optimization
Authors: ,
Abstract:

In this paper, we study a form of stability for a general family of nondiffusion Markov processes known in the literature as piecewise-deterministic Markov process (PDMP). By stability here we mean the existence of an invariant probability measure for the PDMP. It is shown that the existence of such an invariant probability measure is equivalent to the existence of a sigma-finite invariant measure for a Markov kernel G linked to the resolvent operator U of the PDMP, satisfying a boundedness condition or, equivalently, a Radon–Nikodym derivative. Here we generalize existing results of the literature since we do not require any additional assumptions to establish this equivalence. Moreover, we give sufficient conditions to ensure the existence of such a sigma-finite measure satisfying the boundedness condition. They are mainly based on a modified Foster–Lyapunov criterion for the case in which the Markov chain generated by G is either recurrent or weak Feller. To emphasize the relevance of our results, we study three examples and in particular, we are able to generalize the results obtained by Costa and Davis on the capacity expansion model.

Reviews

Required fields are marked *. Your email address will not be published.