Computing moments of the exit time distribution for Markov processes by linear programming

Computing moments of the exit time distribution for Markov processes by linear programming

0.00 Avg rating0 Votes
Article ID: iaor20021998
Volume: 49
Issue: 4
Start Page Number: 516
End Page Number: 530
Publication Date: Jul 2001
Journal: Operations Research
Authors: , ,
Keywords: markov processes
Abstract:

We provide a new approach to the numerical computation of moments of the exit time distribution of Markov processes. The method relies on a linear programming formulation of a process exiting from a bounded domain. The LP formulation characterizes the evolution of the process through the moments of the induced occupation measure and naturally provides upper and lower bounds for the exact values of the moments. The conditions the moments have to satisfy are derived directly from the generator of the Markov process and are not based on some approximation of the process. Excellent software is readily available because the computations involve infinite dimensional linear programs.

Reviews

Required fields are marked *. Your email address will not be published.