Reward processes for semi-Markov processes: Asymptotic behaviour

Reward processes for semi-Markov processes: Asymptotic behaviour

0.00 Avg rating0 Votes
Article ID: iaor20002966
Country: United Kingdom
Volume: 35
Issue: 4
Start Page Number: 833
End Page Number: 842
Publication Date: Dec 1998
Journal: Journal of Applied Probability
Authors: ,
Keywords: Semi-Markov process
Abstract:

The asymptotic behaviour of the cumulative mean of a reward process Zρ, where the reward function ρ belongs to a rather large class of functions, is obtained. It is proved that EZρ(t) = C0 + C1t + o(1), t → ∞, where C0 and C1 are fully specified. A section is devoted to the dual process of a semi-Markov process, and a formula is given for the mean of the first passage time for a state i to a state j of the dual process, in terms of the means of passage times of the original process.

Reviews

Required fields are marked *. Your email address will not be published.