Negative binomial sums of random variables and discounted reward processes

Negative binomial sums of random variables and discounted reward processes

0.00 Avg rating0 Votes
Article ID: iaor2000455
Country: United Kingdom
Volume: 35
Issue: 3
Start Page Number: 589
End Page Number: 599
Publication Date: Sep 1998
Journal: Journal of Applied Probability
Authors:
Keywords: markov processes
Abstract:

Given a sequence of random variables (rewards), the Haviv–Puterman differential equation relates the expected infinite-horizon λ-discounted reward and the expected total reward up to a random time that is determined by an independent negative binomial random variable with parameters 2 and λ. This paper provides an interpretation of this proven, but previously unexplained, result. Furthermore, the interpretation is formalized into a new proof, which then yields new results for the general case where the rewards are accumulated up to a time determined by an independent negative binomial random variable with parameters k and λ.

Reviews

Required fields are marked *. Your email address will not be published.