Article ID: | iaor20003684 |
Country: | Germany |
Volume: | 50 |
Issue: | 3 |
Start Page Number: | 421 |
End Page Number: | 448 |
Publication Date: | Jan 1999 |
Journal: | Mathematical Methods of Operations Research (Heidelberg) |
Authors: | Hordijk A., Yushkevich A.A. |
Keywords: | financial |
This paper is the second part of our study of Blackwell optimal policies in Markov decision chains with a Borel state space and unbounded rewards. We prove that a stationary policy is Blackwell optimal in the class of all history-dependent policies if it is Blackwell optimal in the class of stationary policies. We also develop recurrence and drift conditions which ensure ergodicity and integrability assumptions made in the previous paper, and which are more suitable for applications. As an example we study a cash-balance model.