Article ID: | iaor20041142 |
Country: | Germany |
Volume: | 57 |
Issue: | 1 |
Start Page Number: | 79 |
End Page Number: | 88 |
Publication Date: | Jan 2003 |
Journal: | Mathematical Methods of Operations Research (Heidelberg) |
Authors: | Ohtsubo Y. |
Keywords: | networks: path |
We consider a minimizing risk model in a stochastic shortest path problem in which for each node of a graph we select a probability distribution over the set of successor nodes so as to reach a given target node with minimum threshold probability. We formulate such a problem as undiscounted finite Markov decision processes. We show that an optimal value function is a unique solution to an optimality equation and find an optimal stationary policy. A value iteration method is also given.