Dynamic shortest paths in acyclic networks with Markovian arc costs

Dynamic shortest paths in acyclic networks with Markovian arc costs

0.00 Avg rating0 Votes
Article ID: iaor1994277
Country: United States
Volume: 41
Issue: 1
Start Page Number: 91
End Page Number: 101
Publication Date: Jan 1993
Journal: Operations Research
Authors: ,
Keywords: vehicle routing & scheduling, markov processes, programming: dynamic
Abstract:

The authors examine shortest path problems in acyclic networks in which arc costs are known functions of certain environment variables at network nodes. Each of these variables evolves according to an independent Markov process. The vehicle can wait at a node (at a cost) in anticipation of more favorable arc costs. The authors first develop two recursive procedures for the individual arc case, one based on successive approximations, and the other on policy iteration. They also solve the same problem via parametric linear programming. The authors show that the optimal policy essentially classifies the state of the environment variable at a node into two categories; green states for which the optimal action is to immediately traverse the arc, and red states for which the optimal action is to wait. They then extend these concepts for the entire network by developing a dynamic programming procedure that solves the corresponding problem. The complexity of this method is shown to be O(n2K+nK3), where n is the number of network nodes and K is the number of Markov states at each node. The authors present examples and discuss possible research extensions.

Reviews

Required fields are marked *. Your email address will not be published.