| Article ID: | iaor20052293 |
| Country: | Netherlands |
| Volume: | 25 |
| Issue: | 4 |
| Start Page Number: | 195 |
| End Page Number: | 197 |
| Publication Date: | Nov 1999 |
| Journal: | Operations Research Letters |
| Authors: | Ng Michael K. |
In this note, we show that the evaluation phase in the policy iteration algorithm for the infinite horizon discounted Markov decision problem can be done in O(