Article ID: | iaor19952254 |
Country: | United Kingdom |
Volume: | 46 |
Issue: | 3 |
Start Page Number: | 354 |
End Page Number: | 361 |
Publication Date: | Mar 1995 |
Journal: | Journal of the Operational Research Society |
Authors: | McKinnon K.I.M., Thomas L.C., Archibald T.W. |
Comparisons of the performance of solution algorithms for Markov decision processes rely heavily on problem generators to provide sizeable sets of test problems. Existing generation techniques allow little control over the properties of the test problems and often result in the problems which are not typical of real-world examples. This paper identifies the properties of Markov decision processes which affect the performance of solution algorithms, and also describes a new problem generation technique which allows all of these properties to be controlled.