Optimal replacement of a system according to a semi-Markov decision process in a semi-Markov environment

Optimal replacement of a system according to a semi-Markov decision process in a semi-Markov environment

0.00 Avg rating0 Votes
Article ID: iaor20041981
Country: United Kingdom
Volume: 18
Issue: 2
Start Page Number: 181
End Page Number: 196
Publication Date: Mar 2003
Journal: Optimization Methods & Software
Authors: ,
Keywords: programming: markov decision, markov processes
Abstract:

This paper investigates an optimal replacement problem of a system in a semi-Markov environment. The system itself deteriorates according to a semi-Markov process, and is further influenced by its environment, which changes according to a semi-Markov process. Each change of the environment's state will change the parameters modelling the system and also cause damage on the system. For minimizing the discounted total costs with finite and infinite horizons, we show the existence of optimal control limit policies. A special case of Markov environment is discussed, and the state space can be simplified equivalently to be finite, so the real computation of the problem is feasible. Finally, a numerical example is given to prove the correctness and validity of the analysis.

Reviews

Required fields are marked *. Your email address will not be published.