Optimality Inequalities for Average Cost Markov Decision Processes and the Stochastic Cash Balance Problem

Optimality Inequalities for Average Cost Markov Decision Processes and the Stochastic Cash Balance Problem

0.00 Avg rating0 Votes
Article ID: iaor200954137
Country: United States
Volume: 32
Issue: 4
Start Page Number: 769
End Page Number: 783
Publication Date: Nov 2007
Journal: Mathematics of Operations Research
Authors: ,
Keywords: inventory
Abstract:

For general state and action space Markov decision processes, we present sufficient conditions for the existence of solutions of the average cost optimality inequalities. These conditions also imply the convergence of both the optimal discounted cost value function and policies to the corresponding objects for the average costs per unit time case. Inventory models are natural applications of our results. We describe structural properties of average cost optimal policies for the cash balance problem; an inventory control problem where the demand may be negative and the decision–maker can produce or scrap inventory. We also show the convergence of optimal thresholds in the finite horizon case to those under the expected discounted cost criterion and those under the expected discounted costs to those under the average costs per unit time criterion.

Reviews

Required fields are marked *. Your email address will not be published.