Convergence of the value functions of discounted infinite horizon optimal control problems with low discount rates

Convergence of the value functions of discounted infinite horizon optimal control problems with low discount rates

0.00 Avg rating0 Votes
Article ID: iaor19941039
Country: United States
Volume: 18
Issue: 4
Start Page Number: 1006
End Page Number: 1019
Publication Date: Nov 1993
Journal: Mathematics of Operations Research
Authors:
Abstract:

For autonomous, nonlinear, smooth optimal control systems on n-dimensional manifolds the paper investigates the relationship between the discounted and the average yield optimal value of infinite horizon problems. It is shown that the value functions of discounted problems converge to the value function of the average yield problem as the discount rate tends to zero, if there exist approximately optimal solutions satisfying some periodicity conditions. In general, the discounted value functions cannot be expected to converge, which is shown by a counterexample. A connection to geometric control theory is then made to establish a result of uniform convergence on compact subsets of the interior of control sets, if optimal trajectories do not leave a compact subset of the interior of these control sets.

Reviews

Required fields are marked *. Your email address will not be published.