OPTCON: An algorithm for the optimal control of nonlinear stochastic models

OPTCON: An algorithm for the optimal control of nonlinear stochastic models

0.00 Avg rating0 Votes
Article ID: iaor20083150
Country: Netherlands
Volume: 37
Issue: 1
Start Page Number: 375
End Page Number: 401
Publication Date: Dec 1992
Journal: Annals of Operations Research
Authors: ,
Keywords: control processes
Abstract:

In this paper we describe the algorithm OPTCON which has been developed for the optimal control of nonlinear stochastic models. It can be applied to obtain approximate numerical solutions of control problems where the objective function is quadratic and the dynamic system is nonlinear. In addition to the usual additive uncertainty, some or all of the parameters of the model may be stochastic variables. The optimal values of the control variables are computed in an iterative fashion: First, the time-invariant nonlinear system is linearized around a reference path and approximated by a time-varying linear system. Second, this new problem is solved by applying Bellman's principle of optimality. The resulting feedback equations are used to project expected optimal state and control variables. These projections then serve as a new reference path, and the two steps are repeated until convergence is reached. The algorithm has been implemented in the statistical programming system GAUSS. We derive some mathematical results needed for the algorithm and give an overview of the structure of OPTCON. Moreover, we report on some tentative applications of OPTCON to two small macroeconometric models for Austria.

Reviews

Required fields are marked *. Your email address will not be published.