Computational methods of optimal stochastic control. Optimality principle and successive-approximation optimization scheme

The computation of an optimal strategy in the sense of the expected utility criterion in a discrete-time optimal stochastic control model is considered. An optimality principle is formulated, which defines the necessary and sufficient conditions of optimality of a stationary strategy. A general successive-approximation optimization scheme is developed. This scheme produces a whole family of new optimization methods.