Applications of Borovkov's renovation theory to non-stationary stochastic recursive sequences and their control

Applications of Borovkov's renovation theory to non-stationary stochastic recursive sequences and their control

0.00 Avg rating0 Votes
Article ID: iaor1998997
Country: United Kingdom
Volume: 29
Issue: 2
Start Page Number: 388
End Page Number: 413
Publication Date: Jun 1997
Journal: Advances in Applied Probability
Authors: ,
Abstract:

We investigate in this paper the stability of non-stationary stochastic processes, arising typically in applications of control. The setting is known as stochastic recursive sequences, which allows us to construct on one probability space stochastic processes that correspond to different initial states and even different control policies. It does not require any Markovian assumptions. A natural criterion for stability for such processes is that the influence of the initial state disappears after some finite time; in other words, starting from different initial states, the process will couple after some finite time to the same limiting (not necessarily stationary nor ergodic) stochastic process. We investigate this as well as other types of coupling, and present conditions for them to occur uniformly in some class of control policies. We then use the coupling results to establish new theoretical aspects in the theory of non-Markovian control.

Reviews

Required fields are marked *. Your email address will not be published.