Partially observed optimal stopping problem for discrete-time Markov processes

Partially observed optimal stopping problem for discrete-time Markov processes

0.00 Avg rating0 Votes
Article ID: iaor20174337
Volume: 15
Issue: 3
Start Page Number: 277
End Page Number: 302
Publication Date: Sep 2017
Journal: 4OR
Authors: , ,
Keywords: simulation, markov processes
Abstract:

This paper is dedicated to the investigation of a new numerical method to approximate the optimal stopping problem for a discrete‐time continuous state space Markov chain under partial observations. It is based on a two‐step discretization procedure based on optimal quantization. First, we discretize the state space of the unobserved variable by quantizing an underlying reference measure. Then we jointly discretize the resulting approximate filter and the observation process. We obtain a fully computable approximation of the value function with explicit error bounds for its convergence towards the true value function.

Reviews

Required fields are marked *. Your email address will not be published.