Section: New Results

Partially observed optimal stopping problem for discrete-time Markov processes

In [12], we have investigated of a new numerical method to approximate the optimal stopping problem for a discrete-time continuous state space Markov chain under partial observations. It is based on a two-step discretization procedure based on optimal quantization. First,we discretize the state space of the unobserved variable by quantizing an underlying reference measure. Then we jointly discretize the resulting approximate filter and the observation process. We obtain a fully computable approximation of the value function with explicit error bounds for its convergence towards the true value fonction.

Authors: B. De Saporta, F. Dufour and C. Nivot. All authors are members of CQFD at Inria.