Hinderer, K. - In: Mathematical Methods of Operations Research 62 (2005) 1, pp. 3-22
We present tools and guidelines for investigating Lipschitz continuity of the value functions in MDP’s, using the Hausdorff metric and the Kantorovich metric for measuring the influence of the constraint set and the transition law, respectively. The methods are explained by examples....