function is always a fixed point of a modified version of the Bellman operator. We also show that value iteration monotonically …

The standard Value Iteration (VI) algorithm, referred to as Value Iteration Pre-Jacobi (PJ-VI) algorithm, is the … simplest Value Iteration scheme, and the well-known algorithm for solving Markov Decision Processes (MDPs). In the literature …, the Value Iteration Pre-Gauss-Seidel (VI-PGS) algorithm and the VI Gauss-Seidel (VI-GS) algorithm. In this article, the …