Tests for Suboptimal Actions in Discounted Markov Programming
A new test for suboptimal actions in discounted Markov decision problems is proposed. The test is discussed in relation to that of MacQueen and Porteus and preferred computational schemes are given.