I study the question on the convexity of the value function and Blackwell's (1951) Theorem and relate this to the uniqueness of optimal policies. The main results will conclude that strict convexity and a strict inequality in Blackwell's Theorem will hold if and only if from different priors...