Denardo, Eric V. - In: Management Science 14 (1968) 7, pp. 451-462
The special structure of a class of Markovian decision problems is exploited to simplify the determination of optimum policies. For certain pairs consisting of a state i and decision k, the cost c<sup>k</sup><sub>i</sub> separates (c<sup>k</sup><sub>i</sub> - a<sub>i</sub> + b<sub>k</sub>), while the transition probabilities p<sup>k</sup><sub>ij</sub> and transition time...