Sladký, Karel - In: Mathematical Methods of Operations Research 62 (2005) 3, pp. 387-397
As an extension of the discrete-time case, this note investigates the variance of the total cumulative reward for the embedded Markov chain of semi-Markov processes. Under the assumption that the chain is aperiodic and contains a single class of recurrent states recursive formulae for the...
