Semi-Markov and reward fields
We introduce semi-Markov fields and provide formulations for the basic terms in the semi-Markov theory. In particular we define and consider a class of associated reward fields. Then we present a formula for the expected reward at any multidimensional time epoch. The formula is indeed new even for the classical semi-Markov processes. It gives the expected cumulative reward for fairly large classes of reward functions; in particular, it provides the formulas for the expected cumulative reward given in Masuda and Sumitau (1991), Soltani (1996) and Soltani and Khorshidian (1998).
| Year of publication: |
2014
|
|---|---|
| Authors: | Soltani, A.R. ; Ghasemi, H. |
| Published in: |
Statistics & Probability Letters. - Elsevier, ISSN 0167-7152. - Vol. 95.2014, C, p. 71-76
|
| Publisher: |
Elsevier |
| Subject: | Markov renewal fields | Markov renewal sequences | Semi Markov fields | Reward fields | Expected reward fields |
Saved in:
Saved in favorites
Similar items by person
-
Inference on periodograms of infinite dimensional discrete time periodically correlated processes
Soltani, A.R., (2010)
-
An inequality involving correlations
Nematollahi, A.R., (2006)
-
A class of discrete distributions induced by stable laws
Soltani, A.R., (2009)
- More ...