Semi-Markov and reward fields
We introduce semi-Markov fields and provide formulations for the basic terms in the semi-Markov theory. In particular we define and consider a class of associated reward fields. Then we present a formula for the expected reward at any multidimensional time epoch. The formula is indeed new even for the classical semi-Markov processes. It gives the expected cumulative reward for fairly large classes of reward functions; in particular, it provides the formulas for the expected cumulative reward given in Masuda and Sumitau (1991), Soltani (1996) and Soltani and Khorshidian (1998).
Year of publication: |
2014
|
---|---|
Authors: | Soltani, A.R. ; Ghasemi, H. |
Published in: |
Statistics & Probability Letters. - Elsevier, ISSN 0167-7152. - Vol. 95.2014, C, p. 71-76
|
Publisher: |
Elsevier |
Subject: | Markov renewal fields | Markov renewal sequences | Semi Markov fields | Reward fields | Expected reward fields |
Saved in:
Saved in favorites
Similar items by person
-
On the asymptotic behavior of randomly weighted averages
Roozegar, Rasool, (2015)
-
A class of continuous kernels and Cauchy type heavy tail distributions
Soltani, A.R., (2013)
-
Soltani, A.R., (2005)
- More ...