Stationary solutions of stochastic recursions describing discrete event systems
We consider recursions of the form xn + 1 = [phi]n[xn], where {[phi]n, n >= 0} is a stationary ergodic sequence of maps from a Polish space (E, ) into itself, and {xn, n >= 0} are random variables taking values in (E, ). Questions of existence and uniqueness of stationary solutions are of considerable interest in discrete event system applications. Currently available techniques use simplifying assumptions on the statistics of {[phi]n}n (such as Markov assumptions), or on the nature of these maps (such as monotonicity). We introduce a new technique, without such simplifying assumptions, by weakening the solution concept: instead of a pathwise solution, we construct a probability measure on another sample space and families of random variables on this space whose law gives a stationary solution. The existence of a stationary solution is then translated into tightness of a sequence of probability distributions. Uniqueness questions can be addressed using techniques familiar from the ergodic theory of positive Markov operators
Year of publication: |
1997
|
---|---|
Authors: | Anantharam, Venkat ; Konstantopoulos, Takis |
Published in: |
Stochastic Processes and their Applications. - Elsevier, ISSN 0304-4149. - Vol. 68.1997, 2, p. 181-194
|
Publisher: |
Elsevier |
Keywords: | Stochastic recursions Ergodic theory Queueing processes |
Saved in:
Online Resource
Saved in favorites
Similar items by person
-
Designing a contact process: the piecewise-homogeneous process on a finite set with applications
Wagner, Aaron B., (2005)
-
Learning in games with cumulative prospect theoretic preferences
Phade, Soham R., (2023)
-
On the geometry of Nash and correlated equilibria with cumulative prospect theoretic preferences
Phade, Soham R., (2019)
- More ...