Strongly ergodic Markov chains and rates of convergence using spectral conditions
For finite Markov chains the eigenvalues of P can be used to characterize the chain and also determine the geometric rate at which Pn converges to Q in case P is ergodic. For infinite Markov chains the spectrum of P plays the analogous role. It follows from Theorem 3.1 that ||Pn-Q||[less-than-or-equals, slant]C[beta]n if and only if P is strongly ergodic. The best possible rate for [beta] is the spectral radius of P-Q which in this case is the same as sup{[lambda]: [lambda] |-> [sigma] (P), [lambda] [not equal to];1}. The question of when this best rate equals [delta](P) is considered for both discrete and continous time chains. Two characterizations of strong ergodicity are given using spectral properties of P- Q (Theorem 3.5) and spectral properties of a submatrix of P (Theorem 3.16).
Year of publication: |
1978
|
---|---|
Authors: | Isaacson, Dean ; Luecke, Glenn R. |
Published in: |
Stochastic Processes and their Applications. - Elsevier, ISSN 0304-4149. - Vol. 7.1978, 1, p. 113-121
|
Publisher: |
Elsevier |
Saved in:
Saved in favorites
Similar items by person
-
The convergence of Cesaro averages for certain nonstationary Markov chains
Bowerman, Bruce, (1977)
-
Using benchmarking to determine efficient usage of nodes in a cluster
Luecke, Glenn R., (2007)
-
Nonhomogeneous, continuous-time Markov chains defined by series of proportional intensity matrices
Johnson, Jean T., (1989)
- More ...