Entropy is the Only Finitely Observable Invariant
Our main purpose is to present a very surprising new characterization of the Shannon entropy of stationary ergodic processes. We will use two basic concepts: isomorphism of stationary processes and a notion of finite observability, and we will see how one is led, inevitably, to Shannon's entropy. A function J with values in some metric space, defined on all finite-valued, stationary, ergodic processes is said to be finitely observable (FO) if there is a sequence of functions S_{n}(x_{1},x_{2},...,x_{n}) that for all processes X converges to J(X) for almost every realization x_{1}^{\infty} of X. It is called an invariant if it returns the same value for isomorphic processes. We show that any finitely observable invariant is necessarily a continuous function of the entropy. Several extensions of this result will also be given.
Year of publication: |
2006-05
|
---|---|
Authors: | Ornstein, Donald ; Weiss, Benjamin |
Institutions: | Center for the Study of Rationality, Hebrew University of Jerusalem |
Saved in:
Saved in favorites
Similar items by person
-
Entropy is the only finitely observable invariant
Ornstein, Donald, (2006)
-
Decay and Growth for a Nonlinear Parabolic Equation
Hart, Sergiu, (2003)
-
Evolutionarily Stable Strategies of Random Games, and the Vertices of Random Polygons
Hart, Sergiu, (2007)
- More ...