This paper employs concepts from information theory to choosing the dimension of a data set. We calculate relative measures of information in the data in terms of eigenvalues and derive criteria to determine the `optimal' size of the data set, in particular whether an extra variable adds...

This paper employs concepts from information theory for choosing the dimension of a data set. We propose a relative information measure connected to Kullback–Leibler numbers. By ordering the series of the data set according to the measure, we are able to obtain a subset of a data set that is...