This paper addresses the following question: How much information do the kernel function and the bandwidth provide for nonparametric kernel estimation? The question is addressed by showing that kernel estimation of a cumulative distribution function (CDF) is an information transmission procedure...

Which component is most important for a system's survival? We answer this question by ranking the information relationship between a system and its components. The mutual information (M) measures dependence between the operational states of the system and a component for a mission time as well...

This paper first illustrates that a mutual information index detects and ranks dependence of a wide variety of absolutely continuous families, but the popular association and variance reduction indices fail to serve as such “common metrics”. We then elaborate on some theoretical merits of...