We perform a theoretical investigation of the variance of the cross-validation estimate of the generalization error …

generalization error estimation schemes such as cross-validation or Akaike's information criterion, and thus they result in poor … model selection. In this paper, we propose an alternative estimator of the generalization error for the squared loss … function when training and test distributions are different. The proposed generalization error estimator is shown to be exactly …