An optimization problem which provides a new characterization for ridge regression is discussed. A variant of this optimization problem leads to a new family of biased estimators that includes the Stein estimation method and principal components regression as particular cases. The whole approach is illustrated on the basis of real data sets.