A new regularization method for regression models is proposed. The criterion to be minimized contains a penalty term which explicitly links strength of penalization to the correlation between predictors. As the elastic net, the method encourages a grouping effect where strongly correlated...

A shrinkage type estimator is introduced which has favorable properties in binary regression. Although binary observations are never very far away from the underlying probability, in all interesting cases there is a non-zero distance between observation and underlying mean. The proposed response...

In many applications it is known that the underlying smooth function is constrained to have a specific form. In the present paper, we propose an estimation method based on the regression spline approach, which allows to include concavity or convexity constraints in an appealing way. Instead of...

In additive models the problem of variable selection is strongly linked to the choice of the amount of smoothing used for components that represent metrical variables. Many software packages use separate toolsto solve the different tasks of variable selection and smoothing parameter choice. The...

Gene expression datasets usually have thousends of explanatory variables which are observed on only few samples. Generally most variables of a dataset have no effect and one is interested in eliminating these irrelevant variables. In order to obtain a subset of relevant variables an appropriate...

Additive models of the type y=f_1(x_1)+...+f_p(x_p)+e where f_j,j=1,...,p, have unspecified functional form, are flexible statistical regression models which can be used to characterize nonlinear regression effects. The basic tools used for fitting the additive model are the expansion in...

Various supervised learning and gene selection methods have been used for cancer diagnosis. Most of these methods do not consider interactions between genes, although this might be interesting biologically and improve classification accuracy. Here we introduce a new CART-based method to discover...

Principal components are a well established tool in dimension reduction. The extension to principal curves allows for general smooth curves which pass through the middle of a p-dimensional data cloud. In this paper local principal curves are introduced, which are based on the localization of...