The combination of classifiers leads to substantial reduction of misclassification error in a wide range of applications and benchmark problems. We suggest to use the out-of-bag sample for combining different classifiers. In our setup, a Linear Discriminant Analysis is performed using the...