Weighted bagging: a modification of AdaBoost from the perspective of importance sampling
We motivate the success of AdaBoost (ADA) in classification problems by appealing to an importance sampling perspective. Based on this insight, we propose the Weighted Bagging (WB) algorithm, a regularization method that naturally extends ADA to solve both classification and regression problems. WB uses a part of the available data to build models, and a separate part to modify the weights of observations. The method is used with categorical and regression tress and is compared with ADA, Boosting, Bagging, Random Forest and Support Vector Machine. We apply these methods to some real data sets and report some results of simulations. These applications and simulations show the effectiveness of WB.
Year of publication: |
2011
|
---|---|
Authors: | Yu, Qingzhao |
Published in: |
Journal of Applied Statistics. - Taylor & Francis Journals, ISSN 0266-4763. - Vol. 38.2011, 3, p. 451-463
|
Publisher: |
Taylor & Francis Journals |
Saved in:
Saved in favorites
Similar items by person
-
Classification of functional data: A segmentation approach
Li, Bin, (2008)
-
Misspecification of the effect of race in fixed effects models of health inequalities
Scribner, Richard Allen, (2009)
-
Spatio-temporal analysis of a plant disease in a non-uniform crop: a Monte Carlo approach
Li, Bin, (2011)
- More ...