Standard errors for bagged and random forest estimators
Bagging and random forests are widely used ensemble methods. Each forms an ensemble of models by randomly perturbing the fitting of a base learner. The standard errors estimation of the resultant regression function is considered. Three estimators are discussed. One, based on the jackknife, is applicable to bagged estimators and can be computed using the bagged ensemble. The two other estimators target the bootstrap standard error estimator, and require fitting multiple ensemble estimators, one for each bootstrap sample. It is shown that these bootstrap ensemble sizes can be small, which reduces the computation involved in forming the estimator. The estimators are studied using both simulated and real data.
Year of publication: |
2009
|
---|---|
Authors: | Sexton, Joseph ; Laake, Petter |
Published in: |
Computational Statistics & Data Analysis. - Elsevier, ISSN 0167-9473. - Vol. 53.2009, 3, p. 801-811
|
Publisher: |
Elsevier |
Saved in:
Saved in favorites
Similar items by person
-
Boosted Regression Trees with Errors in Variables
Sexton, Joseph, (2007)
-
Stochastic Approximation Boosting for Incomplete Data Problems
Sexton, Joseph, (2009)
-
Adaptive combination of dependent tests
Sexton, Joseph, (2012)
- More ...