On the layered nearest neighbour estimate, the bagged nearest neighbour estimate and the random forest method in regression and classification

DOI10.1016/j.jmva.2010.06.019zbMath1198.62048OpenAlexW1967689506MaRDI QIDQ604365

Gérard Biau, Luc P. Devroye

Publication date: 10 November 2010

Published in: Journal of Multivariate Analysis (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.jmva.2010.06.019

zbMATH Keywords

random forestsregression estimationbagginglayered nearest neighboursone nearest neighbour estimate

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Estimation in multivariate analysis (62H12) Asymptotic properties of nonparametric inference (62G20) Classification and discrimination; cluster analysis (statistical aspects) (62H30)

Related Items

Estimation of the optimal regime in treatment of prostate cancer recurrence from observational data using flexible weighting models, Rates of convergence for random forests via generalized U-statistics, A random forest guided tour, Estimation and Inference of Heterogeneous Treatment Effects using Random Forests, Stochastic Geometry to Generalize the Mondrian Process, Uniform consistency of \(k\mathrm{NN}\) regressors for functional variables, PAC-Bayesian risk bounds for group-analysis sparse regression by exponential weighting, Spatial performance analysis in basketball with CART, random forest and extremely randomized trees, Maxima-finding algorithms for multidimensional samples: A two-phase approach, Modeling of time series using random forests: theoretical developments, An affine invariant \(k\)-nearest neighbor regression estimate, Bias-corrected random forests in regression, Generalized random forests, Predictive Distribution Modeling Using Transformation Forests, Estimating residual variance in random forest regression, Consistency of random forests, Optimal weighted nearest neighbour classifiers, Tree aggregation for random forest class probability estimation, Sampling from non-smooth distributions through Langevin diffusion, Consistent estimation of residual variance with random forest out-of-bag errors, Unnamed Item, Regression trees and forests for non-homogeneous Poisson processes, Random forest estimation of conditional distribution functions and conditional quantiles, Robustness of random forests for regression, Probability estimation with machine learning methods for dichotomous and multicategory outcome: Theory

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Bagging predictors
• Exact bootstrap \(k\)-nearest neighbor learners
• Consistent nonparametric regression. Discussion
• On the variance of the number of maxima in random vectors and its applications
• Mass transportation problems. Vol. 1: Theory. Vol. 2: Applications
• A distribution-free theory of nonparametric regression
• Discriminatory Analysis. Nonparametric Discrimination: Consistency Properties
• The uniform convergence of nearest neighbor regression function estimators and their application in optimization
• On the Distribution of the Number of Admissible Points in a Vector Random Sample
• Nearest neighbor pattern classification
• Maxima in hypercubes
• Random Forests and Adaptive Nearest Neighbors
• Random forests