Theoretical analysis of cross-validation for estimating the risk of the k-Nearest Neighbor classifier

zbMath1412.62078arXiv1508.04905MaRDI QIDQ4614090

Tristan Mary-Huard, Alain Celisse

Publication date: 30 January 2019

Full work available at URL: https://arxiv.org/abs/1508.04905

zbMATH Keywords

classificationcross-validationnearest neighbor classifierU-statisticEfron-Stein inequalityrisk estimation

Mathematics Subject Classification ID

Estimation in multivariate analysis (62H12) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Order statistics; empirical distribution functions (62G30)

Related Items (2)

Quantum \(k\)-fold cross-validation for nearest neighbor classification algorithm ⋮ Local nearest neighbour classification with applications to semi-supervised learning

Uses Software

• ElemStatLearn

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Optimal cross-validation in density estimation with the \(L^{2}\)-loss
• Risk bounds for statistical learning
• Lectures on the nearest neighbor method
• Choice of neighbor order in nearest-neighbor classification
• A survey of cross-validation procedures for model selection
• Exact bootstrap \(k\)-nearest neighbor learners
• Nonparametric density estimation by exact leave-\(p\)-out cross-validation
• Distribution-free consistency results in nonparametric discrimination and regression function estimation
• The strong uniform consistency of nearest neighbor density estimates
• A finite sample distribution-free performance bound for local discrimination rules
• Efficient multivariate entropy estimation via \(k\)-nearest neighbour distances
• Moment inequalities for functions of independent random variables
• Asymptotic expansions of the \(k\) nearest neighbor risk
• Optimal global rates of convergence for nonparametric regression
• Model selection by resampling penalization
• Local nearest neighbour classification with applications to semi-supervised learning
• Model selection via multifold cross validation
• Consistency of cross validation for comparing regression procedures
• Choice of V for V-Fold Cross-Validation in Least-Squares Density Estimation
• Approximation Theorems of Mathematical Statistics
• A comparative study of ordinary cross-validation, v-fold cross-validation and the repeated learning-testing methods
• Distribution-free performance bounds for potential function rules
• The rate of convergence of<tex>k_n</tex>-NN regression estimates and classification rules (Corresp.)
• The Predictive Sample Reuse Method with Applications
• Distribution-free inequalities for the deleted and holdout error estimates
• Minimax nonparametric classification .I. Rates of convergence
• On the finite sample performance of the nearest neighbor classifier
• Rates of convergence of nearest neighbor estimation under arbitrary sampling
• Rates of Convergence of the Functional $k$-Nearest Neighbor Estimate
• Linear Model Selection by Cross-Validation
• Probability Inequalities for Sums of Bounded Random Variables
• Nearest neighbor pattern classification
• The elements of statistical learning. Data mining, inference, and prediction

This page was built for publication: Theoretical analysis of cross-validation for estimating the risk of the k-Nearest Neighbor classifier