Optimal weighted nearest neighbour classifiers

DOI10.1214/12-AOS1049zbMath1373.62317arXiv1101.5783WikidataQ56533609 ScholiaQ56533609MaRDI QIDQ741805

Richard J. Samworth

Publication date: 15 September 2014

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1101.5783

zbMATH Keywords

classificationbaggingnearest neighboursweighted nearest neighbour classifiers

Mathematics Subject Classification ID

Asymptotic properties of nonparametric inference (62G20) Classification and discrimination; cluster analysis (statistical aspects) (62H30)

Related Items (30)

Measuring the Algorithmic Convergence of Randomized Ensembles: The Regression Setting ⋮ Methodically unified procedures for a conditional approach to outlier detection, clustering, and classification ⋮ Classification in general finite dimensional spaces with the \(k\)-nearest neighbor rule ⋮ Ensemble of a subset of \(k\)NN classifiers ⋮ Estimation and Inference of Heterogeneous Treatment Effects using Random Forests ⋮ Transfer learning for nonparametric classification: minimax rate and adaptive classifier ⋮ Weather daily data approximation using point adaptive ellipsoidal neighborhood in scattered data interpolation methods ⋮ Optimal functional supervised classification with separation condition ⋮ Benefit of Interpolation in Nearest Neighbor Algorithms ⋮ An Outer-Product-of-Gradient Approach to Dimension Reduction and its Application to Classification in High Dimensional Space ⋮ An adaptive multiclass nearest neighbor classifier ⋮ Self-supervised Metric Learning in Multi-View Data: A Downstream Task Perspective ⋮ Local nearest neighbour classification with applications to semi-supervised learning ⋮ Optimal Nonparametric Inference with Two-Scale Distributional Nearest Neighbors ⋮ Distributed adaptive nearest neighbor classifier: algorithm and theory ⋮ A weighted \(k\)-nearest neighbor density estimate for geometric inference ⋮ Nonparametric estimation of surface integrals on level sets ⋮ Unnamed Item ⋮ A regionalisation approach for rainfall based on extremal dependence ⋮ A nearest-neighbor based nonparametric test for viral remodeling in heterogeneous single-cell proteomic data ⋮ Asymptotics and optimal bandwidth for nonparametric estimation of density level sets ⋮ Optimal weighted nearest neighbour classifiers ⋮ Using Network Analysis to Improve Nearest Neighbor Classification of Non-network Data ⋮ Pairwise local Fisher and naive Bayes: improving two standard discriminants ⋮ Marginal singularity and the benefits of labels in covariate-shift ⋮ Adaptive transfer learning ⋮ Unnamed Item ⋮ Tnn: a transfer learning classifier based on weighted nearest neighbors ⋮ Probability estimation with machine learning methods for dichotomous and multicategory outcome: Theory ⋮ Probability estimation with machine learning methods for dichotomous and multicategory outcome: Applications

Uses Software

• UCI-ml

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• On the layered nearest neighbour estimate, the bagged nearest neighbour estimate and the random forest method in regression and classification
• Optimal rates for plug-in estimators of density level sets
• Optimal weighted nearest neighbour classifiers
• Choice of neighbor order in nearest-neighbor classification
• Asymptotics and optimal bandwidth selection for highest density region estimation
• Fast learning rates for plug-in classifiers
• Asymptotic estimate of probability of misclassification for discriminant rules based on density estimates
• Consistent nonparametric regression. Discussion
• Heuristics of instability and stabilization in model selection
• Results in statistical discriminant analysis: A review of the former Soviet Union literature.
• Smooth discrimination analysis
• Bandwidth choice for nonparametric classification
• Optimal aggregation of classifiers in statistical learning.
• Support-vector networks
• Measuring mass concentrations and estimating density contour clusters -- An excess mass approach
• Statistical performance of support vector machines
• Asymptotically Minimax Adaptive Estimation. I: Upper Bounds. Optimally Adaptive Estimates
• Discriminatory Analysis. Nonparametric Discrimination: Consistency Properties
• Theory of Classification: a Survey of Some Recent Advances
• Support Vector Machines
• A Note on Distance-Weighted k-Nearest Neighbor Rules
• Properties of Bagged Nearest Neighbour Classifiers
• Nearest neighbor pattern classification
• Random forests
• Using iterated bagging to debias regressions

This page was built for publication: Optimal weighted nearest neighbour classifiers