An experimental comparison of cross-validation techniques for estimating the area under the ROC curve

DOI10.1016/j.csda.2010.11.018zbMath1328.65018OpenAlexW2005918389WikidataQ60256947 ScholiaQ60256947MaRDI QIDQ901569

Willem Waegeman, Tapio Salakoski, Bernard De Baets, Antti Airola, Tapio Pahikkala

Publication date: 12 January 2016

Published in: Computational Statistics and Data Analysis (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.csda.2010.11.018

zbMATH Keywords

cross-validationarea under the ROC curveclassifier performance estimationconditional AUC estimationleave-pair-out cross-validation

Mathematics Subject Classification ID

Related Items (8)

Three-group ROC analysis: a nonparametric predictive approach ⋮ Quicksort leave-pair-out cross-validation for ROC curve analysis ⋮ The leave-worst-\(k\)-out criterion for cross validation ⋮ On the ERA ranking representability of pairwise bipartite ranking functions ⋮ An efficient variance estimator for cross-validation under partition sampling ⋮ Unnamed Item ⋮ Optimality of training/test size and resampling effectiveness in cross-validation ⋮ Improved Small-Sample Estimation of Nonlinear Cross-Validated Prediction Metrics

Uses Software

• bmrm

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Fast cross-validation algorithms for least squares support vector machine and kernel ridge regression
• Estimating classification error rate: repeated cross-validation, repeated hold-out and bootstrap
• Matrix representations, linear transformations, and kernels for disambiguation in natural language
• A response to Webb and Ting's on the application of ROC analysis to predict classification performance under varying class distributions
• An efficient algorithm for learning to rank from preference graphs
• A critical analysis of variants of the AUC
• Measuring the Accuracy of Diagnostic Systems
• ASSESSING ERROR RATE ESTIMATORS: THE LEAVE‐ONE‐OUT METHOD RECONSIDERED
• Ten More Years of Error Rate Research
• An Alternative Ranking Problem for Search Engines
• Ridge Regression: Biased Estimation for Nonorthogonal Problems
• Multicategory proximal support vector machine classifiers
• On the dual formulation of regularized linear systems with convex risks

This page was built for publication: An experimental comparison of cross-validation techniques for estimating the area under the ROC curve