Classification accuracy as a proxy for two-sample testing

DOI10.1214/20-AOS1962zbMath1461.62100arXiv1602.02210MaRDI QIDQ2656602

Aaditya Ramdas, Aarti Singh, Ilmun Kim, Larry Alan Wasserman

Publication date: 11 March 2021

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1602.02210

zbMATH Keywords

permutation testlinear discriminant analysisHotelling's \(T^2\) testhigh-dimensional asymptoticsclassification accuracytwo sample testing

Mathematics Subject Classification ID

Asymptotic distribution theory in statistics (62E20) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Hypothesis testing in multivariate analysis (62H15)

Related Items

Minimax optimality of permutation tests, On the use of random forest for two-sample testing, Testing for outliers with conformal p-values, Detecting distributional differences in labeled sequence data with application to tropical cyclone satellite imagery, Model-independent detection of new physics signals using interpretable semisupervised classifier tests, Dimension-agnostic inference using cross U-statistics, Global and local two-sample tests via regression, On the power of conditional independence testing under model-X, Local permutation tests for conditional independence

Uses Software

• hypoRF

Cites Work

• A two sample test in high dimensional data
• A review of 20 years of naive tests of significance for high-dimensional mean vectors and covariance matrices
• A multivariate two-sample test based on the number of nearest neighbor type coincidences
• Multivariate generalizations of the Wald-Wolfowitz and Smirnov two-sample tests
• A robustness property of Hotelling's \(T^ 2-\)test
• Results in statistical discriminant analysis: A review of the former Soviet Union literature.
• A survey on continuous elliptical vector distributions
• Some theory for Fisher's linear discriminant function, `naive Bayes', and some alternatives when there are many more variables than observations
• Asymptotic distribution and detection thresholds for two-sample tests based on geometric graphs
• The classification permutation test: a flexible approach to testing for covariate imbalance in observational studies
• A two-sample test for high-dimensional data with applications to gene-set testing
• A test for the mean vector with fewer observations than the dimension
• On Mardia's and Song's measures of kurtosis in elliptical distributions
• A Neyman–Pearson Approach to Statistical Learning
• Multivariate Two-Sample Tests Based on Nearest Neighbors
• Minimax character of the two-sample χ²-test
• Asymptotic Statistics
• The Generalization of Student's Ratio
• Analytic Study of Performance of Error Estimators for Linear Discriminant Analysis
• False Discovery Proportion Estimation by Permutations: Confidence for Significance Analysis of Microarrays
• Remember the curse of dimensionality: the case of goodness-of-fit testing in arbitrary dimension
• Local and Asymptotic Minimax Properties of Multivariate Tests
• An Exact Distribution-Free Test Comparing Two Multivariate Distributions based on Adjacency
• Minimax Character of Hotelling's $T^2$ Test in the Simplest Case
• ON AN OPTIMUM PROPERTY OF TWO IMPORTANT STATISTICAL TESTS
• On a Statistical Problem Arising in the Classification of an Individual into One of Two Groups
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item