Higher Criticism for Discriminating Word-Frequency Tables and Testing Authorship

DOI10.48550/arXiv.1911.01208zbMath1498.62348arXiv1911.01208OpenAlexW4282571011MaRDI QIDQ141519

Alon Kipnis, Alon Kipnis

Publication date: 30 October 2019

Published in: The Annals of Applied Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1911.01208

zbMATH Keywords

unsupervised learninghigher criticismfeature selectionnonparametric methodsauthorship attributiontwo-sample testing

Mathematics Subject Classification ID

Nonparametric hypothesis testing (62G10) Applications of statistics (62P99)

Related Items (2)

Higher criticism to compare two large frequency tables, with sensitivity to possible rare and weak differences ⋮ TableHC

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Innovated higher criticism for detecting sparse signals in correlated noise
• Higher criticism for large-scale inference, especially for rare and weak effects
• Influential features PCA for high dimensional clustering
• Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism
• The sparse Poisson means model
• Hierarchical relational models for document networks
• A correlated topic model of science
• Applied Bayesian and classical inference. The case of the Federalist papers. 2nd ed. of: Inference and disputed authorship: The Federalist
• Hypothesis testing for high-dimensional multinomials: a selective review
• Higher criticism for detecting sparse heterogeneous mixtures.
• Dating medieval English charters
• Detection boundary in sparse regression
• Higher criticism to compare two large frequency tables, with sensitivity to possible rare and weak differences
• Hypothesis testing for densities and high-dimensional multinomials: sharp local minimax rates
• Hypothesis testing for high-dimensional sparse binary regression
• Higher criticism: \(p\)-values and criticism
• Goodness-of-fit tests via phi-divergences
• Estimation and confidence sets for sparse normal mixtures
• Higher criticism thresholding: Optimal feature selection when useful features are rare and weak
• Optimal Detection of Heterogeneous and Heteroscedastic Mixtures
• Rare and weak effects in large-scale inference: methods and phase diagrams
• Introduction to Information Retrieval
• Feature selection by higher criticism thresholding achieves the optimal phase diagram
• Did Shakespeare write a newly-discovered poem?
• Association Pattern Discovery Via Theme Dictionary Models
• Asymptotically Optimal Tests for Multinomial Distributions
• Inference in an Authorship Problem

This page was built for publication: Higher Criticism for Discriminating Word-Frequency Tables and Testing Authorship