Adjusted Pearson chi-square feature screening for multi-classification with ultrahigh dimensional data
type: Item
instance of: scholarly article
title: Adjusted Pearson chi-square feature screening for multi-classification with ultrahigh dimensional data
zbMATH Open document ID: 1390.62113
author: Lyu Ni
author: Fang Fang
author: Fangjiao Wan
published in: Metrika
publication date: 2017-12-01T00:00:00Z
review text: The statistical setting is that of \(n\) independent observations of a categorical response \(Y\) and of \(p\) covariates \(X_1\), \dots, \(X_p\). Let \(S\) be the subset of \(\{1,\dots,p\}\) with the indices of the covariates that statistically relates to the response. The aim of the paper is to develop an estimator \(\hat{S}\) with the sure screening property. This means that \(S\) with high probability is a subset of \(\hat{S}\). The paper considers both categorical and continuous covariates, but the proposed method works by categorizing continuous covariates at their sample percentiles. The estimator \(\hat{S}\) is constructed by ranking the covariates according to an adjusted Pearson chi-square statistic computed separately between the response and each of the covariates. Here adjusted entails that the classical Pearson chi-square statistic is normalized by the logarithm of the number of levels of the covariate. Lower bounds on the probability \(P(S \subseteq \hat{S})\) entailing the sure screening property are provided and proved. These bounds extend previous research in several ways. Firstly, the paper explicitly accounts for both categorical and continuous covariates. Secondly, the bounds are stated explicitly in terms of asymptotic rates on the number of levels \(R\) of the response, the number of levels \(J_k\) of the \(k\)'th covariate (possibly after categorization of a continuous covariate), the number of observations \(n\), and the number of covariates \(p\). That the number of levels \(R\) and \(J_k\) are allowed to increase with the number of observations \(n\) is referred to as diverging classes in the paper. The paper also contains simulation studies supporting the theoretical results, as well as exemplifying small sample behaviour of the proposed methods. Finally, the paper also contains a real data analysis with \(n=497\) and \(p=1125\). This exemplifies the main application of the proposed methodology, namely when \(p\) is larger than \(n\).
reviewed by: Bo Markussen
Mathematics Subject Classification ID: 62H30
Mathematics Subject Classification ID: 62G10
Mathematics Subject Classification ID: 62G20
zbMATH DE Number: 6814696
zbMATH Keywords: variable selection
zbMATH Keywords: continuous and categorical covariates
zbMATH Keywords: diverging classes
zbMATH Keywords: Pearson chi-square statistics
zbMATH Keywords: sure screening property
describes a project that uses: C4.5
MaRDI profile type: Publication
full work available at URL: s00184-017-0629-9
OpenAlex ID: W2763137833
cites work: Model-Free Feature Screening for Ultrahigh Dimensional Discriminant Analysis
cites work: High-dimensional classification using features annealed independence rules
cites work: Sure Independence Screening for Ultrahigh Dimensional Feature Space
cites work: Sure independence screening in generalized linear models with NP-dimensionality
cites work: Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Varying Coefficient Models
cites work: Quantile-adaptive model-free variable screening for high-dimensional heterogeneous data
cites work: Feature Screening via Distance Correlation Learning
cites work: The Kolmogorov filter for variable screening in high-dimensional binary classification
cites work: The fused Kolmogorov filter: a nonparametric model-free screening method
cites work: Entropy-based model-free feature screening for ultrahigh-dimensional multiclass classification
cites work: Forward Regression for Ultra-High Dimensional Variable Screening
cites work: Model-Free Feature Screening for Ultrahigh-Dimensional Data
DOI: 10.1007/S00184-017-0629-9
description: scientific article; zbMATH DE number 6814696