Consistency and robustness of kernel-based regression in convex risk minimization

DOI10.3150/07-BEJ5102zbMath1129.62031arXiv0709.0626WikidataQ59196404 ScholiaQ59196404MaRDI QIDQ2469652

Ingo Steinwart, Andreas Christmann

Publication date: 6 February 2008

Published in: Bernoulli (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/0709.0626

zbMATH Keywords

consistencyinfluence functionsensitivity curvesupport vector regression

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Applications of functional analysis in probability theory and statistics (46N30) Numerical methods for mathematical programming, optimization and variational techniques (65K99)

Related Items

Error analysis on Hérmite learning with gradient data ⋮ Robust nonparametric kernel regression estimator ⋮ On the robustness of regularized pairwise learning methods based on kernels ⋮ Prediction of dynamical time series using kernel based regression and smooth splines ⋮ Loan pricing under estimation risk ⋮ Frameworks and results in distributionally robust optimization ⋮ Fast rates of minimum error entropy with heavy-tailed noise ⋮ Modification of the adaptive Nadaraya-Watson kernel method for nonparametric regression (simulation study) ⋮ Learning rates for the kernel regularized regression with a differentiable strongly convex loss ⋮ Kernel-Based Partial Permutation Test for Detecting Heterogeneous Functional Relationship ⋮ Unnamed Item ⋮ Deep learning theory of distribution regression with CNNs ⋮ Estimation of the bandwidth parameter in Nadaraya-Watson kernel non-parametric regression based on universal threshold level ⋮ Feasible generalized least squares using support vector regression ⋮ A review on consistency and robustness properties of support vector machines for heavy-tailed distributions ⋮ Adaptive kernel methods using the balancing principle ⋮ The performance of semi-supervised Laplacian regularized regression with the least square loss ⋮ Learning with Convex Loss and Indefinite Kernels ⋮ Detecting influential observations in kernel PCA ⋮ Robust pairwise learning with Huber loss ⋮ Robust kernel-based distribution regression ⋮ Learning from dependent observations ⋮ On qualitative robustness of support vector machines ⋮ Identifying outliers using multiple kernel canonical correlation analysis with application to imaging genetics ⋮ On a strategy to develop robust and simple tariffs from motor vehicle insurance data ⋮ A two-experiment approach to Wiener system identification ⋮ Performance analysis of the LapRSSLG algorithm in learning theory ⋮ A statistical learning assessment of Huber regression ⋮ Robust learning from bites for data mining ⋮ Consistency of support vector machines for forecasting the evolution of an unknown ergodic dynamical system from observations with unknown noise ⋮ Analysis of support vector machines regression ⋮ Asymptotic normality of support vector machine variants and other regularized kernel methods ⋮ Robustness by reweighting for kernel estimators: an overview ⋮ Privacy-Preserving Parametric Inference: A Case for Robust Statistics ⋮ Testing subspace restrictions in the presence of high dimensional nuisance parameters ⋮ Robustness of reweighted least squares kernel based regression ⋮ Error analysis of the kernel regularized regression based on refined convex losses and RKBSs

Cites Work

• Convex functions, monotone operators and differentiability.
• Aspects of robust linear regression
• An approach to model complex high-dimensional insurance data
• A distribution-free theory of nonparametric regression
• How to compare different loss functions and their risks
• 10.1162/153244302760185252
• Least Median of Squares Regression
• Consistency of Support Vector Machines and Other Regularized Kernel Classifiers
• Consistency of kernel-based quantile regression
• The Influence Curve and Its Role in Robust Estimation
• Real Analysis and Probability
• 10.1162/1532443041827925
• Function Classes That Approximate the Bayes Risk
• Sums of independent Banach space valued random variables
• Robust Statistics
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item