Optimal rates for regularization of statistical inverse learning problems

DOI10.1007/s10208-017-9359-7zbMath1412.62042arXiv1604.04054OpenAlexW2963053844MaRDI QIDQ667648

Nicole Mücke, Gilles Blanchard

Publication date: 1 March 2019

Published in: Foundations of Computational Mathematics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1604.04054

zbMATH Keywords

inverse problemreproducing kernel Hilbert spaceminimax convergence ratesstatistical learningspectral regularization

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20) Computational learning theory (68Q32) Numerical solution to inverse problems in abstract spaces (65J22) Linear operators in reproducing-kernel Hilbert spaces (including de Branges, de Branges-Rovnyak, and other structured spaces) (47B32)

Related Items (37)

Construction and Monte Carlo estimation of wavelet frames generated by a reproducing kernel ⋮ Two-Layer Neural Networks with Values in a Banach Space ⋮ Distributed spectral pairwise ranking algorithms ⋮ Lower bounds for invariant statistical models with applications to principal component analysis ⋮ Shearlet-based regularization in statistical inverse learning with an application to x-ray tomography ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Rates of convergence of randomized Kaczmarz algorithms in Hilbert spaces ⋮ Convergence of regularization methods with filter functions for a regularization parameter chosen with GSURE and mildly ill-posed inverse problems ⋮ A note on the prediction error of principal component regression in high dimensions ⋮ Mini-workshop: Mathematical foundations of robust and generalizable learning. Abstracts from the mini-workshop held October 2--8, 2022 ⋮ Learning rates for the kernel regularized regression with a differentiable strongly convex loss ⋮ Tikhonov regularization with oversmoothing penalty for nonlinear statistical inverse problems ⋮ Convergence analysis of Tikhonov regularization for non-linear statistical inverse problems ⋮ Convex regularization in statistical inverse learning problems ⋮ Unnamed Item ⋮ Optimality of regularized least squares ranking with imperfect kernels ⋮ Inverse learning in Hilbert scales ⋮ Sketching with Spherical Designs for Noisy Data Fitting on Spheres ⋮ Nonlinear Tikhonov regularization in Hilbert scales for inverse learning ⋮ Kernel regression, minimax rates and effective dimensionality: Beyond the regular case ⋮ On the Improved Rates of Convergence for Matérn-Type Kernel Ridge Regression with Application to Calibration of Computer Models ⋮ Kernel conjugate gradient methods with random projections ⋮ Nyström subsampling method for coefficient-based regularized regression ⋮ Online regularized pairwise learning with least squares loss ⋮ Convergence analysis of distributed multi-penalty regularized pairwise learning ⋮ Convergence Rates of Spectral Regularization Methods: A Comparison between Ill-Posed Inverse Problems and Statistical Kernel Learning ⋮ The empirical process of residuals from an inverse regression ⋮ Concentration of weakly dependent Banach-valued sums and applications to statistical learning methods ⋮ An elementary analysis of ridge regression with random design ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Bayesian frequentist bounds for machine learning and system identification ⋮ Error analysis of the kernel regularized regression based on refined convex losses and RKBSs ⋮ From inexact optimization to learning via gradient concentration ⋮ Regularization: From Inverse Problems to Large-Scale Machine Learning

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Inverse statistical learning
• Optimal learning rates for least squares regularized regression with unbounded sampling
• Regularization in kernel learning
• On regularization algorithms in learning theory
• A distribution-free theory of nonparametric regression
• Best choices for regularization parameters in learning theory: on the bias-variance problem.
• Minimax fast rates for discriminant analysis with errors in variables
• Optimal rates for the regularized least-squares algorithm
• Approximation methods for supervised learning
• Approximation in learning theory
• Shannon sampling. II: Connections to learning theory
• Learning theory estimates via integral operators and their approximations
• On early stopping in gradient descent learning
• Frechet derivatives of the power function
• Convergence rates of Kernel Conjugate Gradient for random design regression
• Convergence Characteristics of Methods of Regularization Estimators for Nonlinear Operator Equations
• DISCRETIZATION ERROR ANALYSIS FOR TIKHONOV REGULARIZATION
• Support Vector Machines
• Spectral Algorithms for Supervised Learning
• CROSS-VALIDATION BASED ADAPTATION FOR REGULARIZATION OPERATORS IN LEARNING THEORY
• Geometry of linear ill-posed problems in variable Hilbert scales
• Boosting With theL₂Loss
• Convergence Rates of General Regularization Methods for Statistical Inverse Problems and Applications
• Introduction to nonparametric estimation

This page was built for publication: Optimal rates for regularization of statistical inverse learning problems