PAC-Bayesian bounds for randomized empirical risk minimizers

DOI10.3103/S1066530708040017zbMath1260.62038arXiv0712.1698OpenAlexW2067940717MaRDI QIDQ734547

Pierre Alquier

Publication date: 13 October 2009

Published in: Mathematical Methods of Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/0712.1698

zbMATH Keywords

classificationregression estimationstatistical learningadaptive inferenceempirical boundrandomized estimator

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Learning and adaptive systems in artificial intelligence (68T05)

Related Items (15)

PAC-Bayesian high dimensional bipartite ranking ⋮ Challenging the empirical mean and empirical variance: a deviation study ⋮ User-friendly Introduction to PAC-Bayes Bounds ⋮ From robust tests to Bayes-like posterior distributions ⋮ Gibbs posterior concentration rates under sub-exponential type losses ⋮ PAC-Bayesian estimation and prediction in sparse additive models ⋮ Sparse regression learning by aggregation and Langevin Monte-Carlo ⋮ PAC-Bayesian bounds for sparse regression estimation with exponential weights ⋮ Model selection for weakly dependent time series forecasting ⋮ Mirror averaging with sparsity priors ⋮ Model misspecification, Bayesian versus credibility estimation, and Gibbs posteriors ⋮ Prediction of time series by statistical learning: general losses and fast rates ⋮ Estimation from nonlinear observations via convex programming with application to bilinear regression ⋮ On some recent advances on high dimensional Bayesian statistics ⋮ Gibbs posterior inference on multivariate quantiles

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Modeling by shortest data description
• Smooth discrimination analysis
• Boosting the margin: a new explanation for the effectiveness of voting methods
• Statistical behavior and consistency of classification methods based on convex risk minimization.
• Optimal aggregation of classifiers in statistical learning.
• Aggregated estimators and empirical complexity for least square regression
• Support-vector networks
• Optimal rates and adaptation in the single-index model using aggregation
• Theory of Classification: a Survey of Some Recent Advances
• Probability Inequalities for Sums of Bounded Random Variables
• The elements of statistical learning. Data mining, inference, and prediction

This page was built for publication: PAC-Bayesian bounds for randomized empirical risk minimizers