Valid inferential models for prediction in supervised learning problems
From MaRDI portal
Publication:6386128
DOI10.1016/J.IJAR.2022.08.001arXiv2112.10234MaRDI QIDQ6386128
Publication date: 19 December 2021
Abstract: Prediction, where observed data is used to quantify uncertainty about a future observation, is a fundamental problem in statistics. Prediction sets with coverage probability guarantees are a common solution, but these do not provide probabilistic uncertainty quantification in the sense of assigning beliefs to relevant assertions about the future observable. Alternatively, we recommend the use of a {em probabilistic predictor}, a data-dependent (imprecise) probability distribution for the to-be-predicted observation given the observed data. It is essential that the probabilistic predictor be reliable or valid, and here we offer a notion of validity and explore its behavioral and statistical implications. In particular, we show that valid probabilistic predictors must be imprecise, that they avoid sure loss, and that they lead to prediction procedures with desirable frequentist error rate control properties. We provide a general construction of a provably valid probabilistic predictor, which has close connections to the powerful conformal prediction machinery, and we illustrate this construction in regression and classification applications.
This page was built for publication: Valid inferential models for prediction in supervised learning problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6386128)