Integrative conformal p-values for powerful out-of-distribution testing with labeled outliers

Author name not available (Why is that?)

Publication date: 23 August 2022

Abstract: This paper develops novel conformal methods to test whether a new observation was sampled from the same distribution as a reference set. Blending inductive and transductive conformal inference in an innovative way, the described methods can re-weight standard conformal p-values based on dependent side information from known out-of-distribution data in a principled way, and can automatically take advantage of the most powerful model from any collection of one-class and binary classifiers. The solution can be implemented either through sample splitting or via a novel transductive cross-validation+ scheme which may also be useful in other applications of conformal inference, due to tighter guarantees compared to existing cross-validation approaches. After studying false discovery rate control and power within a multiple testing framework with several possible outliers, the proposed solution is shown to outperform standard conformal p-values through simulations as well as applications to image recognition and tabular data.

Has companion code repository: https://github.com/ZiyiLiang/weighted_conformal_pvalues

This page was built for publication: Integrative conformal p-values for powerful out-of-distribution testing with labeled outliers

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6408607)