Estimating Conditional Mutual Information for Dynamic Feature Selection

Author name not available (Why is that?)

Publication date: 5 June 2023

Abstract: Dynamic feature selection, where we sequentially query features to make accurate predictions with a minimal budget, is a promising paradigm to reduce feature acquisition costs and provide transparency into the prediction process. The problem is challenging, however, as it requires both making predictions with arbitrary feature sets and learning a policy to identify the most valuable selections. Here, we take an information-theoretic perspective and prioritize features based on their mutual information with the response variable. The main challenge is learning this selection policy, and we design a straightforward new modeling approach that estimates the mutual information in a discriminative rather than generative fashion. Building on our learning approach, we introduce several further improvements: allowing variable feature budgets across samples, enabling non-uniform costs between features, incorporating prior information, and exploring modern architectures to handle partial input information. We find that our method provides consistent gains over recent state-of-the-art methods across a variety of datasets.

Has companion code repository: https://github.com/suinleelab/dime

This page was built for publication: Estimating Conditional Mutual Information for Dynamic Feature Selection

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6439320)