Worth of knowledge in deep learning

Author name not available (Why is that?)

Publication date: 2 July 2023

Abstract: Knowledge constitutes the accumulated understanding and experience that humans use to gain insight into the world. In deep learning, prior knowledge is essential for mitigating shortcomings of data-driven models, such as data dependence, generalization ability, and compliance with constraints. To enable efficient evaluation of the worth of knowledge, we present a framework inspired by interpretable machine learning. Through quantitative experiments, we assess the influence of data volume and estimation range on the worth of knowledge. Our findings elucidate the complex relationship between data and knowledge, including dependence, synergistic, and substitution effects. Our model-agnostic framework can be applied to a variety of common network architectures, providing a comprehensive understanding of the role of prior knowledge in deep learning models. It can also be used to improve the performance of informed machine learning, as well as distinguish improper prior knowledge.

Has companion code repository: https://github.com/woshixuhao/worth_of_knowledge

This page was built for publication: Worth of knowledge in deep learning

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6442325)