Neural network training under semidefinite constraints

Author name not available (Why is that?)

Publication date: 3 January 2022

Abstract: This paper is concerned with the training of neural networks (NNs) under semidefinite constraints, which allows for NN training with robustness and stability guarantees. In particular, we focus on Lipschitz bounds for NNs. Exploiting the banded structure of the underlying matrix constraint, we set up an efficient and scalable training scheme for NN training problems of this kind based on interior point methods. Our implementation allows to enforce Lipschitz constraints in the training of large-scale deep NNs such as Wasserstein generative adversarial networks (WGANs) via semidefinite constraints. In numerical examples, we show the superiority of our method and its applicability to WGAN training.

Has companion code repository: https://github.com/eragon10/neural_network_training_with_matrix_inequality_constraints

This page was built for publication: Neural network training under semidefinite constraints

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6387375)