Training robust neural networks using Lipschitz bounds
From MaRDI portal
Publication:6340180
arXiv2005.02929MaRDI QIDQ6340180
Author name not available (Why is that?)
Publication date: 6 May 2020
Abstract: Due to their susceptibility to adversarial perturbations, neural networks (NNs) are hardly used in safety-critical applications. One measure of robustness to such perturbations in the input is the Lipschitz constant of the input-output map defined by an NN. In this work, we propose a framework to train multi-layer NNs while at the same time encouraging robustness by keeping their Lipschitz constant small, thus addressing the robustness issue. More specifically, we design an optimization scheme based on the Alternating Direction Method of Multipliers that minimizes not only the training loss of an NN but also its Lipschitz constant resulting in a semidefinite programming based training procedure that promotes robustness. We design two versions of this training procedure. The first one includes a regularizer that penalizes an accurate upper bound on the Lipschitz constant. The second one allows to enforce a desired Lipschitz bound on the NN at all times during training. Finally, we provide two examples to show that the proposed framework successfully increases the robustness of NNs.
Has companion code repository: https://github.com/st157640/Training-robust-neural-networks-using-Lipschitz-bounds
This page was built for publication: Training robust neural networks using Lipschitz bounds
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6340180)
