Towards improving discriminative reconstruction via simultaneous dense and sparse coding

arXiv2006.09534MaRDI QIDQ6343081

Author name not available (Why is that?)

Publication date: 16 June 2020

Abstract: Discriminative features extracted from the sparse coding model have been shown to perform well for classification. Recent deep learning architectures have further improved reconstruction in inverse problems by considering new dense priors learned from data. We propose a novel dense and sparse coding model that integrates both representation capability and discriminative features. The model studies the problem of recovering a dense vector $mathbfx$ and a sparse vector $mathbfu$ given measurements of the form $mathbfy=mathbfAmathbfx+mathbfBmathbfu$. Our first analysis proposes a geometric condition based on the minimal angle between spanning subspaces corresponding to the matrices $mathbfA$ and $mathbfB$ that guarantees unique solution to the model. The second analysis shows that, under mild assumptions, a convex program recovers the dense and sparse components. We validate the effectiveness of the model on simulated data and propose a dense and sparse autoencoder (DenSaE) tailored to learning the dictionaries from the dense and sparse model. We demonstrate that (i) DenSaE denoises natural images better than architectures derived from the sparse coding model ($mathbfBmathbfu$), (ii) in the presence of noise, training the biases in the latter amounts to implicitly learning the $mathbfAmathbfx+mathbfBmathbfu$ model, (iii) $mathbfA$ and $mathbfB$ capture low- and high-frequency contents, respectively, and (iv) compared to the sparse coding model, DenSaE offers a balance between discriminative power and representation.

Has companion code repository: https://github.com/btolooshams/densae

This page was built for publication: Towards improving discriminative reconstruction via simultaneous dense and sparse coding

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6343081)