Faster Binary Embeddings for Preserving Euclidean Distances

arXiv2010.00712MaRDI QIDQ6350353

Author name not available (Why is that?)

Publication date: 1 October 2020

Abstract: We propose a fast, distance-preserving, binary embedding algorithm to transform a high-dimensional dataset $mathcalTsubseteqmathbb{R}^n$ into binary sequences in the cube ${pm1}^m$. When $mathcalT$ consists of well-spread (i.e., non-sparse) vectors, our embedding method applies a stable noise-shaping quantization scheme to $Ax$ where $Ainmathbb{R}^{mimesn}$ is a sparse Gaussian random matrix. This contrasts with most binary embedding methods, which usually use $xmapstomathrmsign(Ax)$ for the embedding. Moreover, we show that Euclidean distances among the elements of $mathcalT$ are approximated by the $el{l}_1$ norm on the images of ${pm1}^m$ under a fast linear transformation. This again contrasts with standard methods, where the Hamming distance is used instead. Our method is both fast and memory efficient, with time complexity $O(m)$ and space complexity $O(m)$. Further, we prove that the method is accurate and its associated error is comparable to that of a continuous valued Johnson-Lindenstrauss embedding plus a quantization error that admits a polynomial decay as the embedding dimension $m$ increases. Thus the length of the binary codes required to achieve a desired accuracy is quite small, and we show it can even be compressed further without compromising the accuracy. To illustrate our results, we test the proposed method on natural images and show that it achieves strong performance.

Has companion code repository: https://github.com/jayzhang0727/Faster-Binary-Embeddings-for-Preserving-Euclidean-Distances

This page was built for publication: Faster Binary Embeddings for Preserving Euclidean Distances

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6350353)