Text + Sketch: Image Compression at Ultra Low Rates
From MaRDI portal
Publication:6442624
arXiv2307.01944MaRDI QIDQ6442624
Author name not available (Why is that?)
Publication date: 4 July 2023
Abstract: Recent advances in text-to-image generative models provide the ability to generate high-quality images from short text descriptions. These foundation models, when pre-trained on billion-scale datasets, are effective for various downstream tasks with little or no further training. A natural question to ask is how such models may be adapted for image compression. We investigate several techniques in which the pre-trained models can be directly used to implement compression schemes targeting novel low rate regimes. We show how text descriptions can be used in conjunction with side information to generate high-fidelity reconstructions that preserve both semantics and spatial structure of the original. We demonstrate that at very low bit-rates, our method can significantly improve upon learned compressors in terms of perceptual and semantic fidelity, despite no end-to-end training.
Has companion code repository: https://github.com/leieric/text-sketch
This page was built for publication: Text + Sketch: Image Compression at Ultra Low Rates
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6442624)
