Research

Autoencoding beyond pixels using a learned similarity metric

Authors: Anders Boesen Lindbo Larsen, Søren Kaae Sønderby, Hugo Larochelle, Ole Winther

Authors: Anders Boesen Lindbo Larsen, Søren Kaae Sønderby, Hugo Larochelle, Ole Winther

Publication date: 2015/12/31

Journal: arXiv preprint arXiv:1512.09300

We present an autoencoder that leverages learned representations to better measure similarities in data space. 

By combining a variational autoencoder with a generative adversarial network we can use learned feature representations in the GAN discriminator as basis for the VAE reconstruction objective.

Thereby, we replace element-wise errors with feature-wise errors to better capture the data distribution while offering invariance towards eg translation. We apply our method to images of faces and show that it outperforms VAEs with element-wise similarity measures in terms of visual fidelity.

Moreover, we show that the method learns an embedding in which high-level abstract visual features (eg wearing glasses) can be modified using simple arithmetic.

Download

Similar posts

Sign up for insights from raffle

Get the latest resources, events and webinars sent straight to your inbox. You'll learn about AI, customer service, employee engagement and much more with our knowledge-filled newsletter.