Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 10 additions & 0 deletions content/publication/2026-strano-vaelatents/cite.bib
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
@article{strano2026neural,
title = {How Neural Losses Shape VAE Latents},
author = {Strano, Giorgio and Cerovaz, Luca and Mancusi, Michele and Mencattini, Tommaso and Rodol{\`a}, Emanuele},
journal = {arXiv preprint arXiv:2606.00635},
year = {2026},
url = {https://arxiv.org/abs/2606.00635},
eprint = {2606.00635},
archivePrefix = {arXiv},
primaryClass = {cs.LG}
}
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
56 changes: 56 additions & 0 deletions content/publication/2026-strano-vaelatents/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,56 @@
---
# Documentation: https://wowchemy.com/docs/managing-content/

title: "How Neural Losses Shape VAE Latents"
subtitle: ''
summary: ''
authors:
- strano
- cerovaz
- mancusi
- mencattini
- rodola

# Author notes (optional)
author_notes:
- 'Equal contribution'
- 'Equal contribution'
- 'Equal contribution'
- ''
- ''

tags: []
categories: []
date: '2026-05-30'
lastmod: 2026-06-18T20:33:49+02:00
featured: false
draft: false
publication_short: "arXiv 2026"

# Featured image
# To use, add an image named `featured.jpg/png` to your page's folder.
# Focal points: Smart, Center, TopLeft, Top, TopRight, Left, Right, BottomLeft, Bottom, BottomRight.
image:
caption: ''
focal_point: 'Center'
preview_only: false

# Projects (optional).
# Associate this post with one or more of your projects.
# Simply enter your project's folder or file name without extension.
# E.g. `projects = ["internal-project"]` references `content/project/deep-learning/index.md`.
# Otherwise, set `projects = []`.
projects: []
publishDate: '2026-05-30T09:20:56'
publication_types:
- '3'
abstract: "Modern VAEs are rarely trained with the pointwise likelihood implied by the standard β-VAE objective. In practice, pointwise reconstruction is often combined with perceptual and adversarial losses, despite a lack of understanding of how this changes the latent dynamics of the model. We show that the choice of reconstruction loss reshapes the rate-distortion problem itself, altering both the information content and the geometry of the learned latent space in ways that may be invisible from reconstructions alone. First, we prove and verify empirically that augmenting pointwise reconstruction with neural terms, such as perceptual and adversarial objectives, reduces the amount of information stored in the latent representations. Second, we show that neural reconstruction losses systematically change the geometry of the latent space: they make representations more isotropic and distribute uncertainty more evenly across latent dimensions, producing different posterior variance profiles. These findings highlight how the rate-distortion tradeoff is not a comprehensive lens to understand the behavior of VAEs, and we propose a more mechanistic approach to investigate how the choice of a distortion metric reshapes the optimization problem."

links:
- name: arXiv
url : https://arxiv.org/abs/2606.00635
- name: PDF
url : https://arxiv.org/pdf/2606.00635

publication: '*arXiv preprint arXiv:2606.00635*'
---