NAE: Normalizing AutoEncoder
This work addresses a critical inconsistency between the existing loss functions used in flow-based autoencoders and their reconstruction objectives, which leads to suboptimal training dynamics. The paper provides the first theoretical analysis of this misalignment and introduces a novel conditional loss function designed to align the surrogate gradients of the encoder and decoder with the true reconstruction loss. By preserving the established architecture that combines normalizing flows with autoencoders, the proposed method significantly enhances generative performance. It achieves state-of-the-art results across diverse benchmarks—including molecular generation, tabular data modeling, and image synthesis—demonstrating both its effectiveness and broad applicability.