Improving the Generation of VAEs with High Dimensional Latent Spaces by the use of Hyperspherical Coordinates

2025-07-21

AI Summary

In high-dimensional latent spaces, VAEs suffer from decoding failure when sampling from standard isotropic Gaussian priors due to the extreme sparsity of uniform distributions in high dimensions—a manifestation of the curse of dimensionality. Method: We propose Spherical Coordinate Reparameterization (SC-VAE), which explicitly maps latent variables onto the unit hypersphere and a radial dimension via a differentiable coordinate transformation. This enforces compact clustering of latent representations on the hypersphere while preserving end-to-end trainability—without architectural modifications or increased computational overhead. Contribution/Results: SC-VAE yields substantial improvements in generative performance for latent dimensions ≥128: FID improves by 30–50%, sample diversity increases, and the probability of generating valid samples under random prior sampling rises significantly. The method provides a lightweight, general-purpose, and theoretically grounded solution to degenerate generation in high-dimensional VAEs.

Technology Category

• Machine Learning: Deep Generative Models & Autoencoders
• Computer Vision: Generative Adversarial Networks (GANs) for Vision
• Search and Optimization: Sampling/Simulation-based Search

Application Category

• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
• User Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking
• Economics, Online Markets and Human Computation: Economic ramifications for generative AI infrastructure and applications

Abstract

Variational autoencoders (VAE) encode data into lower-dimensional latent vectors before decoding those vectors back to data. Once trained, decoding a random latent vector from the prior usually does not produce meaningful data, at least when the latent space has more than a dozen dimensions. In this paper, we investigate this issue by drawing insight from high dimensional statistics: in these regimes, the latent vectors of a standard VAE are by construction distributed uniformly on a hypersphere. We propose to formulate the latent variables of a VAE using hyperspherical coordinates, which allows compressing the latent vectors towards an island on the hypersphere, thereby reducing the latent sparsity and we show that this improves the generation ability of the VAE. We propose a new parameterization of the latent space with limited computational overhead.

Problem

• Improving VAE generation in high-dimensional latent spaces
• Addressing latent sparsity using hyperspherical coordinates
• Enhancing meaningful data generation from random latent vectors

Innovation

• Uses hyperspherical coordinates for VAE
• Compresses latent vectors to hypersphere island
• Reduces latent sparsity improving generation