Diffusion Maps is not Dimensionality Reduction

2026-03-30

AI Summary

Diffusion maps (DMAP) are often misapplied as direct dimensionality reduction tools, yet they fundamentally provide a spectral representation reflecting the intrinsic geometry of the underlying manifold; accurate low-dimensional coordinates must be reconstructed via linear combinations of multiple diffusion modes. This study systematically evaluates DMAP, Isomap, and UMAP in recovering the true structure of the Swiss roll dataset—whose ground-truth isometric coordinates are known—across varying latent space dimensions. An ideal affine readout mechanism is introduced to quantify reconstruction error objectively. Results demonstrate that Isomap most faithfully recovers the true manifold structure, followed by UMAP, whereas DMAP achieves accurate reconstruction only when integrating information from multiple diffusion modes, thereby confirming its nature as a spectral embedding method rather than a direct coordinate recovery technique.

Abstract

Diffusion maps (DMAP) are often used as a dimensionality-reduction tool, but more precisely they provide a spectral representation of the intrinsic geometry rather than a complete charting method. To illustrate this distinction, we study a Swiss roll with known isometric coordinates and compare DMAP, Isomap, and UMAP across latent dimensions. For each representation, we fit an oracle affine readout to the ground-truth chart and measure reconstruction error. Isomap most efficiently recovers the low-dimensional chart, UMAP provides an intermediate tradeoff, and DMAP becomes accurate only after combining multiple diffusion modes. Thus the correct chart lies in the span of diffusion coordinates, but standard DMAP do not by themselves identify the appropriate combination.

Problem

• Diffusion Maps
• dimensionality reduction
• manifold learning
• intrinsic geometry
• coordinate chart

Innovation

• Diffusion Maps
• dimensionality reduction
• intrinsic geometry
• spectral representation
• Swiss roll