🤖 AI Summary
Existing 3D generative models produce high-fidelity geometries but fail to guarantee engineering-relevant physical properties—such as automotive aerodynamic efficiency—due to the absence of explicit physical modeling. To address this, we propose a physics-guided 3D shape generation framework. Our method introduces a physics-aware flow matching model integrated with an alternating update mechanism that embeds physical constraints directly into the generative process. Additionally, we design a Shape-Physics joint variational autoencoder (SP-VAE) that unifies flow matching, physics-based regularization, and latent-space physics fine-tuning. Extensive experiments across three benchmarks demonstrate that our approach significantly outperforms state-of-the-art methods in both physical plausibility and visual fidelity. To the best of our knowledge, this is the first work to achieve end-to-end differentiable 3D structural synthesis explicitly driven by physical laws.
📝 Abstract
Existing generative models for 3D shapes can synthesize high-fidelity and visually plausible shapes. For certain classes of shapes that have undergone an engineering design process, the realism of the shape is tightly coupled with the underlying physical properties, e.g., aerodynamic efficiency for automobiles. Since existing methods lack knowledge of such physics, they are unable to use this knowledge to enhance the realism of shape generation. Motivated by this, we propose a unified physics-based 3D shape generation pipeline, with a focus on industrial design applications. Specifically, we introduce a new flow matching model with explicit physical guidance, consisting of an alternating update process. We iteratively perform a velocity-based update and a physics-based refinement, progressively adjusting the latent code to align with the desired 3D shapes and physical properties. We further strengthen physical validity by incorporating a physics-aware regularization term into the velocity-based update step. To support such physics-guided updates, we build a shape-and-physics variational autoencoder (SP-VAE) that jointly encodes shape and physics information into a unified latent space. The experiments on three benchmarks show that this synergistic formulation improves shape realism beyond mere visual plausibility.