Wyckoff Transformer: Generation of Symmetric Crystals

2025-03-04

AI Summary

Existing crystal generation models neglect space-group symmetry constraints, leading to physically implausible and energetically unstable structures. To address this, we propose the first physics-driven generative framework grounded in discrete Wyckoff position representations. Our method introduces a novel position-encoding-free, permutation-invariant autoregressive Transformer that explicitly enforces space-group symmetry as a hard constraint during generation—thereby unifying symmetry fidelity, structural stability, and property predictability. Evaluated across multiple benchmarks, our approach significantly outperforms state-of-the-art models in symmetry fidelity (measured via space-group consistency), energy stability (via DFT-calculated formation energies), property prediction accuracy (e.g., bandgap, bulk modulus), and inference speed. Notably, it achieves, for the first time, controllable generation of high-quality, symmetry-compliant crystals under strict space-group constraints.

Technology Category

• Machine Learning: Deep Generative Models & Autoencoders
• Natural Language Processing: Generation
• Computer Vision: Generative Adversarial Networks (GANs) for Vision

Application Category

• Economics, Online Markets and Human Computation: Economic ramifications for generative AI infrastructure and applications
• Social Networks and Social Media: Generative AI / large language models and their impact on social systems
• Web Mining and Content Analysis: Web data generation and simulation

Abstract

Symmetry rules that atoms obey when they bond together to form an ordered crystal play a fundamental role in determining their physical, chemical, and electronic properties such as electrical and thermal conductivity, optical and polarization behavior, and mechanical strength. Almost all known crystalline materials have internal symmetry. Consistently generating stable crystal structures is still an open challenge, specifically because such symmetry rules are not accounted for. To address this issue, we propose WyFormer, a generative model for materials conditioned on space group symmetry. We use Wyckoff positions as the basis for an elegant, compressed, and discrete structure representation. To model the distribution, we develop a permutation-invariant autoregressive model based on the Transformer and an absence of positional encoding. WyFormer has a unique and powerful synergy of attributes, proven by extensive experimentation: best-in-class symmetry-conditioned generation, physics-motivated inductive bias, competitive stability of the generated structures, competitive material property prediction quality, and unparalleled inference speed.

Problem

• Generating stable crystal structures with symmetry rules
• Addressing challenges in symmetry-conditioned material generation
• Improving material property prediction and inference speed

Innovation

• Generative model for symmetric crystal structures
• Transformer-based autoregressive model without positional encoding
• Uses Wyckoff positions for compressed structure representation