opXRD: Open Experimental Powder X-ray Diffraction Database

2025-03-07

AI Summary

Automated analysis of experimental powder X-ray diffraction (pXRD) data is hindered by the scarcity of high-quality labeled datasets; existing models rely predominantly on simulated data and thus exhibit poor generalization to real-world pXRD patterns characterized by high noise and strong background interference. Method: We introduce the first open-source, large-scale experimental pXRD database—comprising 2,179 expert-annotated spectra and extensive unlabeled real measurements—covering diverse inorganic materials. The database features standardized acquisition protocols, crystallographically precise phase annotations, and an openly accessible architecture. Contribution/Results: This resource systematically bridges the performance gap between simulation-based and experimentally grounded models for the first time. It significantly improves phase identification accuracy and robustness on real pXRD data, enables noise-robust evaluation and cross-domain transfer learning, and establishes a foundational data infrastructure for fully automated, self-driving pXRD analysis in modern laboratories.

Technology Category

• Data Mining & Knowledge Management: Other Foundations of Data Mining & Knowledge Management
• Machine Learning: Evaluation and Analysis
• Knowledge Representation and Reasoning: Diagnosis and Abductive Reasoning

Application Category

• Web Mining and Content Analysis: Large pretrained models with web data
• Economics, Online Markets and Human Computation: Data quality aspects of human-annotated datasets
• Responsible Web: Data and user privacy-enhancing technologies for the Web

Abstract

Powder X-ray diffraction (pXRD) experiments are a cornerstone for materials structure characterization. Despite their widespread application, analyzing pXRD diffractograms still presents a significant challenge to automation and a bottleneck in high-throughput discovery in self-driving labs. Machine learning promises to resolve this bottleneck by enabling automated powder diffraction analysis. A notable difficulty in applying machine learning to this domain is the lack of sufficiently sized experimental datasets, which has constrained researchers to train primarily on simulated data. However, models trained on simulated pXRD patterns showed limited generalization to experimental patterns, particularly for low-quality experimental patterns with high noise levels and elevated backgrounds. With the Open Experimental Powder X-Ray Diffraction Database (opXRD), we provide an openly available and easily accessible dataset of labeled and unlabeled experimental powder diffractograms. Labeled opXRD data can be used to evaluate the performance of models on experimental data and unlabeled opXRD data can help improve the performance of models on experimental data, e.g. through transfer learning methods. We collected umpatterns diffractograms, 2179 of them labeled, from a wide spectrum of materials classes. We hope this ongoing effort can guide machine learning research toward fully automated analysis of pXRD data and thus enable future self-driving materials labs.

Problem

• Automating powder X-ray diffraction analysis for materials characterization
• Overcoming limited generalization of models trained on simulated data
• Providing an open experimental dataset to improve machine learning models

Innovation

• Open database for experimental pXRD data
• Machine learning for automated diffraction analysis
• Transfer learning to improve model performance