Multi-Dataset Inverse Problem Solving with Distributed Generative AI

2026-08-26

AI Summary

本文提出了一种基于分布式生成AI的框架，用于从多个异构数据集中同时分析并提取未知参数，解决了多数据集逆问题中的计算和异质性挑战。

Abstract

Extracting a shared set of unknown, not directly measurable quantities from multiple, heterogeneous datasets is a common challenge across scientific domains. A prominent example is the combination of datasets obtained from different measurements with different settings (e.g. varying detector resolutions). Analyzing such datasets jointly, rather than independently or after naive merging, is essential for obtaining precise and unbiased estimates of the unknowns, but requires careful treatment of dataset heterogeneity and is computationally demanding. We present a generalized framework for simultaneously analyzing multiple heterogeneous datasets in the context of generative AI-based inverse problem solvers. Building on our recent Scalable Asynchronous Generative Inverse Problem Solver (SAGIPS) framework, we extend the well-established distributed data-parallel training paradigm to non-identically distributed datasets, where each dataset is controlled by the same set of unknown inference parameters but covers a different region of the available feature space. Each dataset is processed through its own forward operator and discriminator, providing complementary constraints that collectively guide a shared generator toward global parameter consistency. We validate the approach using a controlled setup inspired by a multi-detector scattering experiment. We provide numerical evidence that our framework is robust to different data fidelities, which arise from unknown detector systematics in the Rutherford experiment, and we show the scaling behavior on multi-GPU leadership computing systems. The results show that our approach is well suited for real-world multi-dataset analyses in which experimental conditions vary across measurements.

Problem

• Multi-Dataset
• Inverse Problem
• Heterogeneous Datasets
• Generative AI
• Data-Parallel Training

Innovation

• Generative AI
• Inverse Problem Solving
• Heterogeneous Datasets
• Distributed Data-Parallel Training
• Global Parameter Consistency