Data Safety: Synthetic Data Quality Analysis Using CIFAKE Dataset
This work addresses the critical gap in understanding whether synthetic images are truly interchangeable with real ones in model training and the absence of systematic evaluation frameworks to ensure their safe and effective use. The study systematically quantifies discrepancies between synthetic and real images across three dimensions: high-dimensional feature distributions, low-level statistical properties in color space, and model training dynamics. Building on these insights, the authors propose a pre-evaluation metric for synthetic data of unknown quality and a safety-aware data fusion strategy for training. Experiments demonstrate that carefully calibrated mixing ratios and integration methods of synthetic and real data can substantially enhance model performance and robustness, thereby offering both theoretical grounding and practical guidance for the reliable deployment of synthetic data in machine learning pipelines.