Neural Restoration of Greening Defects in Historical Autochrome Photographs Based on Purely Synthetic Data

2025-05-28

AI Summary

Historical Autochrome color plates suffer from a distinctive “greenish fading” degradation due to aging, for which no fully automated restoration method exists. Method: To address the severe scarcity of real annotated data, we propose the first end-to-end, unsupervised GAN-based framework featuring a physics-inspired high-fidelity synthetic data generation pipeline; a color-space-aware degradation simulation mechanism; and a novel weighted ChaIR loss function designed to improve reconstruction accuracy in chromatically imbalanced regions. Contribution/Results: The method enables fully automatic, batch-wise restoration without human intervention. Quantitative evaluation shows a 37% reduction in color error and a fivefold increase in processing speed compared to conventional approaches, achieving unprecedented high-fidelity, unsupervised restoration of Autochrome plates.

Technology Category

• Computer Vision: Generative Adversarial Networks (GANs) for Vision
• Machine Learning: Deep Generative Models & Autoencoders
• Natural Language Processing: Generation

Application Category

• Economics, Online Markets and Human Computation: Economic ramifications for generative AI infrastructure and applications
• Web Mining and Content Analysis: Web data generation and simulation
• Search and Retrieval-Augmented AI: Retrieval-Augmented Generation (RAG) and multi-modal RAG

Abstract

The preservation of early visual arts, particularly color photographs, is challenged by deterioration caused by aging and improper storage, leading to issues like blurring, scratches, color bleeding, and fading defects. In this paper, we present the first approach for the automatic removal of greening color defects in digitized autochrome photographs. Our main contributions include a method based on synthetic dataset generation and the use of generative AI with a carefully designed loss function for the restoration of visual arts. To address the lack of suitable training datasets for analyzing greening defects in damaged autochromes, we introduce a novel approach for accurately simulating such defects in synthetic data. We also propose a modified weighted loss function for the ChaIR method to account for color imbalances between defected and non-defected areas. While existing methods struggle with accurately reproducing original colors and may require significant manual effort, our method allows for efficient restoration with reduced time requirements.

Problem

• Automatic removal of greening defects in autochrome photographs
• Synthetic data generation for greening defect simulation
• Improved color restoration using modified weighted loss function

Innovation

• Synthetic dataset generation for greening defects
• Generative AI with designed loss function
• Modified weighted loss for color balance