SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing

2026-04-21

AI Summary

This work addresses the challenge that non-expert users often struggle to articulate precise aesthetic intentions in traditional photo editing, which typically relies on explicit user instructions. To overcome this limitation, we propose SmartPhotoCrafter—the first unified framework integrating reasoning and generation for automatic photographic image enhancement. Our approach employs an Image Critic module to automatically detect visual flaws and a Photographic Artist module to perform targeted refinements, eliminating the need for manual guidance. Trained via a multi-stage strategy—including base pretraining, reasoning-guided supervised fine-tuning, and joint reinforcement learning—our model achieves controllable generation and semantic consistency on a newly curated staged dataset. Experiments demonstrate that SmartPhotoCrafter outperforms existing generative models in automatic photo enhancement, producing results with superior photorealism and heightened sensitivity to tonal adjustments.

Technology Category

• Computer Vision: Diffusion Models for Vision
• Natural Language Processing: Generation
• Cognitive Modeling & Cognitive Systems: Computational Creativity

Application Category

• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
• Economics, Online Markets and Human Computation: Economic ramifications for generative AI infrastructure and applications

Abstract

Traditional photographic image editing typically requires users to possess sufficient aesthetic understanding to provide appropriate instructions for adjusting image quality and camera parameters. However, this paradigm relies on explicit human instruction of aesthetic intent, which is often ambiguous, incomplete, or inaccessible to non-expert users. In this work, we propose SmartPhotoCrafter, an automatic photographic image editing method which formulates image editing as a tightly coupled reasoning-to-generation process. The proposed model first performs image quality comprehension and identifies deficiencies by the Image Critic module, and then the Photographic Artist module realizes targeted edits to enhance image appeal, eliminating the need for explicit human instructions. A multi-stage training pipeline is adopted: (i) Foundation pretraining to establish basic aesthetic understanding and editing capabilities, (ii) Adaptation with reasoning-guided multi-edit supervision to incorporate rich semantic guidance, and (iii) Coordinated reasoning-to generation reinforcement learning to jointly optimize reasoning and generation. During training, SmartPhotoCrafter emphasizes photo-realistic image generation, while supporting both image restoration and retouching tasks with consistent adherence to color- and tone-related semantics. We also construct a stage-specific dataset, which progressively builds reasoning and controllable generation, effective cross-module collaboration, and ultimately high-quality photographic enhancement. Experiments demonstrate that SmartPhotoCrafter outperforms existing generative models on the task of automatic photographic enhancement, achieving photo-realistic results while exhibiting higher tonal sensitivity to retouching instructions. Project page: https://github.com/vivoCameraResearch/SmartPhotoCrafter.

Problem

• photographic image editing
• aesthetic understanding
• automatic enhancement
• image quality
• non-expert users

Innovation

• unified reasoning-to-generation
• automatic photographic editing
• image critic
• photographic artist
• reinforcement learning