Problem
Research questions and friction points this paper is trying to address.
image quality assessment
faithful reasoning
credit assignment
MR-IQA-2: Faithful Image Quality Reflection via Fine-Grained Credit Assignment
π€ AI Summary
ζ¬ζζεΊMR-IQA-2ζ‘ζΆοΌιθΏη»η²εΊ¦ηδΏ‘η¨ει
εε―ιͺθ―ηηη£ζ₯ζΉθΏεΎε质ιθ―δΌ°δΈηζ¨ηδΈθ―εηδΈθ΄ζ§εε―ι ζ§γ
π Abstract
Multimodal large language models (MLLMs) have shown strong potential for image quality assessment (IQA) by improving consistency between quality ratings and their underlying reasoning. However, most approaches supervise reasoning through human-provided ratings and rarely examine whether it faithfully reflects image quality. Rating accuracy alone does not ensure faithful reasoning; a shared reward also obscures supervision sources and may reinforce unfaithful reasoning when a correct rating occurs by chance. To improve the faithfulness and reliability of blind IQA, we aim to (1) decouple credit assignment for reasoning and rating and (2) provide verifiable supervision for faithful reasoning. We introduce MR-IQA-2, an actor-editor-judge framework that operationalizes reasoning-editing-reflection. The actor generates quality reasoning for an input image, and the editor revises the image according to the identified quality factors. A frozen judge compares the original and edited images and provides reflective supervision for the actor's reasoning. MR-IQA-2 further uses fine-grained credit assignment to decouple reasoning and rating supervision. Judge feedback supervises reasoning, whereas human ratings supervise the predicted rating. Masked token-specific updates distinguish these signals while preserving the causal relation from reasoning to rating. Across IQA benchmarks, MR-IQA-2 achieves competitive rating alignment with humans. Visual reflection also enables richer and more faithful visual understanding beyond rating, which may inform image-quality optimization and related downstream tasks. Code is available at https://github.com/RobinY99/MR-IQA-2.
Innovation
Methods, ideas, or system contributions that make the work stand out.
Fine-grained Credit Assignment
Actor-Editor-Judge Framework
Reasoning-Editing-Reflection
Blind IQA
Faithful Reasoning
π Similar Papers
No similar papers found.
