PGVMS: A Prompt-Guided Unified Framework for Virtual Multiplex IHC Staining with Pathological Semantic Learning.

2026-02-11

IEEE Transactions on Medical Imaging

AI Summary

This study addresses the challenge of limited tissue availability in small biopsy samples, which restricts multiplex immunohistochemistry (IHC) staining. To overcome this, the authors propose a prompt-guided unified virtual staining framework that requires only single-plex IHC training data. The method tackles three key challenges—insufficient semantic guidance for multiplex staining, inconsistent protein expression distributions, and cross-modal spatial misalignment—through an adaptive prompt-guided mechanism, a Protein-Aware Learning Strategy (PALS), and a Prototype Consistency Learning Strategy (PCLS). By integrating a pathology vision-language model, protein distribution quantification constraints, and cross-image semantic interactions, the framework enables end-to-end, high-fidelity, semantically consistent, and spatially aligned virtual conversion from H&E to multiple IHC stains, significantly enhancing molecular phenotyping capabilities under sample-limited conditions.

Technology Category

• Computer Vision: Multi-modal Vision
• Machine Learning: Multi-instance/Multi-view Learning
• Intelligent Robots: Multimodal Perception & Sensor Fusion

Application Category

• Search and Retrieval-Augmented AI: Multilingual and cross-lingual Web search
• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
• Economics, Online Markets and Human Computation: Humans versus LLMs for data annotation and labeling

Abstract

Immunohistochemical (IHC) staining enables precise molecular profiling of protein expression, with over 200 clinically available antibody-based tests in modern pathology. However, comprehensive IHC analysis is frequently limited by insufficient tissue quantities in small biopsies. Therefore, virtual multiplex staining emerges as an innovative solution to digitally transform H&E images into multiple IHC representations, yet current methods still face three critical challenges: (1) inadequate semantic guidance for multi-staining, (2) inconsistent distribution of immunochemistry staining, and (3) spatial misalignment across different stain modalities. To overcome these limitations, we present a prompt-guided framework for virtual multiplex IHC staining using only uniplex training data (PGVMS). Our framework introduces three key innovations corresponding to each challenge: First, an adaptive prompt guidance mechanism employing a pathological visual language model dynamically adjusts staining prompts to resolve semantic guidance limitations (Challenge 1). Second, our protein-aware learning strategy (PALS) maintains precise protein expression patterns by direct quantification and constraint of protein distributions (Challenge 2). Third, the prototype-consistent learning strategy (PCLS) establishes cross-image semantic interaction to correct spatial misalignments (Challenge 3). Evaluated on two benchmark datasets, PGVMS demonstrates superior performance in pathological consistency. In general, PGVMS represents a paradigm shift from dedicated single-task models toward unified virtual staining systems.

Problem

• virtual multiplex staining
• immunohistochemical staining
• semantic guidance
• spatial misalignment
• protein expression

Innovation

• prompt-guided learning
• virtual multiplex IHC staining
• pathological visual language model
• protein-aware learning
• prototype-consistent learning