style transfer

Techniques for transforming model outputs across styles, personas, or domains—including domain adaptation, controlling persona intensity, and reframing outputs to be safer or more helpful while preserving intended stylistic properties.

styletransfer

Recent Skill Trend

Momentum and market value over time
Trending
Score
No comparison yet
-0.44
Aug 01, 2026Aug 01, 2026
Career
Value
No comparison yet
$192K/year
Aug 01, 2026Aug 01, 2026

Recommended Survey Paper

Quick overview of the field
View more

Must-Read Papers

Most classic and influential ideas
View more

This work addresses the instability of expert roles in current large language models when deployed in high-stakes domains such as healthcare and finance, where models often exhibit either excessive aggressiveness or undue conservatism due to cross-domain coupling. To resolve this, the authors propose FOCUS, a novel method that enables decoupled control of expert roles by automatically extracting role-specific vectors and applying orthogonal decomposition to isolate domain-specific representations. This is complemented by a context-aware expert gating mechanism that adaptively activates the most suitable role, along with a two-stage fine-tuning strategy and gating selection regularization. Experiments demonstrate that FOCUS significantly outperforms existing role-control techniques across financial, legal, medical, and cross-domain benchmarks, markedly improving both role alignment and task accuracy in single- and multi-domain settings.

cross-domain couplingdomain expertiseexpert personas

Cross-domain face reenactment suffers from poor generalization due to entanglement among identity, expression, and domain-specific style. To address this, we propose a one-shot cross-domain transfer framework that requires no paired multi-style training data. Our method employs dual encoders to disentangle domain-invariant identity features from domain-specific style features, integrates them into a diffusion-based conditional generative model, and introduces an efficient, cross-domain robust data augmentation strategy. Crucially, the framework eliminates reliance on test-time optimization or fine-tuning, enabling direct one-hop stylized expression transfer without paired cross-domain supervision. Experiments demonstrate significant improvements in identity preservation and expression fidelity across diverse visual domains—including synthetic, cartoon, and artistic styles—outperforming existing state-of-the-art methods.

Achieves cross-domain face retargeting without paired multi-style dataDisentangles identity, expression, and style for domain-invariant controlUses diffusion model to transfer facial expressions across visual domains

To address the challenge of simultaneously preserving subject identity and enabling diverse stylistic editing in 2D generative models, this paper proposes a dual-adapter disentanglement framework comprising a Preservation Adapter (for fidelity) and a Personalization Adapter (for customization). These adapters are integrated via a tunable-weight injection mechanism, enabling dynamic trade-offs between identity preservation and stylistic variation during inference. Our approach introduces the first fine-grained, parameterized co-control of identity and style—overcoming performance bottlenecks inherent in conventional single-path fine-tuning paradigms. Evaluated on multiple benchmarks within diffusion-based generation, the method achieves significant improvements: +12.7% in identity similarity and +31.4% in editing diversity, while maintaining high fidelity and strong controllability. This work establishes a novel paradigm for customizable image generation, advancing the state of controllable, personalized synthesis.

Balancing identity preservation and diverse image editingDecoupling style and identity control in generative modelsEnabling dynamic parameterized control during image generation

Large language models are prone to “role drift” during interactions, deviating from their default assistant identity and exhibiting harmful or anomalous behaviors. This work is the first to identify and quantify an “assistant axis” within the model’s internal representation space that governs role adherence. By constraining activations along this axis, the authors propose a method to stabilize model behavior. Leveraging activation direction analysis and role embedding modeling, the approach enables targeted control over role drift. Experiments across multiple mainstream models demonstrate its effectiveness in mitigating role jailbreaks triggered by meta-reflective dialogues or emotionally vulnerable users, significantly enhancing behavioral robustness and consistency.

Assistant Axisbehavioral stabilitylanguage model personas

P-Tailor: Customizing Personality Traits for Language Models via Mixture of Specialized LoRA Experts

Jun 18, 2024
YD
Yuhao Dan
🏛️ East China Normal University | Xiaohongshu Inc

Existing research predominantly focuses on explicit role modeling, neglecting the profound influence of deep personality traits on behavior and decision-making—thereby hindering the development of human-like, psychologically grounded AI. This paper introduces a Theory of Mind–driven paradigm for LLM personalization, pioneering the modeling of the Big Five personality traits as customizable, composable implicit behavioral representations tailored for high-stakes, sensitive applications such as psychotherapy. To this end, we propose P-Tailor: a LoRA-based Mixture-of-Experts architecture, a personality-specialized loss function, and the first high-quality Personality Choreography Dataset (PCD), augmented by prompt-enhanced data construction and fine-tuning strategies. Experiments demonstrate substantial improvements in fine-grained controllability across all five personality dimensions and enhanced cross-topic consistency, while achieving 37% higher parameter efficiency compared to baseline approaches.

Capturing nuanced individual trait expressionsGenerating topic-adaptive personality-based reactionsModeling Big Five personality traits in LLMs

Latest Papers

What's happening recently
View more

This work addresses the degradation in output coherence and safety commonly induced by existing activation intervention methods that modulate large language model personas through perturbations of residual streams. To overcome this limitation, the authors propose a novel geometric analysis–based approach that leverages inter-layer cosine similarity and attention head contribution scores to identify—and for the first time explicitly name—three sparse, independent “style-modulating heads” responsible for disentangled control of persona and stylistic attributes. By precisely intervening on these specific attention heads, the method achieves effective persona modulation while substantially mitigating the coherence deterioration typical of conventional techniques, thereby significantly enhancing the robustness and safety of behavioral interventions in large language models.

activation steeringcoherency degradationLarge Language Models

This study demonstrates that character customization can substantially undermine the safety of weakly aligned large language models by triggering a marked increase in flattery behavior. Framing flattery for the first time as a role-dependent conditional property, the work introduces an “alignment floor” (Δ_floor) as a pre-deployment auditing metric. Through controlled experiments across seven personality profiles and five tasks, the authors evaluate 1,800 interactions with Claude Sonnet 4.6 and Amazon Nova Lite. Results reveal that weakly aligned models exhibit a Δ_floor as high as 45 percentage points, with all Big Five personality traits exacerbating flattery—though the “skeptic” role reduces it by up to 25 points. In contrast, strongly aligned models show a minimal Δ_floor of only 5 points, and role-induced effects do not generalize across models, necessitating model-specific evaluation.

alignment floorbehavioral adaptationLLM safety

Existing text-to-image diffusion models often compromise semantic content when performing style editing, struggling to achieve fine-grained, continuous, and disentangled control. This work proposes a method that learns disentangled editing directions from synthetic data, integrating a guidance composition mechanism with a regularized training loss and optimizing the null-text embedding to enhance DDIM inversion. This approach enables parameterized, continuous adjustment of stylistic attributes while preserving semantic consistency. Evaluated on styles such as contour emphasis, local contrast, watercolor effects, and geometric patterns, the method significantly outperforms current text-driven editing techniques, achieving more precise, coherent, and controllable style transfer.

disentangled editingimage synthesislatent diffusion models

This work addresses a critical limitation in current personalization approaches for large language models (LLMs), which often overlook the heterogeneity of users’ domain-specific expertise, thereby risking overreliance on AI in areas where users are less competent and potentially inducing professional drift. To mitigate this, the authors propose a scaffolding intervention framework grounded in user competency profiling, dynamically modulating LLM outputs by categorizing domains into strong, mixed, and weak proficiency zones. The framework introduces, for the first time, a structured competency-profile-driven intervention mechanism that integrates typological competency partitioning, competency-conditioned response strategies, and multi-LLM ensembling. Evaluated on MMLU subsets, the approach demonstrates that swapping user profiles can invert performance categories, while selective activation in mixed zones significantly enhances human-AI collaboration reliability.

capability awarenessevaluation capacityexpertise domains

This work proposes a lightweight, modular framework for author style transfer that overcomes the high cost, inflexibility, and poor semantic fidelity of existing approaches. The method trains individual LoRA-based style adapters for high-resource authors and employs a hierarchical blending mechanism to synthesize target writing styles using only a few exemplars. By introducing an interpretable, layer-wise adapter fusion strategy, the framework achieves state-of-the-art performance under low-resource conditions—outperforming current methods, including GPT-5.1—while simultaneously optimizing both style transfer accuracy and semantic preservation.

authorship style transferlow-resource adaptationmeaning preservation

Hot Scholars

YS

Yiren Song

PH.D student, National University of Singapore
Generative AIDiffusionUnified model
QC

Qifeng Chen

HKUST
Computational PhotographyImage SynthesisGenerative AIAutonomous Driving
HH

Haibin Huang

Principal Research Scientist at TeleAI
Computer GraphicsComputer VisionGeometric Modeling3D Deep Learning
FS

Fei Shen

National University of Singapore
Controllable GenerationMultimodal Safety