Projecting Out the Malice: A Global Subspace Approach to LLM Detoxification

2026-01-09

arXiv.org

AI Summary

Large language models are prone to generating toxic content, and existing alignment methods struggle to fully eliminate toxicity embedded in model parameters while remaining vulnerable to adversarial attacks. This work proposes GLOSS, a novel approach that introduces the concept of a “global toxicity subspace” for the first time. Leveraging mechanistic interpretability, GLOSS precisely identifies and removes this subspace within feedforward network (FFN) layers, overcoming limitations of local methods that are susceptible to reconstruction or noise interference. Requiring no extensive retraining and incurring minimal computational overhead, GLOSS achieves state-of-the-art detoxification performance on large models such as Qwen3 while effectively preserving their general capabilities.

Technology Category

• Machine Learning: Large Multimodal Models (LMMs)
• Natural Language Processing: (Large) Language Models
• Computer Vision: Large Vision Models

Application Category

• Graph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphs
• Web Mining and Content Analysis: Large pretrained models with web data
• Search and Retrieval-Augmented AI: Large language models for search

Abstract

Large language models (LLMs) exhibit exceptional performance but pose inherent risks of generating toxic content, restricting their safe deployment. While traditional methods (e.g., alignment) adjust output preferences, they fail to eliminate underlying toxic regions in parameters, leaving models vulnerable to adversarial attacks. Prior mechanistic studies characterize toxic regions as"toxic vectors"or"layer-wise subspaces", yet our analysis identifies critical limitations: i) Removed toxic vectors can be reconstructed via linear combinations of non-toxic vectors, demanding targeting of entire toxic subspace; ii) Contrastive objective over limited samples inject noise into layer-wise subspaces, hindering stable extraction. These highlight the challenge of identifying robust toxic subspace and removing them. Therefore, we propose GLOSS (GLobal tOxic Subspace Suppression), a lightweight method that mitigates toxicity by identifying and eliminating this global subspace from FFN parameters. Experiments on LLMs (e.g., Qwen3) show GLOSS achieves SOTA detoxification while preserving general capabilities without requiring large-scale retraining. WARNING: This paper contains context which is toxic in nature.

Problem

• toxicity
• large language models
• subspace
• detoxification
• adversarial robustness

Innovation

• toxic subspace
• global subspace suppression
• LLM detoxification
• mechanistic interpretability
• parameter space intervention