Semantic Fibers and Cross-Gram Interference: A Calculus of Safety Drift in Overcomplete Representations

📅 2026-09-13
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究解决了跨语言模型的安全性漂移问题,通过线性代数方法精确刻画,并提出了一种校准暴露度量来区分不同类型的漂移。
📝 Abstract
A deployed language model may refuse a harmful request in English yet comply with its faithful translation, revealing a cross-lingual safety failure that cannot be characterized reliably by output behavior alone. We formalize this phenomenon through an audited equivalence relation and show that, for a declared quotient, representation, metric, feature dictionary, scoring head, threshold, and contrast model, the resulting safety drift admits an exact linear-algebraic characterization. Specifically, the drift is a cross-Gram functional of the within-fiber contrast; its worst admissible value is a support function, while margin invariance is characterized by an annihilator condition. We introduce an intrinsic calibrated exposure measure, governed by the leverage duality $χ^2=1/\ell-1$, which separates observed drift into three diagnostically distinct regimes: a reader fault removable by recalibration, an exact correction that is too ill-conditioned to be reliable, and a representation-level collision that no readout-only intervention can remove. Thus, identical observed exposure can lead to fundamentally different remediation verdicts. The framework also extends to cone-valued safety heads. An untied order-swap identity provides a diagnostic for the linear control interface; its calibration-state residual predicts a distinct three-control composition error on unseen states and targets, achieving median Spearman correlation $0.964$, compared with $0.269$ for a static cross-Gram baseline. etc.....
Problem

Research questions and friction points this paper is trying to address.

Cross-lingual Safety
Language Model
Semantic Fibers
Safety Drift
Representation
Innovation

Methods, ideas, or system contributions that make the work stand out.

cross-lingual safety drift
linear-algebraic characterization
calibrated exposure measure
untied order-swap identity
🔎 Similar Papers
2024-09-24Workshop on Representation Learning for NLPCitations: 0
💼 Related Jobs
No related jobs found.
M
Mohammed Ahnouch
Université Paris 1
L
Lotfi Elaachack
Faculty of Science and Technology of Tangier, Abdelmalek Essaadi University