Beyond Surface Cues: Disentangling Sociocultural Signals in Multilingual LLMs

2026-08-24

AI Summary

本文通过多代理审核方法，区分了多语言大模型输出中的社会偏见、身份差异表示及跨文化模式，解决了表面线索误导文化理解的问题。

Abstract

Multilingual LLM outputs can vary across sociocultural contexts. However, evidence of cultural grounding can be misleading: identity labels may be inferred from explicit or indirect textual cues, while names and wording can reveal the source language. Treating all these signals as evidence of cultural grounding may obscure potential biases. We present a human-validated, multi-agent audit that separates three questions: whether outputs reproduce social biases, whether identity groups are represented differently, and whether outputs reflect cross-cultural patterns. The study analyzes 89,253 outputs from 12 LLMs in English, French, and Chinese, spanning 18 occupations and three task conditions. We find that bias representation varies systematically across languages and tasks. Removing direct identity cues sharply reduces identity-label prediction in English and Chinese, but has a much smaller effect in French. Across all language-genre settings, the cultural context associated with the source language receives the highest average relevance score, with moderate agreement between automated and human ratings. However, the ability to identify the source language drops substantially after translation and again after masking names. Without these controls, multilingual audits may mistake surface cues for cultural understanding, leading to misleading conclusions about cross-cultural variation and bias. Our audit offers a practical framework for separating such shortcuts from more meaningful cross-cultural patterns.

Problem

• Multilingual LLMs
• Sociocultural Signals
• Cultural Grounding
• Social Biases
• Identity Labels

Innovation

• multilingual LLMs
• sociocultural signals
• bias representation
• identity cues
• cross-cultural patterns