Free-form Association Tasks Reveal Stereotype Hallucination in Large Language Models

2026-06-29

AI Summary

This study investigates whether large language models genuinely simulate the cognitive mechanisms underlying human stereotyping or merely rely on statistical associations in their predictions. By employing free-association tasks—such as responses to abstract art and Rorschach inkblots—that present stimuli devoid of predefined cultural meanings, the authors compare first- and second-order responses between humans and multimodal large models (GPT-4o mini and Llama-3.2-11B-Vision-Instruct). The research reveals, for the first time, that while models exhibit highly homogeneous first-order responses, their second-order outputs generate “stereotype hallucinations” that diverge from actual intergroup differences observed in human populations. Critically, this phenomenon persists even after fine-tuning on human response data, suggesting that current models lack the foundational cognitive structures that underpin authentic human stereotyping processes.

Abstract

Recent studies argue that LLMs can predict human stereotypical judgments. Yet whether LLMs emulate the cognitive processes underlying human stereotypes, or merely retrieve learned associations to solve prediction tasks, remains unclear. Prior work examines LLMs' stereotypes in either (i) controlled judgment tasks like multiple choice surveys, or (ii) contexts constrained by conventionalized and predictable group biases. Here, we compare the structure of the stereotypes that humans and LLMs exhibit in the interpretation of free-form stimuli, namely abstract art and Rorschach blots, which lack pre-established cultural meanings. We recruit participants across five social domains (gender, partisanship, personality, urbanicity, and lifestyle) and elicit both first-order (direct personal interpretations) and second-order responses (predictions about how members of social groups will interpret the stimuli); we replicate this design with two multimodal models (GPT-4o mini and Llama-3.2-11B-Vision-Instruct). Humans and LLMs differ not only in magnitude but in the qualitative nature of their stereotypes. Human first-order responses display heterogeneity with minimal group structure. When predicting group responses, humans engage in "stereotype exaggeration" by moderately amplifying first-order tendencies while preserving diversity. By contrast, LLMs exhibit homogeneous first-order responses, and yet generate stark second-order stereotypes that neither amplify existing first-order tendencies nor reflect actual human group differences, a process we term "stereotype hallucination." LLMs continued to hallucinate stereotypes even when fine-tuned on the response data of actual participants. These findings suggest significant limitations in the use of LLMs to model and predict human behavior in novel contexts involving diverse interpretations.

Problem

• stereotype hallucination
• large language models
• free-form association
• human stereotypes
• cognitive modeling

Innovation

• free-form association
• stereotype hallucination
• large language models
• Rorschach blots
• second-order stereotypes