What Does AI Do for Cultural Interpretation? A Randomized Experiment on Close Reading Poems with Exposure to AI Interpretation

2026-03-06

AI Summary

This study investigates the impact of AI assistance on human performance in close reading of poetry and associated reading enjoyment. Through a preregistered randomized controlled experiment (N = 400), it compares three conditions: no AI support, a single AI interpretation, and multiple AI interpretations. The research provides the first empirical evidence of a “less-is-more” effect in AI-assisted cultural interpretation: a single AI interpretation significantly enhances both close reading performance and reading enjoyment, whereas multiple interpretations, while further improving performance, diminish enjoyment due to increased overreliance on AI. These findings offer critical empirical insights into the boundaries and optimization pathways of human–AI collaboration in hermeneutic tasks within the humanities.

Technology Category

• Humans and AI: Learning Human Values and Preferences
• Natural Language Processing: Interpretability, Analysis, and Evaluation of NLP Models
• Application Domains: Humanities & Computational Social Science

Application Category

• Economics, Online Markets and Human Computation: Research challenges in human and human-AI computation
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions

Abstract

AI demonstrates unprecedented reasoning capabilities, but its increasing integration into human reasoning via automated reading and summarization has provoked debate about its use for cultural interpretation. Close reading -- the practice of understanding, analyzing, and critiquing cultural texts for pleasure -- is a skill at the core of such interpretation, traditionally being seen as exclusive to humans. To test AI's impact on close reading, both in terms of interpretative performance and pleasure, we conducted a preregistered randomized experiment (n=400) investigating the impact of AI assistance by presenting single or multiple AI interpretations, on close reading poems, compared to no AI assistance. We found that single AI interpretation boosted both performance and pleasure, while multiple AI interpretations only improved performance. Further exploration revealed a trade-off: participants who heavily relied on AI showed better performance on the task but lower pleasure. Our results contribute to discussion on whether and how to calibrate AI assistance for cultural interpretation:"less is more."

Problem

• AI
• cultural interpretation
• close reading
• human-AI collaboration
• pleasure

Innovation

• close reading
• AI assistance
• cultural interpretation
• randomized experiment
• human-AI collaboration