Are Language Models Models?

2026-01-15

AI Summary

This study critically examines whether large language models (LLMs) can serve as valid model systems in cognitive science. Drawing on Marr’s three-level framework—computational theory, algorithmic representation, and neural implementation—the work presents the first systematic evaluation of LLMs against foundational criteria for cognitive models at each level. The analysis reveals that LLMs demonstrably fail to meet these criteria at the implementation level and lack sufficient grounding at both the algorithmic and computational levels, thereby undermining their capacity to explain human cognitive mechanisms. The central contribution lies in clarifying that LLMs should be regarded as research tools rather than bona fide cognitive models, thereby delineating their appropriate role and inherent limitations within cognitive science.

Technology Category

• Cognitive Modeling & Cognitive Systems: Analogy
• Machine Learning: Large Multimodal Models (LMMs)
• Natural Language Processing: (Large) Language Models

Application Category

• Economics, Online Markets and Human Computation: Cost models of using LLMs in production systems
• User Modeling, Personalization and Recommendation: Large Language Models (LLM) for user modeling and recommendation
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions

Abstract

Futrell and Mahowald claim LMs"serve as model systems", but an assessment at each of Marr's three levels suggests the claim is clearly not true at the implementation level, poorly motivated at the algorithmic-representational level, and problematic at the computational theory level. LMs are good candidates as tools; calling them cognitive models overstates the case and unnecessarily feeds LLM hype.

Problem

• language models
• cognitive models
• Marr's levels
• model systems
• LLM hype

Innovation

• language models
• cognitive modeling
• Marr's levels
• model systems
• LLM hype