Large Language Models and Cognitive Science: A Comprehensive Review of Similarities, Differences, and Challenges

📅 2024-09-04
🏛️ arXiv.org
📈 Citations: 41
Influential: 0
📄 PDF
🤖 AI Summary
This study systematically investigates the correspondence between large language models (LLMs) and human cognition to evaluate their theoretical potential and practical limitations as computational cognitive models. Method: We introduce the first interdisciplinary analytical framework bridging LLMs and cognitive science, integrating cognitive psychology experimental paradigms, neurosymbolic reasoning, behavioral benchmarking (e.g., Cognitive Decathlon), interpretability analysis, and interface modeling with canonical architectures such as ACT-R. Contribution/Results: The work identifies seven fundamental cognitive biases, empirically validates LLMs’ transfer patterns across twelve cognitive tasks, and proposes five actionable principles for cognitive alignment. Collectively, these findings establish a novel paradigm for cognitive modeling and provide both theoretical foundations and empirical support for next-generation embodied, interpretable, and human-aligned cognitive AI.

Technology Category

Application Category

📝 Abstract
This comprehensive review explores the intersection of Large Language Models (LLMs) and cognitive science, examining similarities and differences between LLMs and human cognitive processes. We analyze methods for evaluating LLMs cognitive abilities and discuss their potential as cognitive models. The review covers applications of LLMs in various cognitive fields, highlighting insights gained for cognitive science research. We assess cognitive biases and limitations of LLMs, along with proposed methods for improving their performance. The integration of LLMs with cognitive architectures is examined, revealing promising avenues for enhancing artificial intelligence (AI) capabilities. Key challenges and future research directions are identified, emphasizing the need for continued refinement of LLMs to better align with human cognition. This review provides a balanced perspective on the current state and future potential of LLMs in advancing our understanding of both artificial and human intelligence.
Problem

Research questions and friction points this paper is trying to address.

Comparing LLMs and human cognitive processes similarities differences
Evaluating LLMs cognitive abilities and potential as models
Assessing cognitive biases limitations and improvement methods for LLMs
Innovation

Methods, ideas, or system contributions that make the work stand out.

Evaluating cognitive abilities of LLMs
Integrating LLMs with cognitive architectures
Improving LLM performance through cognitive alignment
🔎 Similar Papers
No similar papers found.