Can Good Writing Be Generative? Expert-Level AI Writing Emerges through Fine-Tuning on High-Quality Books

2026-01-26

AI Summary

This study challenges the long-held assumption that human authors are irreplaceable in literary creation by investigating whether generative AI can achieve expert-level creative writing. The authors fine-tuned large language models (LLMs) on complete literary works and combined them with contextual prompting to generate texts mimicking the styles of renowned authors, pitting AI outputs against those of professional writers in a double-blind experiment. For the first time, both expert and non-expert reviewers participated at scale: fine-tuned AI received a 62% preference rate from experts—substantially above the 17.3% baseline—and consistently outperformed human writers among non-experts. Follow-up interviews revealed that expert reviewers experienced shaken aesthetic confidence and even identity crises. Beyond demonstrating AI’s breakthrough capabilities in stylistic imitation, the study provokes deeper reflection on the nature of creativity and the future of creative labor.

Technology Category

• Humans and AI: Learning Human Values and Preferences
• Cognitive Modeling & Cognitive Systems: Computational Creativity
• Natural Language Processing: Code Generation / Program Synthesis from Natural Language

Application Category

• Economics, Online Markets and Human Computation: Trust and reliance of crowd workers and data experts on GenAI
• Social Networks and Social Media: Generative AI / large language models and their impact on social systems
• Web Mining and Content Analysis: Web data quality in the era of algorithmically-generated content

Abstract

Creative writing has long been considered a uniquely human endeavor, requiring voice and style that machines could not replicate. This assumption is challenged by Generative AI that can emulate thousands of author styles in seconds with negligible marginal labor. To understand this better, we conducted a behavioral experiment where 28 MFA writers (experts) competed against three LLMs in emulating 50 critically acclaimed authors. Based on blind pairwise comparisons by 28 expert judges and 131 lay judges, we find that experts preferred human writing in 82.7% of cases under the in-context prompting condition but this reversed to 62% preference for AI after fine-tuning on authors'complete works. Lay judges, however, consistently preferred AI writing. Debrief interviews with expert writers revealed that their preference for AI writing triggered an identity crisis, eroding aesthetic confidence and questioning what constitutes"good writing."These findings challenge discourse about AI's creative limitations and raise fundamental questions about the future of creative labor.

Problem

• generative AI
• creative writing
• fine-tuning
• author style
• creative labor

Innovation

• fine-tuning
• creative writing
• large language models
• author style emulation
• human-AI comparison