đ¤ AI Summary
This work addresses the longstanding issue in automatic summarizationâoveremphasis on content coverage at the expense of reader engagement. To this end, we propose the âSpotlightâ paradigm, which prioritizes extracting and generating the most salient, attention-grabbing information to enhance reader involvement with the source text. We formally define the âspotlightâ conceptâdistinct from conventional summarizationâand introduce the first dedicated dataset and evaluation benchmark explicitly designed for measuring reader engagement. Our method employs a two-stage training strategy: first, fine-tuning a large language model on our curated dataset; second, aligning outputs with user preferences via Direct Preference Optimization (DPO). Extensive experiments demonstrate that our approach significantly outperforms baseline summarization models across key dimensionsâincluding salient information identification, readability, and perceptual appealâestablishing a novel, engagement-centered standard for information distillation.
đ Abstract
In this paper, we introduce Spotlight, a novel paradigm for information extraction that produces concise, engaging narratives by highlighting the most compelling aspects of a document. Unlike traditional summaries, which prioritize comprehensive coverage, spotlights selectively emphasize intriguing content to foster deeper reader engagement with the source material. We formally differentiate spotlights from related constructs and support our analysis with a detailed benchmarking study using new datasets curated for this work. To generate high-quality spotlights, we propose a two-stage approach: fine-tuning a large language model on our benchmark data, followed by alignment via Direct Preference Optimization (DPO). Our comprehensive evaluation demonstrates that the resulting model not only identifies key elements with precision but also enhances readability and boosts the engagement value of the original document.