Problem
Research questions and friction points this paper is trying to address.
data pruning
high-dimensional feature embeddings
semantic interactions
rare semantic concepts
Mapping the Concept Landscape: Structural Perception of Global Distributions for Transparent Data Pruning
๐ค AI Summary
ๆฌๆๆๅบไธ็งๅบไบ็ปๆๆ็ฅ็ๆฐๆฎๅชๆๆนๆณ๏ผ้่ฟๆๅปบๅพๅ-ๆๆฌๅฏน็ๅพ่กจ็คบๆฅไผๅ็จๆ่ฏญไนๆฆๅฟต็่ฆ็๏ผๆ้ซๆฐๆฎๅชๆๆ็ๅ้ๆๅบฆใ
๐ Abstract
Existing data pruning methods predominantly rely on high-dimensional feature embeddings to measure sample importance. However, these compressed vectors often obscure fine-grained semantic interactions, leading to suboptimal coverage of rare semantic concepts in the pruned subsets. In this paper, we propose Mapping the Concept Landscape (MCL), a novel structural perception framework for transparent data pruning. Instead of abstract embeddings, we represent each image-caption pair as an explicit sample-level graph comprising entities, events, and attributes. By integrating these individual graphs into a comprehensive dataset-level graph, we characterize the global distribution of semantic concepts and quantify their rarity across the entire corpus. Based on this structured perception, we develop a greedy concept-coverage maximization algorithm that iteratively selects samples to maximize the marginal gain of high-value, under-represented concepts. Experimental results on various benchmarks demonstrate that our method not only achieves superior pruning efficiency compared to state-of-the-art methods but also provides a transparent and interpretable audit trail for the selection process.
Innovation
Methods, ideas, or system contributions that make the work stand out.
structural perception
transparent data pruning
concept coverage maximization
sample-level graph
๐ Similar Papers
No similar papers found.
๐ผ Related Jobs
No related jobs found.
