SHEAF: Self-profiled Hardness Estimation from Answer-set Flux for Predicting Query Hardness in Graph-based ANN Search

2026-07-13

AI Summary

This work addresses the challenge in graph-based approximate nearest neighbor (ANN) search where a fixed beam width struggles to balance efficiency and recall. The authors propose SHEAF, a query-adaptive hardness estimator grounded in answer-set flux, which dynamically predicts the minimal beam width required for each query through two shallow probes, thereby overcoming the limitations of conventional static geometric metrics such as Local Intrinsic Dimensionality (LID). Experimental evaluations on graph indices including CAGRA and HNSW demonstrate that SHEAF significantly outperforms five baseline methods in beam width prediction accuracy across four datasets, achieving up to a 1.55× improvement in correlation with actual query hardness.

Abstract

Graph-based approximate nearest neighbor (ANN) search is usually governed by a beam-width parameter that trades recall for throughput and is fixed for the whole workload. Yet, queries may not be equally hard: for example, on the widely used data set SIFT1M, the beam that a query needs to reach 95\% recall varies by more than $32\times$. Therefore, serving each query at its own width would help if the system could tell, cheaply and in advance, how hard it is. The prevailing proxy for this difficulty is called local intrinsic dimensionality (LID); however, LID is static and geometric, which makes it only weakly predict the minimum beam. This paper presents a new measure, namely Self-profiled Hardness Estimation from Answer-set Flux (SHEAF), which represents a query's hardness as how much its own top-$k$ answer set changes between two shallow probe widths. We design a self-profiling estimator that turns this flux into a deployable per-query beam predictor; furthermore, we develop a fixed-probe evaluation protocol that scores each measure over all queries with an observed minimum sufficient beam. On popular ANN indexes such as CAGRA and HNSW across four diverse data sets, SHEAF predicts the per-query beam better than five baseline measures on both GPU and CPU by up to $1.55\times$ in held-out correlation, using only two shallow probe searches and no query-time ground truth.

Problem

• query hardness prediction
• beam-width adaptation
• approximate nearest neighbor search
• graph-based ANN
• per-query resource allocation

Innovation

• SHEAF
• query hardness prediction
• answer-set flux
• adaptive beam-width
• graph-based ANN search