NeuRoute: Logit-Guided Neural Routing for Billion-Scale Vector Search with Sub-Hour Index Construction
This study addresses the prohibitive indexing time associated with billion-scale vector search by proposing NeuRoute, a learned hashing index framework. The method employs logit-guided neural routing integrated with adaptive multi-bucket probing and centroid-gated early stopping mechanisms. Furthermore, it utilizes a lightweight encoder optimized via a selective similarity preservation objective to enhance retrieval efficiency. Experimental evaluations on the BigANN-1B dataset demonstrate that NeuRoute achieves a Recall@10 of 90.3% and a throughput of 2,414 QPS. Notably, the end-to-end index construction time is reduced to under one hour. These results indicate that NeuRoute significantly accelerates both index building and query performance for large-scale vector retrieval systems, offering a practical solution to the scalability bottlenecks inherent in current high-dimensional indexing approaches.