Robustifying Sparse Matrix Multiplication

2026-07-01

AI Summary

This work addresses the problem of efficiently and robustly approximating the top-$k$ largest entries in the product of two sparse matrices, where the error is only affected by small, non-target entries. We present the first general black-box reduction framework that transforms any sparse matrix multiplication algorithm into a robust variant with only a polylogarithmic overhead in running time. Our approach integrates techniques from sparse recovery with knapsack-style combinatorial optimization, achieving high accuracy while significantly improving efficiency. When combined with state-of-the-art algorithms, our method attains a runtime of $O((m_{\text{in}} + k)^{1.346})$, and for $k \geq m_{\text{in}}^{1.762}$, it reaches a nearly optimal complexity of $k^{1+o(1)}$.

Abstract

In the seminal sparse matrix multiplication problem the goal is to compute the product of two $n \times n$ matrices when the matrices are sparse, i.e., when the number of nonzeros in the input matrices $m_{in}$ and/or the number of nonzeros in the output matrix $m_{out}$ are much smaller than $n^2$. In this paper, we explore the generalized problem of (approximately) computing the $k$ largest output entries, with an approximation error dependent solely on the smaller entries -- from the viewpoint of sparse recovery, this can be seen as a robust variant of sparse matrix multiplication. Despite the substantial research dedicated to sparse matrix multiplication, almost no existing algorithms are robust in this sense. The one exception is Pagh's algorithm in time $\widetilde O(m_{in} + nk)$ [ITCS'12], and it remained open whether other algorithms can be similarly made robust. Our principal contribution is a black-box reduction from robust sparse matrix multiplication to conventional sparse matrix multiplication with only polylogarithmic overhead. Specifically, we show that any sparse matrix multiplication algorithm with running time $T(n, m_{in}, m_{out})$ can be transformed into a robust algorithm running in time $\widetilde O(T(n, m_{in}, k))$. This reduction leverages an extensive toolkit from sparse recovery, and intriguingly, also involves solving a knapsack-type problem. By plugging in the state-of-the-art algorithm for sparse matrix multiplication by Abboud, Bringmann, Fischer, and Künnemann [SODA'24], we achieve significantly improved bounds such as $O((m_{in} + k)^{1.346})$. Notably, in the regime where $k \geq m_{in}^{1.762}$, our reduction culminates in an almost-optimal $k^{1+o(1)}$-time algorithm.

Problem

• sparse matrix multiplication
• robustness
• sparse recovery
• approximate computation
• top-k entries

Innovation

• robust sparse matrix multiplication
• black-box reduction
• sparse recovery
• approximate top-k
• knapsack-type problem