Institution profile

School of Data Science

Academic institution
Research library2linked papers
Opportunities0open roles
Selected work

Representative Papers

Distributed Stochastic Momentum Tracking with Local Updates: Achieving Optimal Communication and Iteration Complexities

Oct 28, 2025

To address the fundamental trade-off between high communication overhead and low convergence efficiency in distributed stochastic optimization, this paper proposes Local Momentum Tracking (LMT). LMT integrates multi-step local updates, momentum tracking, and loopless Chebyshev acceleration (LCA), enabling multiple local computations per communication round while preserving global coordination and computational efficiency. Theoretically, when the number of local updates is appropriately chosen, LMT simultaneously achieves optimal communication complexity O(1/ε) and iteration complexity O(1/ε), marking the first linear speedup under multi-step local update settings without requiring strong convexity or second-order smoothness assumptions. Empirical evaluations demonstrate that LMT significantly outperforms state-of-the-art methods in bandwidth-constrained networks, effectively breaking the communication–computation trade-off bottleneck.

0 citationsRead paper
Recent publications

Latest Papers

Distributed Stochastic Momentum Tracking with Local Updates: Achieving Optimal Communication and Iteration Complexities

Oct 28, 2025

To address the fundamental trade-off between high communication overhead and low convergence efficiency in distributed stochastic optimization, this paper proposes Local Momentum Tracking (LMT). LMT integrates multi-step local updates, momentum tracking, and loopless Chebyshev acceleration (LCA), enabling multiple local computations per communication round while preserving global coordination and computational efficiency. Theoretically, when the number of local updates is appropriately chosen, LMT simultaneously achieves optimal communication complexity O(1/ε) and iteration complexity O(1/ε), marking the first linear speedup under multi-step local update settings without requiring strong convexity or second-order smoothness assumptions. Empirical evaluations demonstrate that LMT significantly outperforms state-of-the-art methods in bandwidth-constrained networks, effectively breaking the communication–computation trade-off bottleneck.

0 citationsRead paper