A Momentum-Based Variance-Reduced Algorithm for Federated Multiobjective Optimization

📅 2026-08-24
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文针对联邦多目标优化问题,提出了一种基于动量的方差减少算法,通过改进梯度估计器减少了随机更新的方差,提高了收敛速度。
📝 Abstract
Federated learning has traditionally been formulated as a single-objective optimization problem, primarily focused on maximizing model utility. In real-world applications, however, machine learning models often need to optimize multiple and potentially conflicting objectives simultaneously. This motivates federated multiobjective optimization (FMOO), which provides a natural framework for jointly handling multiple task-specific objectives in federated learning. In this paper, we propose a momentum-based variance-reduced algorithm for federated multiobjective optimization. The method incorporates a momentum-driven gradient estimator into the local updates to reduce the variance of stochastic updates, leading to an improved convergence rate. We establish theoretical guarantees showing that the expected Pareto stationarity measure of a randomly selected output iterate decays at a rate of $\mathcal{O}(T^{-2/3})$, improving upon the $\mathcal{O}(T^{-1/2})$ rates established for existing methods such as FSMGDA and FedCMOO. Numerical experiments on federated multiobjective optimization benchmarks demonstrate the effectiveness and competitive performance of the proposed algorithm.
Problem

Research questions and friction points this paper is trying to address.

Federated Learning
Multiobjective Optimization
Variance Reduction
Innovation

Methods, ideas, or system contributions that make the work stand out.

momentum-based variance-reduced algorithm
federated multiobjective optimization
convergence rate improvement
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
Y
Yong Zhao
College of Mathematics and Statistics, Chongqing Jiaotong University, Chongqing 400074, China.
C
Chunlin You
College of Mathematics and Statistics, Chongqing Jiaotong University, Chongqing 400074, China.
M
Minh N. Dao
School of Science, RMIT University, Melbourne, VIC 3000, Australia.
Z
Zai-Yun Peng
School of Mathematics, Yunnan Normal University, 650092 Kunming, Yunnan, China.