Local Epochs, Averaging, and Variable Selection in Federated Lasso

📅 2026-09-15
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究通过理论分析和蒙特卡洛模拟,探讨了在联邦Lasso中本地迭代次数、平均化及变量选择的影响,比较了几种方法在不同场景下的表现。
📝 Abstract
Theoretical analysis and Monte Carlo simulation separate local-epoch effects from averaging and tuning effects in federated Lasso. How much local work should precede averaging when fitting a sparse regression? An orthogonal calculation shows that extra epochs can have no effect while averaging still enlarges the selected set. A correlated two-site construction gives an exact, nonmonotone limiting objective gap and its minimizing epoch count. We then compare coordinate-descent averaging, two thresholding modifications, and adapted FedDualAvg across twelve scenarios and 600 replicates. Methods share a penalty, independent validation samples, selection rules, and resource limits. FedDualAvg generally achieves smaller objective gaps but does not always recover variables better. Thresholding gains depend strongly on selection rules. Epoch effects vary with correlation, signal strength, site allocation, and the outcome measured. These results distinguish faster iteration from better optimization, prediction, and variable selection.
Problem

Research questions and friction points this paper is trying to address.

Federated Lasso
Local Epochs
Averaging
Sparse Regression
Variable Selection
Innovation

Methods, ideas, or system contributions that make the work stand out.

Federated Lasso
Local Epochs
Averaging
Variable Selection
FedDualAvg
K
Keivan Bolouri
Department of Statistics, Donald Bren School of Information and Computer Sciences, University of California, Irvine