背景与现有方法局限
On-device federated learning (FL) on edge devices is limited by the memory required by client-side adaptive optimizers. Maintaining optimizer states locally increases memory usage and can restrict the size of models that can be deployed on resource-constrained edge devices.
State quantization can reduce this memory footprint, but uniform compression methods may perform poorly under skewed, non-IID data distributions because they can lose small-variance values that are important for stable optimization.
Q-LocalAdam 优化器提出
We present Q-LocalAdam, a distribution-aware optimizer for memory-constrained edge devices. It applies block-wise linear quantization to the bounded momentum state and log-space quantization to the heavy-tailed variance state. A post-dequantization variance floor is used to maintain numerical stability.
Q-