首页 > AI前沿 > Q-LocalAdam: Memory-Efficient Client-Side Adaptive Optimization for Edge Federated Learning

Q-LocalAdam: Memory-Efficient Client-Side Adaptive Optimization for Edge Federated Learning

arXiv机器学习 2026-11-18 13:00 4 阅读 查看原文

背景与现有方法局限

On-device federated learning (FL) on edge devices is limited by the memory required by client-side adaptive optimizers. Maintaining optimizer states locally increases memory usage and can restrict the size of models that can be deployed on resource-constrained edge devices.

State quantization can reduce this memory footprint, but uniform compression methods may perform poorly under skewed, non-IID data distributions because they can lose small-variance values that are important for stable optimization.

Q-LocalAdam 优化器提出

We present Q-LocalAdam, a distribution-aware optimizer for memory-constrained edge devices. It applies block-wise linear quantization to the bounded momentum state and log-space quantization to the heavy-tailed variance state. A post-dequantization variance floor is used to maintain numerical stability.

Q-