An Efficient Subspace Algorithm for Federated Learning on Heterogeneous Data
J. Zhang, Y. Fan, Y. Xu, K. Yuan
IEEE Transactions on Signal Processing, 2026
Federated OptimizationMemory-Efficient TrainingIEEE TSP 2026
Publications
Browse journal articles, conference papers, preprints, and technical reports from the group.
Showing 1–6 of 110 results
Accelerating LLM Pre-Training through Flat-Direction Dynamics Enhancement
S. Zhu, R. Hu, M. Wang, M. Sun, X. Wang, K. Yuan, Z. Wen
Advances in Neural Information Processing Systems (NeurIPS), 2026
LLM OptimizationLLM PretrainingOptimizerNeurIPS 2026Clapping: Removing Per-sample Storage for Pipeline Parallel Distributed Optimization with Communication Compression
B Kong, X Huang, Y Xu, Y Liang, B Wang, K Yuan
Advances in Neural Information Processing Systems (NeurIPS), 2026
Distributed OptimizationCommunication CompressionMemory-Efficient TrainingNeurIPS 2026BROS: Bias-Corrected Randomized Subspaces for Memory-Efficient Single-Loop Bilevel Optimization
H. Zhang, B. Kong, E. Zhang, K. Yuan
Advances in Neural Information Processing Systems (NeurIPS), 2026
Bilevel OptimizationMemory-Efficient TrainingNeurIPS 2026GNMR: Runtime Stability Control for Low-Precision Large Language Model Training
B. Kong, W. Jia, E. Zhang, G. Li, Y. Dong, Y. Wang, Y. Wang, Y. Peng, K. Yuan
The Conference on Empirical Methods in Natural Language Processing (EMNLP), 2026
LLM OptimizationEfficient QuantizationEMNLP 2026CMuon: Accelerating and Stabilizing Diffusion Transformer Training via Chunked Momentum Orthogonalization
C. Chen, P. Sun, K. Yuan
The European Conference on Computer Vision (ECCV), 2026
LLM OptimizerECCV 2026