A Memory Efficient Subspace Optimization Method for Training Large Language Models

Kun Yuan · PKU Workshop on Optimization Theory and Methods · Peking University, Beijing, China