LLM Pretraining through Flat-Direction Dynamics Enhancement

Kun Yuan · Workshop on Intelligent Optimization and Decision-Making · Beijing, China