Talks
Talks, seminars, and invited presentations from the MELON Research Group. Browse our archive of past presentations.
2026
LLM Pretraining through Flat-Direction Dynamics Enhancement
Workshop on Intelligent Optimization and Decision-Making · Beijing, China
Speaker: Kun Yuan
Memory-Efficient LLM Training via Implicit Structures
Microsoft Research Asia ACE Talk · Beijing, China
Speaker: Kun Yuan
2025
A Single-Loop Decentralized Bilevel Algorithm with Transient Complexity Analysis
EUSIPCO 2025 · Palermo, Italy
Speaker: Kun Yuan
Subspace Optimization for LLM Training
RLChina 2025 · Beijing, China
Speaker: Kun Yuan
Memory-Efficient Pre-Training for LLMs
Invited Talk · Shenzhen, China
Speaker: Kun Yuan
SPARKLE: A Unified Single-Loop Primal-Dual Framework for Decentralized Bilevel Optimization
Great Bay University · Dongguan, China
Speaker: Kun Yuan
A Memory Efficient Subspace Optimization Method for Training Large Language Models
PKU Workshop on Optimization Theory and Methods · Peking University, Beijing, China
Speaker: Kun Yuan
2024
Subspace Optimization for Large Language Models with Convergence Guarantees
NUS-PKU-SJTU Workshop on Data Science and Machine Learning · National University of Singapore, Singapore
Speaker: Kun Yuan
A Mathematics-Inspired Learning-to-Optimize Framework for Decentralized Optimization
ORSC 2024 · Guiyang, China
Speaker: Kun Yuan
Efficient Optimization for Deep Learning: Part I
Fudan University · Shanghai, China
Speaker: Kun Yuan
Efficient Optimization for Deep Learning: Part II
Fudan University · Shanghai, China
Speaker: Kun Yuan
Efficient Optimization for Deep Learning: Part III
Fudan University · Shanghai, China
Speaker: Kun Yuan
Asynchronous Diffusion Learning with Agent Subsampling and Local Updates
IEEE ICASSP 2024 · Seoul, Korea
Speaker: Kun Yuan
Towards Decentralized Optimization over Digraphs: Effective Metrics, Lower Bound, and Optimal Algorithms
International Workshop on Stochastic Optimization · Xiangtan, China
Speaker: Kun Yuan
Distributed Machine Learning: Part I
Machine Learning Summer School (MLSS) · OIST, Okinawa, Japan
Speaker: Kun Yuan
Distributed Machine Learning: Part II
Machine Learning Summer School (MLSS) · OIST, Okinawa, Japan
Speaker: Kun Yuan
2023
Achieving Linear Speedup with Network-Independent Learning Rates in Decentralized Optimization
62nd IEEE Conference on Decision and Control (CDC) · Singapore
Speaker: Kun Yuan
Lower Bounds and Accelerated Algorithms in Distributed Optimization with Communication Compression
Chinese Academy of Sciences · Beijing, China
Speaker: Kun Yuan
Accelerating Decentralized Deep Training with Sparse and Effective Topologies
Chinese Academy of Sciences · Beijing, China
Speaker: Kun Yuan
A Unified Algorithm for Non-IID Decentralized Learning
Shenzhen University · Shenzhen, China
Speaker: Kun Yuan