MLO Group Meeting, "Benchmarking Optimizers for LLM Pretraining (raw edition)"

Slides

Date
May 7, 2025 2:00 PM — 2:30 PM
Event
MLO Group Meeting
Location
EPFL
Rte J-D. Colladon, Ecublens, Vaud 1015
LLMs Pretraining Optimizers Training Dynamics
Andrii Semenov
Andrii Semenov
ML Researcher

My research interests include Large-Scale and Stochastic Optimization.