Optimizers

MLO Group Meeting, "Benchmarking Optimizers for LLM Pretraining (raw edition)"
30 minutes oral talk on modern optimizers and their efficacy in LLM training.
May 7, 2025 2:00 PM — 2:30 PM EPFL
Slides
MLO Group Meeting, "Benchmarking Optimizers for LLM Pretraining (raw edition)"