Posts

“Benchmarking Optimizers for Large Language Model Pretraining” (with Matteo Pagliardini and Martin Jaggi).

“Enhancing LLM Training via Spectral Clipping” (with Xiaowen Jiang and Sebastian U. Stich).

I am accepted at University of Zurich to follow the PhD program at the Department of Mathematical Modeling and Machine Learning (D3ML) in the research group of Prof. Dr. Anastasiia Koloskova.

“Apertus: Democratizing Open and Compliant LLMs for Global Language Environments” – a project by Team Apertus within the Swiss AI Initiative.

“Enhancing LLM Training via Spectral Clipping” – joint work with Xiaowen Jiang and Sebastian U. Stich.

“Gradient-Normalized Smoothness for Optimization with Approximate Hessians” – joint work with Martin Jaggi and Nikita Doikov.

“Adaptive Regularized Newton Method with Inexact Hessian” – joint work with Aleksandr Shestakov, Nail Bashirov, Alexander Gasnikov, Martin Takáč, Aleksandr Beznosikov and Dmitry Kamzolov.