Muon Is Scalable for LLM Training

5 pointsby renonce3 months ago

1 comment

yorwba3 months ago

For people who want to know more about the Muon optimizer: <a href="https://kellerjordan.github.io/posts/muon/" rel="nofollow">https://kellerjordan.github.io/posts/muon/</a>