corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a0bbb3-d390-724f-8a41-2095fa2d5940

Dion: the distributed orthonormal update revolution is here

Microsoft Research · published 12 August 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at microsoft.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
18
Words captured
1,124

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://arxiv.org/pdf/1412.6980
arxiv.org
https://arxiv.org/pdf/1711.05101
arxiv.org
https://kellerjordan.github.io/posts/muon/
kellerjordan.github.io
https://github.com/KellerJordan/modded-nanogpt/tree/master
github.com
https://arxiv.org/abs/2502.16982
arxiv.org
https://arxiv.org/abs/2505.02222
arxiv.org
https://moonshotai.github.io/Kimi-K2/
moonshotai.github.io
https://arxiv.org/abs/2304.11277
arxiv.org
https://arxiv.org/abs/1909.08053
arxiv.org
Deriving Muon Read at the source ↗
jeremybernste.in
https://www.microsoft.com/en-us/research/publication/dion-distributed-orthonormalized-updates/
microsoft.com
https://en.wikipedia.org/wiki/Orthonormality
en.wikipedia.org
https://www.essential.ai/blog/infra
essential.ai
https://docs.modula.systems/algorithms/newton-schulz/
docs.modula.systems
https://github.com/microsoft/dion/
github.com
https://arxiv.org/pdf/1905.13727
arxiv.org
https://www.microsoft.com/en-us/research/event/microsoft-research-forum/past-episodes/?OCID=msr_researchforum_MCR_Blog_Promo
microsoft.com
https://arxiv.org/abs/2407.21783
arxiv.org