corpus.blog
42,060 blogs · 5,214,511 posts Claim your blog
Record · corpus.blog/posts/01a0878d-2f30-703b-8830-6274d53e7750

Training extremely large neural networks across thousands of GPUs.

jeremyjordan.me · published 27 February 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at jeremyjordan.me Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
21
Words captured
4,138

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://ai.meta.com/research/publications/the-llama-3-herd-of-models/?ref=jeremyjordan.me
ai.meta.com
https://resources.nvidia.com/en-us-tensor-core/nvidia-tensor-core-gpu-datasheet?ref=jeremyjordan.me
resources.nvidia.com
https://arxiv.org/pdf/1812.06162.pdf?ref=jeremyjordan.me
arxiv.org
https://pytorch.org/docs/stable/generated/torch.optim.AdamW.html?ref=jeremyjordan.me
pytorch.org
https://pytorch.org/docs/stable/profiler.html?ref=jeremyjordan.me
pytorch.org
https://arxiv.org/abs/2304.11277?ref=jeremyjordan.me
arxiv.org
https://arxiv.org/abs/1811.06965?ref=jeremyjordan.me
arxiv.org
https://arxiv.org/abs/1806.03377?ref=jeremyjordan.me
arxiv.org
https://arxiv.org/abs/1909.08053?ref=jeremyjordan.me
arxiv.org
https://arxiv.org/abs/2411.01783?ref=jeremyjordan.me
arxiv.org
https://arxiv.org/abs/2101.03961?ref=jeremyjordan.me
arxiv.org
https://github.com/deepseek-ai/DualPipe?ref=jeremyjordan.me
github.com
https://arxiv.org/abs/2412.19437?ref=jeremyjordan.me
arxiv.org
https://arxiv.org/abs/2006.15704?ref=jeremyjordan.me
arxiv.org
https://arxiv.org/abs/2104.04473?ref=jeremyjordan.me
arxiv.org
https://huggingface.co/spaces/nanotron/ultrascale-playbook?ref=jeremyjordan.me
huggingface.co
https://www.youtube.com/watch?v=ZkWs89H7baA&ref=jeremyjordan.me
youtube.com
https://www.youtube.com/watch?v=-K3bZYHYHEA&list=PL_lsbAsL_o2CSuhUhJIiW0IkdT5C2wGWj&ref=jeremyjordan.me
youtube.com
https://www.youtube.com/watch?v=gHaNUcS1_O4&ref=jeremyjordan.me
youtube.com
https://www.youtube.com/watch?v=kgOJHAdNnGU&ref=jeremyjordan.me
youtube.com
https://www.youtube.com/watch?v=9MvD-XsowsE&ref=jeremyjordan.me
youtube.com
Elsewhere on jeremyjordan.me (3)