Record · corpus.blog/posts/01a087da-c19c-71e8-b395-e27e7d407adb

AuroraGPT: Training Foundation Models on Supercomputers

Sam Foreman · published 16 December 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at samforeman.me Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 20
Words captured: 1,397

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://github.com/saforem2/ezpz

github.com

https://github.com/argonne-lcf/Megatron-DeepSpeed

github.com

https://github.com/argonne-lcf/inference-endpoints

github.com

https://github.com/argonne-lcf/Megatron-DeepSpeed/blob/e3b0398d2f2d3f8ec543e99373ca14bd18a1e4f8/megatron/arguments.py

github.com

https://sc24.supercomputing.org/2024/10/presenting-the-finalists-for-the-2024-gordon-bell-prize/

sc24.supercomputing.org

https://www.researchgate.net/profile/Carla-Mann-3/publication/387390653_MProt-DPO_Breaking_the_ExaFLOPS_Barrier_for_Multimodal_Protein_Design_Workflows_with_Direct_Preference_Optimization/links/67a0f736645ef274a46243f1/MProt-DPO-Breaking-the-ExaFLOPS-Barrier-for-Multimodal-Protein-Design-Workflows-with-Direct-Preference-Optimization.pdf

researchgate.net

https://dl.acm.org/doi/10.1109/SC41406.2024.00013

dl.acm.org

https://github.com/microsoft/DeepSpeed

github.com

https://samforeman.me/posts/auroragpt/long-sequences/

samforeman.me

https://raw.githubusercontent.com/saforem2/scaling4science/main/assets/25B.svg

raw.githubusercontent.com

https://raw.githubusercontent.com/saforem2/scaling4science/main/assets/33B.svg

raw.githubusercontent.com

https://github.com/saforem2/scaling4science

github.com

https://github.com/saforem2/Megatron-DS-Benchmarking

github.com

https://arxiv.org/abs/2509.13523

arxiv.org

https://www.ncdc.noaa.gov/data-access/model-data/model-datasets/global-forcast-system-gfs

ncdc.noaa.gov

https://arxiv.org/html/2312.15796v1

arxiv.org

https://doi.org/10.1109/SC41406.2024.00013

doi.org

https://arxiv.org/abs/2312.15796

arxiv.org

https://arxiv.org/abs/2310.04610

arxiv.org

https://samforeman.me/talks/2025/12/16/slides.html

samforeman.me