corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a087da-c19c-71e8-b395-e27e7e120a3c

Training Foundation Models on Supercomputers

Sam Foreman · published 24 October 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at samforeman.me Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
39
Words captured
1,750

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://samforeman.me
samforeman.me
https://www.alcf.anl.gov/about/people/group/506
alcf.anl.gov
https://auroragpt.anl.gov
auroragpt.anl.gov
https://arxiv.org/abs/2509.13523
arxiv.org
https://awards.acm.org/bell-climate
awards.acm.org
https://www.researchgate.net/publication/387390653_MProt-DPO_Breaking_the_ExaFLOPS_Barrier_for_Multimodal_Protein_Design_Workflows_with_Direct_Preference_Optimization
researchgate.net
https://sc24.supercomputing.org/2024/10/presenting-the-finalists-for-the-2024-gordon-bell-prize/
sc24.supercomputing.org
https://www.biorxiv.org/content/10.1101/2022.10.10.511571v2
biorxiv.org
https://www.acm.org/media-center/2022/november/gordon-bell-special-prize-covid-research-2022
acm.org
https://alcf.anl.gov
alcf.anl.gov
https://www.chicagomag.com/wp-content/uploads/2023/01/C202302-Aurora-Supercomputer-nodes.jpg
chicagomag.com
https://www.chicagomag.com/wp-content/uploads/2023/01/C202302-Aurora-Supercomputer-Argonne.jpg
chicagomag.com
https://www.chicagomag.com/chicago-magazine/february-2023/the-computer-that-will-change-everything/
chicagomag.com
https://www.alcf.anl.gov/sites/default/files/2024-07/Aurora_FactSheet_2024.pdf
alcf.anl.gov
https://accounts.alcf.anl.gov/
accounts.alcf.anl.gov
https://nairrpilot.org/
nairrpilot.org
https://x.com/tenderizzation/status/1944591320796090606
x.com
https://twitter.com/tenderizzation
twitter.com
https://chatgpt.com/share/688ab77e-9ca0-800a-8ab0-a293e06b3cce
chatgpt.com
https://github.com/Hannibal046/Awesome-LLM
github.com
https://github.com/argonne-lcf/Megatron-DeepSpeed
github.com
https://github.com/argonne-lcf/inference-endpoints
github.com
https://github.com/argonne-lcf/Megatron-DeepSpeed/blob/e3b0398d2f2d3f8ec543e99373ca14bd18a1e4f8/megatron/arguments.py
github.com
https://www.researchgate.net/profile/Carla-Mann-3/publication/387390653_MProt-DPO_Breaking_the_ExaFLOPS_Barrier_for_Multimodal_Protein_Design_Workflows_with_Direct_Preference_Optimization/links/67a0f736645ef274a46243f1/MProt-DPO-Breaking-the-ExaFLOPS-Barrier-for-Multimodal-Protein-Design-Workflows-with-Direct-Preference-Optimization.pdf
researchgate.net
https://dl.acm.org/doi/10.1109/SC41406.2024.00013
dl.acm.org
https://github.com/microsoft/DeepSpeed
github.com
https://samforeman.me/posts/auroragpt/long-sequences/
samforeman.me
https://raw.githubusercontent.com/saforem2/scaling4science/main/assets/25B.svg
raw.githubusercontent.com
https://raw.githubusercontent.com/saforem2/scaling4science/main/assets/33B.svg
raw.githubusercontent.com
https://github.com/saforem2/scaling4science
github.com
https://github.com/saforem2/Megatron-DS-Benchmarking
github.com
https://www.researchgate.net/publication/337499051_Learning_better_physics_a_machine_learning_approach_to_lattice_gauge_theory
researchgate.net
https://www.intel.com/content/www/us/en/newsroom/news/intel-powered-aurora-supercomputer-breaks-exascale-barrier.html
intel.com
https://www.ncdc.noaa.gov/data-access/model-data/model-datasets/global-forcast-system-gfs
ncdc.noaa.gov
https://arxiv.org/html/2312.15796v1
arxiv.org
https://doi.org/10.1109/SC41406.2024.00013
doi.org
https://arxiv.org/abs/2312.15796
arxiv.org
https://arxiv.org/abs/2310.04610
arxiv.org
https://samforeman.me/talks/2025/10/24/slides.html
samforeman.me