Record · corpus.blog/posts/01a07d5d-72e7-7112-bd07-c154e4c77123

Building Blocks for Foundation Model Training and Inference on AWS

Hugging Face · published 11 May 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at huggingface.co Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 88
Words captured: 4,347

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://arxiv.org/abs/2001.08361

arxiv.org

https://cdn-uploads.huggingface.co/production/uploads/64d6b270c2eedf9af82baa23/X5ZiXBoPmJzcDhaiL_Zkf.jpeg

cdn-uploads.huggingface.co

https://blogs.nvidia.com/blog/ai-scaling-laws/

blogs.nvidia.com

https://slurm.schedmd.com/documentation.html

slurm.schedmd.com

https://kubernetes.io/docs/

kubernetes.io

https://pytorch.org/

pytorch.org

https://jax.readthedocs.io/

jax.readthedocs.io

https://prometheus.io/docs/introduction/overview/

prometheus.io

https://grafana.com/docs/grafana/latest/

grafana.com

https://cdn-uploads.huggingface.co/production/uploads/64d6b270c2eedf9af82baa23/QSBYRirLS8pkgJK3rvqMF.png

cdn-uploads.huggingface.co

https://aws.amazon.com/ec2/instance-types/accelerated-computing/

aws.amazon.com

https://aws.amazon.com/ec2/instance-types/p5/

aws.amazon.com

https://www.nvidia.com/en-us/data-center/h100/

nvidia.com

https://www.nvidia.com/en-us/data-center/h200/

nvidia.com

https://aws.amazon.com/ec2/instance-types/p6/

aws.amazon.com

https://www.nvidia.com/en-us/data-center/dgx-b200/

nvidia.com

Inside NVIDIA Blackwell Ultra: The Chip Powering the AI Factory Era Read at the source ↗

developer.nvidia.com

https://www.nvidia.com/en-us/data-center/dgx-b300/

nvidia.com

https://www.nvidia.com/en-us/data-center/hgx/

nvidia.com

https://aws.amazon.com/ec2/ultraclusters/

aws.amazon.com

https://docs.aws.amazon.com/ec2/latest/instancetypes/ac.html

docs.aws.amazon.com

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/efa.html

docs.aws.amazon.com

https://aws.amazon.com/blogs/aws/new-amazon-ec2-p5en-instances-with-nvidia-h200-tensor-core-gpus-and-efav3-networking/

aws.amazon.com

https://aws.amazon.com/blogs/machine-learning/aws-ai-infrastructure-with-nvidia-blackwell-two-powerful-compute-solutions-for-the-next-frontier-of-ai/

aws.amazon.com

https://aws.amazon.com/s3/

aws.amazon.com

https://www.lustre.org/about/

lustre.org

https://aws.amazon.com/fsx/lustre/

aws.amazon.com

https://cdn-uploads.huggingface.co/production/uploads/64d6b270c2eedf9af82baa23/iMu8fYvHpDiGrquj6d-6m.jpeg

cdn-uploads.huggingface.co

https://aws.amazon.com/ec2/ultraservers/

aws.amazon.com

https://aws.amazon.com/about-aws/whats-new/2025/07/amazon-p6e-gb200-ultraservers-gpu-performance-ec2/

aws.amazon.com

https://www.nvidia.com/en-us/data-center/gb200-nvl72/

nvidia.com

https://developer.nvidia.com/blog/nvidia-grace-hopper-superchip-architecture-in-depth/

developer.nvidia.com

https://aws.amazon.com/blogs/aws/new-amazon-ec2-p6e-gb200-ultraservers-powered-by-nvidia-grace-blackwell-gpus-for-the-highest-ai-performance/

aws.amazon.com

https://slurm.schedmd.com/

slurm.schedmd.com

https://kubernetes.io/

kubernetes.io

https://cdn-uploads.huggingface.co/production/uploads/64d6b270c2eedf9af82baa23/rYM10isubva2wx3jIVeZm.png

cdn-uploads.huggingface.co

https://slurm.schedmd.com/sched_config.html

slurm.schedmd.com

https://slurm.schedmd.com/priority_multifactor.html

slurm.schedmd.com

https://slurm.schedmd.com/topology.html

slurm.schedmd.com

https://slurm.schedmd.com/gres.html

slurm.schedmd.com

https://github.com/aws/aws-parallelcluster

github.com

https://aws.amazon.com/pcs/

aws.amazon.com

https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod.html

docs.aws.amazon.com

https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod-resiliency-slurm-cluster-health-check.html

docs.aws.amazon.com

https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod-resiliency-slurm-auto-resume.html

docs.aws.amazon.com

https://kueue.sigs.k8s.io/

kueue.sigs.k8s.io

https://volcano.sh/

volcano.sh

https://github.com/NVIDIA/KAI-Scheduler

github.com

https://aws.amazon.com/eks/

aws.amazon.com

https://github.com/NVIDIA/k8s-device-plugin

github.com

https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod-eks.html

docs.aws.amazon.com

https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod-eks-operate-console-ui-governance-policies.html

docs.aws.amazon.com

https://karpenter.sh/

karpenter.sh

https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-eks-checkpointless.html

docs.aws.amazon.com

https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-eks-elastic-training.html

docs.aws.amazon.com

https://cdn-uploads.huggingface.co/production/uploads/64d6b270c2eedf9af82baa23/nglvcX4bzuE_vxavN-2ZU.png

cdn-uploads.huggingface.co

https://docs.nvidia.com/cuda/gpudirect-rdma/index.html

docs.nvidia.com

https://github.com/NVIDIA/gdrcopy

github.com

https://github.com/amzn/amzn-drivers

github.com

https://github.com/ofiwg/libfabric

github.com

https://www.lustre.org/

lustre.org

https://developer.nvidia.com/cuda-toolkit

developer.nvidia.com

https://github.com/Dao-AILab/flash-attention

github.com

https://triton-lang.org/

triton-lang.org

https://github.com/NVIDIA/cutlass/blob/1d9e1f6d7a1e820a884765cf3dcfda05c95f39d1/media/docs/cpp/cute/00_quickstart.md

github.com

https://github.com/NVIDIA/cutlass

github.com

https://developer.nvidia.com/nccl

developer.nvidia.com

Democratizing Large-Scale Mixture-of-Experts Training with NVIDIA PyTorch Parallelism Read at the source ↗

developer.nvidia.com

https://github.com/aws/aws-ofi-nccl

github.com

https://github.com/ai-dynamo/nixl

github.com

https://docs.pytorch.org/docs/stable/nn.html

docs.pytorch.org

https://docs.pytorch.org/docs/stable/distributed.fsdp.fully_shard.html

docs.pytorch.org

https://huggingface.co/docs/transformers/

huggingface.co

https://huggingface.co/docs/accelerate/

huggingface.co

https://developer.nvidia.com/megatron-core

developer.nvidia.com

https://docs.nvidia.com/nemo-framework/user-guide/latest/

docs.nvidia.com

https://github.com/volcengine/verl

github.com

https://github.com/vllm-project/vllm

github.com

https://github.com/sgl-project/sglang

github.com

NVIDIA Dynamo, A Low-Latency Distributed Inference Framework for Scaling Reasoning AI Models Read at the source ↗

developer.nvidia.com

https://docs.aws.amazon.com/prometheus/latest/userguide/what-is-Amazon-Managed-Service-Prometheus.html

docs.aws.amazon.com

https://docs.aws.amazon.com/grafana/latest/userguide/what-is-Amazon-Managed-Service-Grafana.html

docs.aws.amazon.com

https://github.com/NVIDIA/dcgm-exporter

github.com

https://grafana.com/grafana/dashboards/21645-gpu-health-cluster/

grafana.com

https://cdn-uploads.huggingface.co/production/uploads/64d6b270c2eedf9af82baa23/CNoV_SbvTriVgMgg85ekz.png

cdn-uploads.huggingface.co

https://www.linkedin.com/in/aman-shanbhag/

linkedin.com

https://www.linkedin.com/in/pbelevich/

linkedin.com

https://www.linkedin.com/in/keitawatanabe/

linkedin.com