corpus.blog
41,948 blogs · 5,214,511 posts Claim your blog
Record · corpus.blog/posts/01a0fe82-ddc4-71d5-bac6-31b62c6a825a

Accelerating PyTorch with CUDA Graphs

PyTorch Blog · published 26 October 2021

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at pytorch.org Wayback capture
3blogs citing
First cited
2 Jan 2023
Most recent
14 May 2026
Rank this month
not ranked
External links
12
Words captured
3,076

Cited by

Blog
In the post
Date
Hugging Face
Unlocking asynchronicity in continuous batching Read at the source ↗
14 May 2026
Modal
'I paid for the whole GPU, I am going to use the whole GPU': A high-level guide to GPU utilization Read at the source ↗
24 Feb 2025
Tristan Hume
Production Twitter on One Machine? 100Gbps NICs and NVMe are fast Read at the source ↗
2 Jan 2023

Links from this post

Link
Host
https://blogs.nvidia.com/blog/2021/06/30/mlperf-ai-training-partners/
blogs.nvidia.com
https://github.com/NVIDIA/Megatron-LM
github.com
https://developer.nvidia.com/nccl
developer.nvidia.com
https://developer.nvidia.com/blog/cuda-10-features-revealed/
developer.nvidia.com
https://developer.nvidia.com/blog/cuda-graphs
developer.nvidia.com
https://www.nvidia.com/en-us/on-demand/session/gtcspring21-s32082/
nvidia.com
https://docs.nvidia.com/deeplearning/nccl/user-guide/docs/usage/cudagraph.html
docs.nvidia.com
https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html
docs.nvidia.com
https://docs.nvidia.com/cuda/cuda-runtime-api/group__CUDART__GRAPH.html
docs.nvidia.com
https://ngc.nvidia.com/catalog/collections?orderBy=scoreDESC&pageNumber=0&query=pytorch&quickFilter=&filters=
ngc.nvidia.com
https://github.com/NVIDIA/DeepLearningExamples/tree/master/PyTorch/
github.com
https://github.com/mlcommons/training_results_v1.0/tree/master/NVIDIA
github.com
Elsewhere on pytorch.org (7)