corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a07d5d-86e9-710f-b9c2-b454a574f499

'I paid for the whole GPU, I am going to use the whole GPU': A high-level guide to GPU utilization

Modal · published 24 February 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at modal.com Wayback capture
1blogs citing
First cited
9 Jan 2026
Most recent
9 Jan 2026
Rank this month
not ranked
Links from this post
43
Words captured
3,060

Cited by

Blog
In the post
Date
Jonathon Belotti [thundergolfer]
20,000 healthy GPUs Read at the source ↗
9 Jan 2026

Links from this post

Link
Host
https://old.reddit.com/r/chiptunes/comments/qc0zl5/why_did_fm_synthesis_take_so_long_to_take_off/hhemu2v/
old.reddit.com
https://modal.com/gpu-glossary/device-hardware/streaming-multiprocessor
modal.com
https://www.youtube.com/watch?v=3jJ1GhGkLY0
youtube.com
Memory snapshots: Checkpoint/restore for sub-second startup Read at the source ↗
modal.com
https://ai-infrastructure.org/the-state-of-ai-infrastructure-at-scale-2024/
ai-infrastructure.org
https://www.banana.dev/blog/sunset
banana.dev
https://modal.com/docs
modal.com
https://modal.com/pricing
modal.com
https://modal.com/gpu-glossary/device-software/cuda-programming-model
modal.com
https://modal.com/gpu-glossary/host-software/nvidia-smi
modal.com
https://modal.com/gpu-glossary/host-software/nvml
modal.com
https://modal.com/docs/guide/gpu-metrics
modal.com
https://martinfowler.com/bliki/Yagni.html
martinfowler.com
https://modal.com/gpu-glossary/host-software/cuda-runtime-api
modal.com
https://pytorch.org/blog/accelerating-pytorch-with-cuda-graphs/
pytorch.org
https://modal.com/docs/guide/dynamic-batching
modal.com
https://modal.com/docs/examples/torch_profiling
modal.com
https://slate.com/technology/2014/08/shark-attacks-threaten-google-s-undersea-internet-cables-video.html
slate.com
https://modal.com/gpu-glossary/device-hardware/register-file
modal.com
https://modal.com/gpu-glossary/device-software/memory-hierarchy
modal.com
https://modal.com/gpu-glossary/device-hardware/gpu-ram
modal.com
https://arxiv.org/abs/2205.14135
arxiv.org
How to Optimize a CUDA Matmul Kernel for cuBLAS-like Performance: a Worklog Read at the source ↗
siboehm.com
https://modal.com/gpu-glossary/device-hardware/tensor-core
modal.com
Outperforming cuBLAS on H100: a Worklog Read at the source ↗
cudaforfun.substack.com
https://docs.nvidia.com/datacenter/dcgm/latest/user-guide/feature-overview.html
docs.nvidia.com
https://github.com/stas00/ml-engineering/blob/master/training/performance/README.md
github.com
https://arxiv.org/abs/2407.21783
arxiv.org
DeepSeek Debates: Chinese Leadership On Cost, True Training Cost, Closed Model Margin Impacts Read at the source ↗
semianalysis.com
https://github.com/stas00/ml-engineering/tree/master/compute/accelerator
github.com
https://github.com/gunnarmorling/1brc
github.com
https://www.hetzner.com/dedicated-rootserver/ax161
hetzner.com
https://en.wikipedia.org/wiki/Advanced_Vector_Extensions
en.wikipedia.org
https://modal.com/
modal.com
https://modal.com/gpu-glossary
modal.com
https://www.youtube.com/watch?v=139UPjoq7Kw&t=1236s
youtube.com
https://blog.codingconfessions.com/p/gpu-computing
blog.codingconfessions.com
https://github.com/stas00/ml-engineering/
github.com
https://x.com/marksaroufim
x.com
https://x.com/pytorch
x.com
https://x.com/GPU_MODE
x.com
https://x.com/erikdunteman
x.com
https://pig.dev
pig.dev