Record · corpus.blog/posts/01a0f8d0-64db-722e-a9f1-3c33d956b6e7

DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time — Huawei, GB300 NVL72, MI355X, B200

inferencex.semianalysis.com · published 9 June 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at inferencex.semianalysis.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
External links: 27
Words captured: 6,335

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://newsletter.semianalysis.com/p/deepseekv4-16t-day-0-to-day-43-performance

newsletter.semianalysis.com

https://inferencemax.ai/

inferencemax.ai

https://x.com/SemiAnalysis_/status/2062942704296743164

x.com

https://github.com/NVIDIA/TensorRT-LLM/pull/13710

github.com

https://github.com/NVIDIA/TensorRT-LLM/pull/13771

github.com

https://x.com/SemiAnalysis_/status/2048082151711641829

x.com

https://newsletter.semianalysis.com/p/inferencex-v2-nvidia-blackwell-vs

newsletter.semianalysis.com

https://x.com/EmbeddedLLM/status/1913854116545307094

x.com

https://github.com/sgl-project/sglang/pull/23600

github.com

https://github.com/vllm-project/vllm/pull/40760

github.com

https://github.com/NVIDIA/srt-slurm/pull/71

github.com

https://github.com/sgl-project/sglang/pull/23608

github.com

https://github.com/ROCm/ATOM/pull/650

github.com

https://github.com/NVIDIA/TensorRT-LLM/commit/b3f45bb608aecca666a451ca5138b81470487f05

github.com

https://github.com/SemiAnalysisAI/InferenceX/actions/runs/25231354124/job/73987414247

github.com

https://github.com/ROCm/aiter/pull/2916

github.com

https://semianalysis.com/tokenomics-model/

semianalysis.com

https://semianalysis.com/ai-cloud-tco-model/

semianalysis.com

https://semianalysis.com/accelerator-hbm-model/

semianalysis.com

https://github.com/vllm-project/vllm/issues/40902

github.com

https://github.com/sgl-project/sglang/issues/23666

github.com

https://gitcode.com/cann/community/blob/master/events/meetup/slides/DeepSeek-V4/20260424/DeepSeek-V4%E6%98%87%E8%85%BE%E9%A6%96%E5%8F%91_%E5%9F%BA%E4%BA%8ECANN%E7%9A%84%E9%AB%98%E6%80%A7%E8%83%BD%E6%8E%A8%E7%90%86%E4%BC%98%E5%8C%96%E5%AE%9E%E8%B7%B5.pdf

gitcode.com

https://newsletter.semianalysis.com/i/188090866/multi-token-prediction-mtp

newsletter.semianalysis.com

https://gitcode.com/cann/cann-recipes-infer/blob/052e0ba122043bf46a2b5d17e16488e53e7b0b60/executor/core/engine/execution_engine.py

gitcode.com

https://cann.csdn.net/69d8a96e54b52172bc684f2e.html

cann.csdn.net

https://x.com/deepseek_ai/status/2057854261699195173

x.com

https://github.com/SemiAnalysisAI/InferenceX

github.com

Elsewhere on inferencex.semianalysis.com (15)

https://inferencex.semianalysis.com/

inferencex.semianalysis.com

https://inferencex.semianalysis.com/quotes

inferencex.semianalysis.com

https://inferencex.semianalysis.com/inference?g_model=DeepSeek-V4-Pro&g_rundate=2026-04-27&g_runid=25016676395&i_hc=1&i_prec=fp4%2Cfp8&i_active=b200_vllm%2Cb300_vllm%2Cgb200_dynamo-vllm%2Ch200_vllm%2Cmi355x_atom%2Cmi355x_sglang

inferencex.semianalysis.com

https://inferencex.semianalysis.com/inference?i_hc=1&g_model=DeepSeek-V4-Pro&g_rundate=2026-04-25&i_prec=fp4%2Cfp8&g_runid=24943464864&i_active=b200_sglang%2Cb300_sglang%2Cmi355x_sglang

inferencex.semianalysis.com

https://inferencex.semianalysis.com/inference?g_model=DeepSeek-V4-Pro&g_rundate=2026-04-27&g_runid=25016676395&i_prec=fp4%2Cfp8&i_hc=1&i_legend=0&i_active=b200_vllm%2Cgb200_dynamo-vllm

inferencex.semianalysis.com

https://inferencex.semianalysis.com/inference?g_model=DeepSeek-V4-Pro&g_rundate=2026-04-27&g_runid=25016676395&i_prec=fp4%2Cfp8&i_hc=1&i_legend=0&i_active=b300_sglang%2Cb300_sglang_mtp

inferencex.semianalysis.com

https://inferencex.semianalysis.com/inference?g_model=DeepSeek-V4-Pro&g_rundate=2026-04-25&i_hc=1&i_legend=0&g_runid=24943464864&i_prec=fp4%2Cfp8&i_gpus=mi355x_atom%2Cmi355x_sglang&i_dstart=2026-04-25&i_dend=2026-04-26&i_active=mi355x_sglang

inferencex.semianalysis.com

https://inferencex.semianalysis.com/inference?g_model=DeepSeek-V4-Pro&g_rundate=2026-04-25&i_legend=0&g_runid=24943464864&i_prec=fp4%2Cfp8&i_gpus=mi355x_sglang%2Ch200_sglang&i_dstart=2026-04-25&i_dend=2026-05-27&i_dates=2026-05-02%2C2026-05-03%2C2026-05-04%2C2026-05-08%2C2026-05-10%2C2026-05-19%2C2026-05-21&i_active=mi355x_sglang

inferencex.semianalysis.com

https://inferencex.semianalysis.com/inference?g_rundate=2026-05-31&g_runid=26696268345&g_model=DeepSeek-V4-Pro&i_gpus=mi355x_atom%2Ch200_sglang&i_dstart=2026-04-26&i_dend=2026-05-14&i_prec=fp4%2Cfp8&i_active=mi355x_atom&i_dates=2026-05-02

inferencex.semianalysis.com

https://inferencex.semianalysis.com/inference?g_rundate=2026-05-29&g_model=DeepSeek-V4-Pro&g_runid=26649066318&i_gpus=b300_sglang%2Cb300_trt%2Cb300_vllm&i_active=b300_sglang%2Cb300_trt&i_dstart=2026-04-24&i_dend=2026-05-18&i_dates=2026-04-25%2C2026-04-26%2C2026-04-27%2C2026-04-28%2C2026-04-29%2C2026-05-03%2C2026-05-05

inferencex.semianalysis.com

https://inferencex.semianalysis.com/inference?i_hc=1&g_model=DeepSeek-V4-Pro&g_rundate=2026-06-08&g_runid=27099659001&i_prec=fp4%2Cfp8&i_gpus=gb300_dynamo-sglang%2Cgb300_dynamo-sglang_mtp&i_active=gb300_dynamo-sglang&i_dates=2026-04-30%2C2026-05-07%2C2026-05-11%2C2026-05-20%2C2026-05-22%2C2026-05-28%2C2026-06-02%2C2026-06-03%2C2026-06-08&i_dstart=2026-04-30&i_dend=2026-06-08

inferencex.semianalysis.com

https://inferencex.semianalysis.com/inference?g_model=DeepSeek-V4-Pro&g_rundate=2026-06-05&g_runid=27002889438&i_metric=y_tpPerMw&i_gpus=b200_vllm&i_dates=2026-04-28&i_dstart=2026-04-27&i_dend=2026-06-05&i_hc=1&i_linelabel=1

inferencex.semianalysis.com

https://inferencex.semianalysis.com/inference?g_model=DeepSeek-V4-Pro&g_rundate=2026-06-05&g_runid=27002889438&i_active=b300_sglang_mtp%2Cgb300_dynamo-sglang%2Cgb300_dynamo-sglang_mtp%2Cmi355x_sglang_mtp&i_linelabel=1

inferencex.semianalysis.com

https://inferencex.semianalysis.com/calculator?g_rundate=2026-06-08&g_model=DeepSeek-V4-Pro&g_runid=27099659001

inferencex.semianalysis.com

https://inferencex.semianalysis.com/inference?i_hc=1&g_model=DeepSeek-V4-Pro&g_rundate=2026-06-05&i_prec=fp4%2Cfp8&i_active=b200_vllm%2Cmi355x_vllm&g_runid=27002889438

inferencex.semianalysis.com