corpus.blog
42,805 blogs · 5,350,595 posts Claim your blog
Record · corpus.blog/posts/01a0f8d0-64db-722e-a9f1-3c33d5c06e5c

AgentX - InferenceXv3: Does the CUDA Moat Hold Up in Agentic Inferencing?

inferencex.semianalysis.com · published 24 August 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at inferencex.semianalysis.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
169
Words captured
16,508

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://newsletter.semianalysis.com/p/claude-code-is-the-inflection-point
newsletter.semianalysis.com
https://openai.com/signals/enterprise-data/
openai.com
https://github.com/SemiAnalysisAI/InferenceX
github.com
http://recipes.vllm.ai
recipes.vllm.ai
https://docs.sglang.io/cookbook/intro
docs.sglang.io
https://huggingface.co/datasets/semianalysisai/cc-traces-weka-062126
huggingface.co
https://github.com/alibaba-edu/qwen-bailian-usagetraces-anon
github.com
https://github.com/ai-dynamo/aiperf
github.com
https://semianalysis.com/datacenter-industry-model/
semianalysis.com
https://github.com/sgl-project/sglang/blob/v0.5.17/python/sglang/srt/server_args.py
github.com
https://github.com/vllm-project/vllm/issues/52911
github.com
https://github.com/vllm-project/router/blob/main/src/policies/consistent_hash.rs
github.com
https://github.com/vllm-project/router
github.com
https://github.com/llm-d/llm-d-router
github.com
https://github.com/sgl-project/sglang/tree/main/sgl-model-gateway
github.com
https://github.com/ROCm/ATOM/tree/main/atom/mesh
github.com
https://pypi.org/project/mooncake-transfer-engine/
pypi.org
https://github.com/kvcache-ai/Mooncake/tree/main/mooncake-transfer-engine
github.com
https://docs.vllm.ai/en/latest/design/attention_backends/
docs.vllm.ai
https://github.com/vllm-project/vllm/pull/43447
github.com
https://github.com/vllm-project/vllm/pull/44774
github.com
https://github.com/vllm-project/vllm/pull/45444
github.com
https://github.com/vllm-project/vllm/pull/42258
github.com
https://github.com/vllm-project/vllm/pull/44082
github.com
https://github.com/vllm-project/vllm/pull/37160
github.com
https://github.com/vllm-project/vllm/pull/40549
github.com
https://github.com/vllm-project/vllm/pull/42296
github.com
https://github.com/vllm-project/vllm/pull/42828
github.com
https://github.com/vllm-project/vllm/pull/51052
github.com
https://github.com/vllm-project/vllm/pull/41289
github.com
https://github.com/vllm-project/vllm/pull/46412
github.com
https://github.com/vllm-project/vllm/pull/46906
github.com
https://github.com/vllm-project/vllm/pull/45659
github.com
https://github.com/vllm-project/vllm/pull/45969
github.com
https://github.com/vllm-project/vllm/pull/45971
github.com
https://github.com/vllm-project/vllm/pull/46188
github.com
https://github.com/vllm-project/vllm/pull/44103
github.com
https://github.com/vllm-project/vllm/pull/45371
github.com
https://github.com/vllm-project/vllm/pull/46855
github.com
https://github.com/vllm-project/vllm/pull/45340
github.com
https://github.com/vllm-project/vllm/pull/49069
github.com
https://github.com/vllm-project/vllm/pull/49071
github.com
https://github.com/vllm-project/vllm/pull/51183
github.com
https://github.com/vllm-project/vllm/pull/51714
github.com
https://github.com/vllm-project/vllm/pull/51713
github.com
https://github.com/vllm-project/vllm/pull/52882
github.com
https://github.com/sgl-project/sglang/pull/26907
github.com
https://github.com/sgl-project/sglang/pull/27210
github.com
https://github.com/sgl-project/sglang/pull/29369
github.com
https://github.com/sgl-project/sglang/pull/34565
github.com
https://github.com/sgl-project/sglang/pull/30339
github.com
https://github.com/sgl-project/sglang/pull/29417
github.com
https://github.com/sgl-project/sglang/pull/28534
github.com
https://github.com/sgl-project/sglang/pull/29735
github.com
https://github.com/sgl-project/sglang/pull/30255
github.com
https://github.com/sgl-project/sglang/pull/30365
github.com
https://github.com/sgl-project/sglang/pull/34888
github.com
https://github.com/sgl-project/sglang/pull/35017
github.com
https://github.com/sgl-project/sglang/pull/26091
github.com
https://github.com/sgl-project/sglang/pull/26245
github.com
https://github.com/sgl-project/sglang/pull/26293
github.com
https://github.com/sgl-project/sglang/pull/26387
github.com
https://github.com/sgl-project/sglang/pull/26579
github.com
https://github.com/sgl-project/sglang/pull/30461
github.com
https://github.com/sgl-project/sglang/pull/30497
github.com
https://github.com/sgl-project/sglang/pull/31294
github.com
https://github.com/sgl-project/sglang/pull/33662
github.com
https://github.com/sgl-project/sglang/pull/32042
github.com
https://github.com/sgl-project/sglang/pull/32196
github.com
https://github.com/sgl-project/sglang/pull/30545
github.com
https://github.com/sgl-project/sglang/pull/35070
github.com
https://github.com/sgl-project/sglang/pull/35071
github.com
https://github.com/sgl-project/sglang/pull/30762
github.com
https://github.com/sgl-project/sglang/pull/32368
github.com
https://github.com/sgl-project/sglang/pull/34216
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/17462
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/16231
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/17518
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/17428
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/16734
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/17473
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/16876
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/17316
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/17105
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/17285
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/16279
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/17278
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/15727
github.com
https://github.com/NVIDIA/TensorRT-LLM/pull/17526
github.com
https://github.com/ROCm/ATOM/pull/1640
github.com
https://github.com/ROCm/ATOM/pull/902
github.com
https://github.com/ROCm/ATOM/pull/939
github.com
https://github.com/ROCm/ATOM/pull/1345
github.com
https://github.com/ROCm/ATOM/pull/1771
github.com
https://github.com/ROCm/ATOM/pull/1318
github.com
https://github.com/ROCm/ATOM/pull/1406
github.com
https://github.com/ROCm/ATOM/pull/1725
github.com
https://github.com/ROCm/ATOM/pull/1807
github.com
https://github.com/ROCm/ATOM/pull/1737
github.com
https://github.com/ROCm/ATOM/pull/1331
github.com
https://github.com/ROCm/ATOM/pull/1647
github.com
https://github.com/ROCm/ATOM/pull/1220
github.com
https://github.com/ROCm/ATOM/pull/1701
github.com
https://github.com/ROCm/ATOM/pull/1746
github.com
https://github.com/ROCm/ATOM/pull/1911
github.com
https://github.com/ROCm/ATOM/pull/1552
github.com
https://github.com/ROCm/aiter/pull/3728
github.com
https://github.com/ROCm/aiter/pull/3267
github.com
https://github.com/ROCm/aiter/pull/2893
github.com
https://github.com/ROCm/aiter/pull/4474
github.com
https://github.com/ROCm/aiter/pull/4680
github.com
https://github.com/ROCm/aiter/pull/3459
github.com
https://github.com/ai-dynamo/dynamo/pull/10540
github.com
https://github.com/ai-dynamo/dynamo/pull/10836
github.com
https://github.com/ai-dynamo/dynamo/pull/11095
github.com
https://github.com/ai-dynamo/dynamo/pull/11503
github.com
https://github.com/ai-dynamo/dynamo/pull/11508
github.com
https://github.com/ai-dynamo/dynamo/pull/12329
github.com
https://github.com/ai-dynamo/dynamo/pull/10521
github.com
https://github.com/ai-dynamo/dynamo/pull/10676
github.com
https://github.com/ai-dynamo/dynamo/pull/11644
github.com
https://github.com/ai-dynamo/dynamo/pull/10645
github.com
https://github.com/ai-dynamo/dynamo/pull/12158
github.com
https://github.com/ai-dynamo/dynamo/pull/13447
github.com
https://github.com/ai-dynamo/dynamo/pull/10437
github.com
https://github.com/ai-dynamo/dynamo/pull/11104
github.com
https://github.com/ai-dynamo/dynamo/pull/11539
github.com
https://github.com/ai-dynamo/dynamo/pull/11574
github.com
https://github.com/ai-dynamo/dynamo/pull/11569
github.com
https://github.com/ai-dynamo/dynamo/pull/10433
github.com
https://github.com/ai-dynamo/dynamo/pull/11820
github.com
https://github.com/ai-dynamo/dynamo/pull/12161
github.com
https://github.com/ai-dynamo/dynamo/pull/12999
github.com
https://github.com/LMCache/LMCache/pull/3382
github.com
https://github.com/LMCache/LMCache/pull/3635
github.com
https://github.com/LMCache/LMCache/pull/3869
github.com
https://github.com/LMCache/LMCache/pull/3908
github.com
https://github.com/LMCache/LMCache/pull/4524
github.com
https://github.com/LMCache/LMCache/pull/3092
github.com
https://github.com/LMCache/LMCache/pull/3101
github.com
https://github.com/LMCache/LMCache/pull/3843
github.com
https://github.com/LMCache/LMCache/pull/4273
github.com
https://github.com/LMCache/LMCache/pull/4363
github.com
https://github.com/LMCache/LMCache/pull/3561
github.com
https://github.com/kvcache-ai/Mooncake/pull/2225
github.com
https://github.com/kvcache-ai/Mooncake/pull/3184
github.com
https://github.com/kvcache-ai/Mooncake/pull/3338
github.com
https://newsletter.semianalysis.com/p/can-amd-break-the-cuda-moat-amd-advancing
newsletter.semianalysis.com
https://github.com/vllm-project/vllm/pull/45879
github.com
https://github.com/vllm-project/vllm/pull/45720
github.com
https://github.com/vllm-project/vllm/pull/45546
github.com
https://arxiv.org/abs/2506.02634
arxiv.org
https://arxiv.org/html/2608.09867v1
arxiv.org
https://github.com/callanjfox/kv-cache-tester
github.com
https://docs.nvidia.com/aiperf/benchmark-modes/trace-replay-with-mooncake-traces
docs.nvidia.com
https://huggingface.co/datasets/semianalysisai/cc-traces-weka-062126-256k
huggingface.co
https://github.com/SemiAnalysisAI/aiperf
github.com
https://en.wikipedia.org/wiki/Thundering_herd_problem
en.wikipedia.org
https://platform.claude.com/docs/en/build-with-claude/prompt-caching
platform.claude.com
Open vs Closed Loop: A Benchmarking Crime Read at the source ↗
notpeerreviewed.com
https://newsletter.semianalysis.com/i/188090866/multi-token-prediction-mtp
newsletter.semianalysis.com
https://github.com/SemiAnalysisAI/InferenceX/tree/main/golden_al_distribution
github.com
https://huggingface.co/datasets/nvidia/SPEED-Bench
huggingface.co
https://github.com/SemiAnalysisAI/aiperf/releases
github.com
https://github.com/sgl-project/sglang/issues/27574
github.com
https://github.com/SemiAnalysisAI/InferenceX-app/issues/new/choose
github.com
https://newsletter.semianalysis.com/subscribe
newsletter.semianalysis.com
https://github.com/anthropics/claude-code/issues/49207
github.com
https://github.com/anthropics/claude-code/issues/66761
github.com
Elsewhere on inferencex.semianalysis.com (23)
https://inferencex.semianalysis.com/
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference/agentic/440193?i_seq=agentic-traces&i_xmode=interactivity&view=logs
inferencex.semianalysis.com
https://inferencex.semianalysis.com/quotes
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_rundate=2026-08-21&i_seq=agentic-traces&g_runid=32433563482&i_xmode=interactivity&i_label=0&i_e2e_xmetric=
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_rundate=2026-08-21&g_runid=32433563482&i_seq=agentic-traces&i_xmode=interactivity&i_best=0&i_active=mi355x_atom%2Cmi355x_mori-sglang&i_vendor=AMD&i_linelabel=0&i_metric=y_tpPerGpu
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_rundate=2026-08-21&g_runid=32433563482&i_seq=agentic-traces&i_metric=y_tpPerGpu&i_xmode=interactivity&i_linelabel=0&i_best=0&i_active=gb200_dynamo-vllm%2Cgb300_dynamo-trt
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_rundate=2026-08-21&g_runid=32433563482&i_seq=agentic-traces&i_xmode=interactivity&i_best=0&i_active=b200_vllm%2Cb300_vllm
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference/agentic/439522
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference/agentic/439967
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_rundate=2026-08-21&g_runid=32433563482&i_seq=agentic-traces&i_xmode=interactivity&i_best=0&i_active=b200_sglang%2Ch200_dynamo-sglang%2Cmi355x_sglang
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_rundate=2026-08-21&g_runid=32433563482&i_seq=agentic-traces&i_xmode=ttft&i_best=0&i_active=h200_dynamo-sglang&i_optimal=0
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_rundate=2026-08-21&g_runid=32433563482&i_seq=agentic-traces&i_xmode=ttft&i_best=0&i_active=b200_vllm%2Cb300_vllm%2Cmi355x_atom%2Cmi355x_vllm&i_label=0
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_model=MiniMax-M3&i_seq=agentic-traces&i_xmode=ttft
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_model=MiniMax-M3&i_seq=agentic-traces&i_xmode=interactivity&i_best=0&i_hc=1&i_active=mi355x_vllm
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_model=MiniMax-M3&i_seq=agentic-traces&i_xmode=ttft&i_best=0&i_active=b200_trt%2Cb200_vllm%2Cb300_trt%2Cb300_vllm&i_hc=1&i_label=0
inferencex.semianalysis.com
https://inferencex.semianalysis.com/agentx/cc-traces-weka-062126-256k
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_model=Qwen-3.5-397B-A17B&i_seq=agentic-traces&i_xmode=ttft&i_best=0&i_hc=1
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_model=Qwen-3.5-397B-A17B&i_seq=agentic-traces&i_xmode=interactivity&i_hc=1&i_best=0&i_prec=fp4%2Cfp8&i_active=b300_sglang%2Ch100_sglang%2Ch200_sglang
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_model=GLM-5.2&i_seq=agentic-traces&i_xmode=ttft&i_best=0&i_prec=fp4&i_active=b200_sglang%2Cb300_sglang%2Cgb200_dynamo-sglang%2Cgb300_dynamo-trt%2Cmi355x_atom%2Cmi355x_sglang
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference/agentic/439239
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference?g_rundate=2026-08-13&g_runid=31723588108&i_seq=agentic-traces&i_xmode=interactivity&g_model=MiniMax-M3&i_best=0&i_active=b200_vllm
inferencex.semianalysis.com
https://inferencex.semianalysis.com/inference/agentic/439903
inferencex.semianalysis.com
https://inferencex.semianalysis.com/datasets
inferencex.semianalysis.com