corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a08747-bfe0-735e-bd4e-4b0866825aec

The Stack Below the Stack (Part 3): Serving at Scale

blog.desigeek.com · published 17 August 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at blog.desigeek.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
75
Words captured
23,421

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://recipes.vllm.ai/deepseek-ai/DeepSeek-V4-Pro
recipes.vllm.ai
https://github.com/vllm-project/vllm/pull/43425
github.com
https://en.wikipedia.org/wiki/Radix_tree
en.wikipedia.org
https://github.com/mlc-ai/xgrammar
github.com
https://github.com/guidance-ai/llguidance
github.com
https://www.manning.com/books/llm-customization-and-fine-tuning
manning.com
https://research.google/blog/looking-back-at-speculative-decoding/
research.google
https://www.cncf.io/projects/llm-d/
cncf.io
https://github.com/google/tpu-sync
github.com
https://github.com/vllm-project/vllm-ascend/issues
github.com
https://horace.io/brrr_intro.html
horace.io
https://arxiv.org/abs/2408.03314
arxiv.org
https://github.com/vllm-project/vllm/commit/01e7bebf34b4ce992c07b01ecb0d9c21a5890980
github.com
https://github.com/vllm-project/vllm/issues/40862
github.com
https://github.com/vllm-project/vllm/pull/41183
github.com
https://handbook.modular.com/
handbook.modular.com
https://arxiv.org/abs/2309.06180
arxiv.org
https://docs.vllm.ai/
docs.vllm.ai
https://vllm.ai/blog/2025-12-17-large-scale-serving
vllm.ai
https://arxiv.org/abs/2312.07104
arxiv.org
https://docs.sglang.ai/
docs.sglang.ai
https://github.com/NVIDIA/TensorRT-LLM
github.com
https://huggingface.co/docs/text-generation-inference
huggingface.co
https://github.com/InternLM/lmdeploy
github.com
https://github.com/ggerganov/llama.cpp
github.com
https://ollama.com/
ollama.com
https://arxiv.org/abs/2411.15100
arxiv.org
https://arxiv.org/abs/2306.00978
arxiv.org
https://arxiv.org/abs/2210.17323
arxiv.org
https://arxiv.org/abs/2209.05433
arxiv.org
https://docs.nvidia.com/deeplearning/transformer-engine/user-guide/index.html
docs.nvidia.com
https://arxiv.org/abs/2412.19437
arxiv.org
https://arxiv.org/abs/2305.13245
arxiv.org
https://arxiv.org/abs/2405.04434
arxiv.org
https://www.latent.space/p/inference-eng
latent.space
https://arxiv.org/abs/2311.03285
arxiv.org
https://arxiv.org/abs/2310.18547
arxiv.org
https://arxiv.org/abs/2211.17192
arxiv.org
https://arxiv.org/abs/2302.01318
arxiv.org
https://arxiv.org/abs/2401.10774
arxiv.org
https://arxiv.org/abs/2401.15077
arxiv.org
https://arxiv.org/abs/2404.19737
arxiv.org
https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B
huggingface.co
https://huggingface.co/Qwen/Qwen3.8-27B
huggingface.co
https://arxiv.org/abs/2607.05147
arxiv.org
https://arxiv.org/abs/2508.06471
arxiv.org
https://arxiv.org/abs/2602.15763
arxiv.org
Speculative Decoding: Getting K Tokens for the Price of One Read at the source ↗
salmanq.com
https://www.baseten.co/inference-engineering/
baseten.co
https://www.together.ai/research
together.ai
https://github.com/deepseek-ai/DeepEP
github.com
Mixture of Experts Explained Read at the source ↗
huggingface.co
https://docs.nvidia.com/dynamo/latest/index.html
docs.nvidia.com
https://docs.nvidia.com/dynamo/latest/design_docs/dynamo_flow.html
docs.nvidia.com
https://github.com/ai-dynamo/nixl
github.com
https://github.com/LMCache/LMCache
github.com
https://github.com/llm-d/llm-d
github.com
https://rocm.docs.amd.com/
rocm.docs.amd.com
https://newsletter.semianalysis.com/p/mi300x-vs-h100-vs-h200-benchmark-part-1-training
newsletter.semianalysis.com
https://groq.com/technology/
groq.com
https://github.com/vllm-project/vllm-ascend
github.com
https://arxiv.org/abs/2606.24937
arxiv.org
https://github.com/vllm-project/production-stack
github.com
https://github.com/vllm-project/aibrix
github.com
https://arxiv.org/abs/2504.03648
arxiv.org
https://github.com/verl-project/verl
github.com
https://github.com/OpenRLHF/OpenRLHF
github.com
https://github.com/THUDM/slime
github.com
https://github.com/inclusionAI/AReaL
github.com
https://arxiv.org/abs/2309.17453
arxiv.org
https://arxiv.org/abs/2306.14048
arxiv.org
https://arxiv.org/abs/2404.14469
arxiv.org
https://arxiv.org/abs/2505.24133
arxiv.org
https://arxiv.org/abs/2405.16444
arxiv.org
Learning to reason with LLMs Read at the source ↗
openai.com