56,966 blogs · 4,417,066 posts Claim your blog

Record · corpus.blog/posts/01a08c74-da1b-709a-9abd-0dbccb1007c9

Deploying Qwen3.8-2.4T-A95B on Amazon SageMaker HyperPod with vLLM

AWS Machine Learning · published 9 September 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at aws.amazon.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 15
Words captured: 4,330

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B

huggingface.co

https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod.html

docs.aws.amazon.com

https://docs.vllm.ai/

docs.vllm.ai

https://aws.amazon.com/blogs/machine-learning/deploying-kimi-k3-on-amazon-sagemaker-hyperpod-and-amazon-eks/

aws.amazon.com

https://d2908q01vomqb2.cloudfront.net/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59/2026/09/09/ML-21725-1.png

d2908q01vomqb2.cloudfront.net

https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod-model-deployment-dpd.html

docs.aws.amazon.com

https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod-model-deployment-data-capture.html

docs.aws.amazon.com

https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod-model-deployment-custom-certs.html

docs.aws.amazon.com

https://recipes.vllm.ai/Qwen/Qwen3.8-2.4T-A95B?hardware=b300&variant=nvfp4&features=tool_calling,reasoning,spec_decoding

recipes.vllm.ai

https://github.com/aws-samples/sagemaker-genai-hosting-examples/tree/main/SageMakerHyperpod/Qwen3.8-2.4T-A95B

github.com

https://d2908q01vomqb2.cloudfront.net/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59/2026/09/09/ML-21725-2.png

d2908q01vomqb2.cloudfront.net

https://docs.vllm.ai/en/stable/features/reasoning_outputs.html

docs.vllm.ai

https://docs.vllm.ai/en/stable/features/speculative_decoding/mtp/

docs.vllm.ai

https://docs.vllm.ai/en/latest/features/tool_calling/

docs.vllm.ai

Serve Qwen3.8-2.4T-A95B, a 2.4T-Parameter Model, with Configurable Reasoning on NVIDIA GB300 NVL72 Read at the source ↗

developer.nvidia.com