corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a07df2-9525-7060-a08e-3ee5396b07e1

Co-Designing AI Models Using Speculative Decoding for Faster LLM Inference

NVIDIA Developer Blog · published 2 September 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at developer.nvidia.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
10
Words captured
2,713

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
An Introduction to Speculative Decoding for Reducing Latency in AI Inference Read at the source ↗
developer.nvidia.com
AI Model Co-Design: Hardware-Friendly LLM Design Read at the source ↗
developer.nvidia.com
Co-Designing AI Model Attention for Fast, Interactive Long-Context Inference Read at the source ↗
developer.nvidia.com
https://www.nvidia.com/en-us/glossary/mixture-of-experts/
nvidia.com
https://huggingface.co/blog/nvidia/speed-bench
huggingface.co
https://github.com/NVIDIA/TensorRT-LLM
github.com
https://github.com/NVIDIA/Model-Optimizer
github.com
https://github.com/NVIDIA/Model-Optimizer/blob/main/tools/launcher/examples/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16/hf_streaming_dspark_warmstart.yaml
github.com
https://github.com/NVIDIA/Model-Optimizer/blob/main/tools/launcher/examples/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16/hf_dspark_ptq_fp8.yaml
github.com
https://github.com/NVIDIA/Model-Optimizer/blob/main/tools/launcher/examples/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16/hf_dspark_ptq_nvfp4.yaml
github.com