Record · corpus.blog/posts/01a0c52f-7eea-7166-a29a-ff1b08a07b16

Pruning and Distilling LLMs Using NVIDIA TensorRT Model Optimizer

NVIDIA Developer Blog · published 7 October 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at developer.nvidia.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 20
Words captured: 2,174

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://www.nvidia.com/en-us/glossary/large-language-models/

nvidia.com

How Small Language Models Are Key to Scalable Agentic AI Read at the source ↗

developer.nvidia.com

https://arxiv.org/pdf/2407.14679

arxiv.org

https://github.com/NVIDIA/TensorRT-Model-Optimizer

github.com

https://arxiv.org/pdf/2408.11796

arxiv.org

https://en.wikipedia.org/wiki/Kullback%E2%80%93Leibler_divergence

en.wikipedia.org

https://github.com/NVIDIA-NeMo/NeMo/tree/main/tutorials/llm/qwen/pruning-distillation

github.com

https://github.com/NVIDIA-NeMo/NeMo/blob/main/tutorials/llm/qwen/pruning-distillation/01_model_and_data_preparation.ipynb

github.com

https://docs.nvidia.com/nemo-framework/index.html

docs.nvidia.com

http://nvcr.io/nvidia/nemo:25.09

nvcr.io

https://github.com/NVIDIA-NeMo/NeMo/blob/main/tutorials/llm/qwen/pruning-distillation/03_distillation.ipynb

github.com

https://github.com/NVIDIA-NeMo/NeMo/blob/main/tutorials/llm/qwen/pruning-distillation/02_pruning.ipynb

github.com

https://docs.nvidia.com/nemo-framework/user-guide/latest/model-optimization/distillation/distillation.html

docs.nvidia.com

https://huggingface.co/datasets/OptimalScale/ClimbMix

huggingface.co

https://huggingface.co/datasets/nvidia/ClimbMix

huggingface.co

https://github.com/NVIDIA/TensorRT-Model-Optimizer/tree/main/examples/pruning

github.com

https://github.com/NVIDIA/TensorRT-Model-Optimizer/tree/main/examples/llm_distill

github.com

Optimizing LLMs for Performance and Accuracy with Post-Training Quantization Read at the source ↗

developer.nvidia.com

How Quantization Aware Training Enables Low-Precision Accuracy Recovery Read at the source ↗

developer.nvidia.com

An Introduction to Speculative Decoding for Reducing Latency in AI Inference Read at the source ↗

developer.nvidia.com