corpus.blog
42,281 blogs · 5,361,753 posts Claim your blog
Record · corpus.blog/posts/01a0fcf1-cb77-7268-85ba-f4e4570ac391

Quantization-Aware Training for Large Language Models with PyTorch

PyTorch Blog · published 30 July 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at pytorch.org Wayback capture
5blogs citing
First cited
30 Oct 2024
Most recent
5 Jul 2026
Rank this month
not ranked
External links
28
Words captured
2,831

Cited by

Blog
In the post
Date
Redis
Does quantization speed up inference? Read at the source ↗
5 Jul 2026
ternarysearch.blogspot.com
Quantization-Aware Distillation Read at the source ↗
8 Feb 2026
bmin.ai
Four Ingredients for Successful Language Model Retrofitting Read at the source ↗
21 Jan 2026
aaron-ang.github.io
Building an On-Device Automobile Assistant Read at the source ↗
5 Sept 2025
alexzhang13.github.io
A Meticulous Guide to Advances in Deep Learning Efficiency over the Years Read at the source ↗
30 Oct 2024

Links from this post

Link
Host
https://github.com/pytorch/ao/
github.com
https://github.com/pytorch/torchtune/
github.com
https://github.com/google/XNNPACK
github.com
https://github.com/pytorch/executorch/tree/main/examples/models/llama2
github.com
https://github.com/pytorch/ao/blob/v0.3.0/torchao/quantization/prototype/qat.py
github.com
https://github.com/pytorch/torchtune
github.com
https://github.com/pytorch/torchtune/blob/main/recipes/configs/llama3/8B_qat_full.yaml
github.com
https://github.com/pytorch/torchtune/blob/main/recipes/quantization.md
github.com
https://arxiv.org/pdf/1308.3432
arxiv.org
https://cloud.google.com/blog/products/compute/accurate-quantized-training-aqt-for-tpu-v5e
cloud.google.com
https://github.com/pytorch/ao/blob/v0.2.0/torchao/quantization/prototype/qat.py
github.com
https://github.com/pytorch/executorch/blob/main/examples/models/llama2/README.md
github.com
https://arxiv.org/pdf/2305.17888
arxiv.org
https://github.com/pytorch/ao/blob/v0.3.0/torchao/quantization/GPTQ.py
github.com
https://huggingface.co/meta-llama/Llama-2-7b
huggingface.co
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct
huggingface.co
https://huggingface.co/datasets/allenai/c4
huggingface.co
https://github.com/EleutherAI/lm-evaluation-harness
github.com
https://arxiv.org/pdf/1902.08153
arxiv.org
https://arxiv.org/pdf/2306.12929
arxiv.org
https://arxiv.org/pdf/2405.16406
arxiv.org
https://arxiv.org/pdf/2211.10438
arxiv.org
https://www.nvidia.com/en-us/data-center/tensor-cores/
nvidia.com
https://arxiv.org/pdf/2109.12948
arxiv.org
https://github.com/pytorch/pytorch/blob/v2.3.1/aten/src/ATen/native/cuda/int4mm.cu
github.com
https://github.com/NVIDIA/cutlass/pull/1413
github.com
https://github.com/pytorch/ao/issues
github.com
https://github.com/pytorch/ao/pull/383
github.com
Elsewhere on pytorch.org (3)