Skip to content
corpus.blog
Sign in Claim your blog
Record · pytorch.org

Distilling Llama3.1 8B into 1B in torchtune

PyTorch Blog · 18 November 2024 · 8 min read

A post on pytorch.org, published 18 November 2024, has not been cited by any blog yet (corpus.blog, measured 10 October 2026).

A record is what was published and who pointed at it. The text of the post is not shown here: read it at the source, or at its Wayback capture.

Read at pytorch.org (opens in a new tab) Wayback capture (opens in a new tab)

0blogs citing

Citing blogs and links by period
Period Blogs Links
All time00
Last 90 days00
Last 30 days00
Last 7 days00
Figures for this page
Words blogs link it with0
External links15
Length1,826

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://arxiv.org/pdf/1503.02531 Who cites this page
arxiv.org
https://arxiv.org/pdf/2306.08543 Who cites this page
arxiv.org
https://arxiv.org/pdf/2402.03898 Who cites this page
arxiv.org
https://arxiv.org/pdf/2404.02657 Who cites this page
arxiv.org
https://arxiv.org/pdf/2306.13649 Who cites this page
arxiv.org
https://en.wikipedia.org/wiki/Kullback%E2%80%93Leibler_divergence Who cites this page
en.wikipedia.org
Llama 3.2: Revolutionizing edge AI and vision with open, customizable models Read at ai.meta.com (opens in a new tab)
ai.meta.com
https://github.com/pytorch/torchtune/blob/4234b78b914af23384ce0348f564e2119d107a96/recipes/knowledge_distillation_single_device.py Who cites this page
github.com
https://github.com/pytorch/torchtune/blob/09c2619f713e771b4159f7b83bac8971c7053bd3/recipes/knowledge_distillation_distributed.py Who cites this page
github.com
https://github.com/EleutherAI/lm-evaluation-harness/tree/feff1b55c57993c4d42c8f913a22eeec395cd690/lm_eval/tasks/truthfulqa Who cites this page
github.com
https://github.com/EleutherAI/lm-evaluation-harness/tree/517aadc/lm_eval/tasks/hellaswagd Who cites this page
github.com
https://github.com/EleutherAI/lm-evaluation-harness/tree/b62b9bd/lm_eval/tasks/commonsense_qa Who cites this page
github.com
https://github.com/EleutherAI/lm-evaluation-harness/tree/main Who cites this page
github.com
https://arxiv.org/pdf/2402.12030 Who cites this page
arxiv.org
https://arxiv.org/pdf/2404.05961 Who cites this page
arxiv.org
Elsewhere on pytorch.org (1)

Something wrong here? Report a problem