corpus.blog
41,948 blogs · 5,239,565 posts Claim your blog
Record · corpus.blog/posts/01a0fda2-402b-708f-9fe5-06863fdec69d

Accelerating Generative AI with PyTorch II: GPT, Fast

PyTorch Blog · published 30 November 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at pytorch.org Wayback capture
2blogs citing
First cited
26 Nov 2024
Most recent
29 May 2026
Rank this month
not ranked
External links
14
Words captured
3,144

Cited by

Blog
In the post
Date
Hugging Face
Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler Read at the source ↗
29 May 2026
njkumar.com
Calculating GPT-2’s inference speedups Read at the source ↗
26 Nov 2024

Links from this post

Link
Host
https://github.com/ggerganov/llama.cpp
github.com
https://github.com/vllm-project/vllm
github.com
https://github.com/mlc-ai/mlc-llm
github.com
https://www.youtube.com/watch?v=IWpM_9AsC-U
youtube.com
https://github.com/pytorch-labs/ao/tree/main
github.com
https://github.com/pytorch-labs/gpt-fast/blob/main/generate.py
github.com
https://github.com/pytorch-labs/gpt-fast/blob/main/tp.py
github.com
https://www.dipkumar.dev/becoming-the-unbeatable/posts/gpt-kvcache/
dipkumar.dev
https://github.com/pytorch-labs/gpt-fast/blob/0afae1ace441ce4c5d02ef11a72da28cf7ca4795/generate.py
github.com
https://github.com/pytorch-labs/gpt-fast/blob/main/quantize.py
github.com
https://arxiv.org/abs/2211.17192
arxiv.org
https://arxiv.org/abs/2210.17323
arxiv.org
https://github.com/pytorch-labs/gpt-fast/blob/main/model.py
github.com
https://github.com/pytorch-labs/gpt-fast
github.com
Elsewhere on pytorch.org (5)