Skip to content
corpus.blog
Sign in Claim your blog
Record · cameronrwolfe.substack.com

Decoder-Only Transformers: The Workhorse of Generative LLMs

cameronrwolfe.substack.com · 4 March 2024 · 36 min read

A post on cameronrwolfe.substack.com, published 4 March 2024, is cited by 2 distinct blogs to date (corpus.blog, measured 13 October 2026).

A record is what was published and who pointed at it. The text of the post is not shown here: read it at the source, or at its Wayback capture.

Read at cameronrwolfe.substack.com (opens in a new tab) Wayback capture (opens in a new tab)

2blogs citing

Citing blogs and links by period
Period Blogs Links
All time22
Last 90 days00
Last 30 days00
Last 7 days00
Figures for this page
First cited8 Feb 2025
Latest citation16 Jul 2025
Words blogs link it with2
External links37
Length8,187

Words blogs link it with

The words blogs link this page with, by how many different blogs use them.

  • decoder-only1 blog
  • deep (learning) focus1 blog

Cited by 2 blogs in 2 posts

One row per blog, the most recently citing first. Each shows the blog's newest citing post; open a row for the others.

Blog
Newest citing post
Date
Vicki Boykis1 post
My favorite use-case for AI is writing logs

linked as “decoder-only”

Read at vickiboykis.com (opens in a new tab)
16 Jul 2025
blog.sshh.io1 post
How to Backdoor Large Language Models

linked as “Deep (Learning) Focus”

Read at blog.sshh.io (opens in a new tab)
8 Feb 2025

Links from this post

Link
Host
https://www.interconnects.ai/p/model-merging Read at interconnects.ai (opens in a new tab)
interconnects.ai
https://pytorch.org/tutorials/beginner/basics/tensorqs_tutorial.html Who cites this page
pytorch.org
http://en.wikipedia.org/wiki/Dot_product Who cites this page
en.wikipedia.org
https://en.wikipedia.org/wiki/Softmax_function Who cites this page
en.wikipedia.org
https://github.co/hiddenchars Who cites this page
github.co
https://en.wikipedia.org/wiki/Transpose Who cites this page
en.wikipedia.org
https://www.nvidia.com/en-us/data-center/h200/ Who cites this page
nvidia.com
http://neuralnetworksanddeeplearning.com/chap5.html Who cites this page
neuralnetworksanddeeplearning.com
https://www.geeksforgeeks.org/xavier-initialization/ Who cites this page
geeksforgeeks.org
https://www.geeksforgeeks.org/kaiming-initialization-in-deep-learning/ Who cites this page
geeksforgeeks.org
https://pytorch.org/docs/stable/generated/torch.nn.Sigmoid.html Who cites this page
pytorch.org
ReLU Read at pytorch.org (opens in a new tab)
pytorch.org
LayerNorm Read at pytorch.org (opens in a new tab)
pytorch.org
https://pytorch.org/docs/stable/generated/torch.nn.functional.layer_norm.html Who cites this page
pytorch.org
GELU Read at pytorch.org (opens in a new tab)
pytorch.org
Linear Read at pytorch.org (opens in a new tab)
pytorch.org
https://pytorch.org/docs/stable/generated/torch.bmm.html Who cites this page
pytorch.org
https://arxiv.org/abs/1512.03385 Who cites this page
arxiv.org
https://huggingface.co/docs/transformers/en/tokenizer_summary?ref=cybernetist.com Who cites this page
huggingface.co
https://karpathy.ai/ Who cites this page
karpathy.ai
https://www.youtube.com/watch?v=zduSFxRajkE Who cites this page
youtube.com
Embedding Read at pytorch.org (opens in a new tab)
pytorch.org
CrossEntropyLoss Read at pytorch.org (opens in a new tab)
pytorch.org
https://github.com/bzhangGo/rmsnorm Who cites this page
github.com
https://docs.mosaicml.com/projects/composer/en/latest/method_cards/low_precision_layernorm.html
docs.mosaicml.com
https://arxiv.org/abs/2001.04451 Who cites this page
arxiv.org
https://arxiv.org/abs/2010.05315 Who cites this page
arxiv.org
https://arxiv.org/abs/2009.14794 Who cites this page
arxiv.org
Shreyansh Singh | Paper Summary #8 - FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness Read at shreyansh26.github.io (opens in a new tab)
shreyansh26.github.io
Accelerated PyTorch 2 Transformers Read at pytorch.org (opens in a new tab)
pytorch.org
https://arxiv.org/abs/2307.08691 Who cites this page
arxiv.org
Flash-Decoding for long-context inference Read at pytorch.org (opens in a new tab)
pytorch.org
Relative Positional Encoding Read at jaketae.github.io (opens in a new tab)
jaketae.github.io
http://en.wikipedia.org/wiki/Rotation_matrix Who cites this page
en.wikipedia.org
https://huggingface.co/mosaicml/mpt-7b-storywriter Who cites this page
huggingface.co
https://medium.com/@wolfecameron
medium.com
https://storage.googleapis.com/deepmind-media/gemini/gemini_1_report.pdf Who cites this page
storage.googleapis.com
Elsewhere on cameronrwolfe.substack.com (4)

Something wrong here? Report a problem