Record · corpus.blog/posts/01a08219-ddaf-7384-bcb4-f2bfb5b04faf

A Mathematical Framework for Transformer Circuits

Transformer Circuits · published 22 December 2021

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at transformer-circuits.pub Wayback capture

20blogs citing

First cited: 11 Feb 2022
Most recent: 23 Sept 2026
Rank this month: not ranked
Links from this post: 0
Words captured: not extracted

Cited by

Blog

In the post

Date

Modal

How to serve trillions of tokens for trillion-parameter coding agents Read at the source ↗

23 Sept 2026

ccomkhj.github.io

Attention has four matrices, not three Read at the source ↗

2 Aug 2026

fuzzing.science

The Reverse Engineer's Guide to Mechanistic Interpretability Read at the source ↗

30 Jul 2026

zackproser

The Attention Head Read at the source ↗

19 Jul 2026

barmag.github.io

Hunting My Hand-Crafted Induction Head in Real Models Read at the source ↗

17 Jul 2026

tylercrosse.com

Notes on A Mathematical Framework for Transformer Circuits Read at the source ↗

12 Jul 2026

tylercrosse.com

Transformer Circuits Thread Notes Read at the source ↗

12 Jul 2026

salmanq.com

Induction Heads: The Circuit Behind In-Context Learning Read at the source ↗

4 May 2026

blog.thefactoryfactory.com

Explaining AI is a human problem Read at the source ↗

6 Mar 2026

bennycheung.github.io

Hallucinations Aren't Bugs: The Kantian Architecture of AI Consciousness Read at the source ↗

1 Mar 2026

daoudclarke.net

Making LLMs More Efficient With Search Heads Read at the source ↗

23 Feb 2026

Nelson Elhage

Solving regex crosswords with Z3 Read at the source ↗

21 Oct 2025

aiimpacts.org

Towards the Operationalization of Philosophy & Wisdom Read at the source ↗

27 Oct 2024

adamkarvonen.github.io

Manipulating Chess-GPT’s World Model Read at the source ↗

20 Mar 2024

swe-to-mle.pages.dev

Positional Encoding for Self Attention Read at the source ↗

9 Dec 2023

blog.jessriedel.com

Compact precise definition of a transformer function Read at the source ↗

10 Oct 2023

dailynous.com

How to Tell Whether an AI Is Conscious (guest post) Read at the source ↗

1 Sept 2023

erichgrunewald.com

Against LLM Reductionism Read at the source ↗

8 Mar 2023

vkrakovna.wordpress.com

Paradigms of AI alignment: components and enablers Read at the source ↗

2 Jun 2022

Nelson Elhage

Transformers for software engineers Read at the source ↗

1 Apr 2022

neelnanda.io

Post 45: Simplify EA Pitches to “Holy Shit, X-Risk” Read at the source ↗

11 Feb 2022

thegustafson.com

Self-Attention: Q, K, V from First Principles Read at the source ↗

—

thegustafson.com

Multi-Head Attention and Representation Subspaces Read at the source ↗

—

thegustafson.com

Causal Masking and the Autoregressive Constraint Read at the source ↗

—

thegustafson.com

The Feed-Forward Block as Key-Value Memory Read at the source ↗

—

thegustafson.com

Layer Normalization: Pre-Norm, Post-Norm, and RMSNorm Read at the source ↗

—

Links from this post

This post doesn't link to any pages we've captured.