Record · corpus.blog/posts/01a08219-ddaf-7384-bcb4-f2bfb4da8a91

In-Context Learning and Induction Heads

Transformer Circuits · published 8 March 2022

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at transformer-circuits.pub Wayback capture

13blogs citing

First cited: 7 Jun 2022
Most recent: 11 Sept 2026
Rank this month: not ranked
Links from this post: 1
Words captured: 5,646

Cited by

Blog

In the post

Date

dwarkesh.com

AI researchers debate how close we are to recursive self-improvement Read at the source ↗

11 Sept 2026

fazamhd.com

Large Language Models Read at the source ↗

10 Sept 2026

fazamhd.com

Large Language Models Read at the source ↗

10 Sept 2026

zackproser

The Attention Head Read at the source ↗

19 Jul 2026

tylercrosse.com

Notes on In-Context Learning and Induction Heads Read at the source ↗

12 Jul 2026

tylercrosse.com

Transformer Circuits Thread Notes Read at the source ↗

12 Jul 2026

salmanq.com

Induction Heads: The Circuit Behind In-Context Learning Read at the source ↗

4 May 2026

soniajoseph.ai

Multimodal interpretability in 2024 Read at the source ↗

10 Oct 2024

The Gradient

Mamba Explained Read at the source ↗

28 Mar 2024

kolaayonrinde.com

Mamba Explained Read at the source ↗

11 Feb 2024

kevinbinz.com

Links (June 2023) Read at the source ↗

1 Jul 2023

tomekkorbak.com

Repetition suppression. Details on my inverse scaling prize submission Read at the source ↗

21 Mar 2023

n1o.github.io

Paper overview: Hungry Hungry Hippos: Towards Language Modeling with State Space Models Read at the source ↗

6 Feb 2023

mitchgordon.me

Anecdotes in Language Model Coherence Read at the source ↗

16 Sept 2022

nsaphra.net

Interpretability Creationism Read at the source ↗

7 Jun 2022

Links from this post

Link

Host

A Mathematical Framework for Transformer Circuits Read at the source ↗

transformer-circuits.pub