corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a08784-a37a-718e-8ddc-ed9fc4953edf

Attention has four matrices, not three

ccomkhj.github.io · published 2 August 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at ccomkhj.github.io Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
11
Words captured
2,680

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://arxiv.org/abs/1706.03762
arxiv.org
A Mathematical Framework for Transformer Circuits Read at the source ↗
transformer-circuits.pub
https://arxiv.org/abs/1911.02150
arxiv.org
https://aclanthology.org/2023.emnlp-main.298/
aclanthology.org
https://arxiv.org/abs/2307.09288
arxiv.org
https://aclanthology.org/P19-1580/
aclanthology.org
https://proceedings.neurips.cc/paper_files/paper/2019/file/2c601ad9d2ff9bc8b282670cdd54f69f-Paper.pdf
proceedings.neurips.cc
https://aclanthology.org/N19-1357/
aclanthology.org
https://aclanthology.org/D19-1002/
aclanthology.org
https://arxiv.org/abs/2309.17453
arxiv.org
https://www.3blue1brown.com/lessons/attention/
3blue1brown.com