Record · corpus.blog/posts/01a07d5d-6106-7330-a368-9a756fbaa394

Transformers for software engineers

Nelson Elhage · published 1 April 2022

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at blog.nelhage.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 22
Words captured: 6,691

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://arxiv.org/abs/1706.03762

arxiv.org

https://en.wikipedia.org/wiki/GPT-3

en.wikipedia.org

OpenAI Codex Read at the source ↗

openai.com

https://www.deepmind.com/blog/language-modelling-at-scale-gopher-ethical-considerations-and-retrieval

deepmind.com

https://www.anthropic.com/

anthropic.com

Thread: Circuits Read at the source ↗

distill.pub

https://jalammar.github.io/illustrated-transformer/

jalammar.github.io

https://github.com/nelhage/transformer-rs/blob/master/src/lib.rs

github.com

https://arxiv.org/pdf/2005.14165.pdf

arxiv.org

A Mathematical Framework for Transformer Circuits Read at the source ↗

transformer-circuits.pub

https://en.wikipedia.org/wiki/Rectifier_(neural_networks

en.wikipedia.org

https://arxiv.org/abs/1606.08415

arxiv.org

https://github.com/huggingface/transformers

github.com

https://github.com/EleutherAI/gpt-neox

github.com

Exercises Read at the source ↗

transformer-circuits.pub

Rotary Embeddings: A Relative Revolution Read at the source ↗

blog.eleuther.ai

https://arxiv.org/abs/1607.06450

arxiv.org

https://arxiv.org/abs/1910.07467

arxiv.org

https://transformer-circuits.pub/

transformer-circuits.pub

https://colab.research.google.com/

colab.research.google.com

https://sites.research.google/trc/about/

sites.research.google

https://www.lesswrong.com/posts/YDF7XhMThhNfHfim9/ai-safety-needs-great-engineers

lesswrong.com