corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a07df3-b802-7088-8ae7-35a1a9fa121f

Transformer Taxonomy (the last lit review)

kipply · published 30 March 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at kipp.ly Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
80
Words captured
3,569

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://arxiv.org/pdf/2005.14165.pdf
arxiv.org
https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
d4mucfpksywv.cloudfront.net
https://arxiv.org/pdf/2001.08361.pdf
arxiv.org
https://arxiv.org/pdf/1706.03762.pdf
arxiv.org
https://arxiv.org/pdf/2303.08774.pdf
arxiv.org
https://arxiv.org/pdf/2112.11446.pdf
arxiv.org
https://arxiv.org/pdf/2203.07814.pdf
arxiv.org
https://arxiv.org/pdf/2112.04426.pdf
arxiv.org
https://beta.openai.com/docs/model-index-for-researchers
beta.openai.com
https://arxiv.org/pdf/2203.15556.pdf
arxiv.org
https://arxiv.org/pdf/2201.11990.pdf
arxiv.org
https://uploads-ssl.webflow.com/60fd4503684b466578c0d307/61138924626a6981ee09caf6_jurassic_tech_paper.pdf
uploads-ssl.webflow.com
https://arxiv.org/pdf/2204.14198.pdf
arxiv.org
https://arxiv.org/pdf/2209.06794.pdf
arxiv.org
https://arxiv.org/pdf/2205.06175.pdf
arxiv.org
https://arxiv.org/pdf/2112.00861.pdf
arxiv.org
https://arxiv.org/pdf/2207.05221.pdf
arxiv.org
https://arxiv.org/pdf/2302.07459.pdf
arxiv.org
https://arxiv.org/pdf/2204.02311.pdf
arxiv.org
https://github.com/EleutherAI/gpt-neox
github.com
https://arxiv.org/pdf/2204.06745.pdf
arxiv.org
https://www.deepspeed.ai/
deepspeed.ai
https://github.com/NVIDIA/Megatron-LM
github.com
https://github.com/kingoflolz/mesh-transformer-jax/
github.com
https://pile.eleuther.ai/
pile.eleuther.ai
https://arxiv.org/pdf/2112.06905.pdf
arxiv.org
https://arxiv.org/pdf/2201.08239.pdf
arxiv.org
https://arxiv.org/pdf/2001.09977.pdf
arxiv.org
https://arxiv.org/pdf/2101.03961.pdf
arxiv.org
https://arxiv.org/pdf/2211.05100.pdf
arxiv.org
https://arxiv.org/pdf/2211.09085.pdf
arxiv.org
https://scontent-sjc3-1.xx.fbcdn.net/v/t39.8562-6/333078981_693988129081760_4712707815225756708_n.pdf?_nc_cat=108&ccb=1-7&_nc_sid=ad8a9d&_nc_ohc=ov6yTHfLfNQAX82vXIA&_nc_ht=scontent-sjc3-1.xx&oh=00_AfAg4KoJmp5lBEyThQ9XAh24xKRPZ-wVH1UWh4euhxSy8w&oe=63FFCFA2
scontent-sjc3-1.xx.fbcdn.net
https://crfm.stanford.edu/helm/latest
crfm.stanford.edu
https://arxiv.org/pdf/2205.01068.pdf
arxiv.org
https://github.com/facebookresearch/metaseq/blob/main/projects/OPT/chronicles/OPT175B_Logbook.pdf
github.com
https://arxiv.org/pdf/2210.02414.pdf
arxiv.org
https://arxiv.org/pdf/1911.02150.pdf
arxiv.org
https://arxiv.org/pdf/1904.10509.pdf
arxiv.org
https://arxiv.org/abs/1701.06538
arxiv.org
https://arxiv.org/pdf/2202.01169.pdf
arxiv.org
https://arxiv.org/pdf/2112.10684.pdf
arxiv.org
https://arxiv.org/pdf/2202.08906.pdf
arxiv.org
https://arxiv.org/pdf/2202.09368.pdf
arxiv.org
https://arxiv.org/pdf/2205.10937.pdf
arxiv.org
https://openreview.net/pdf?id=23ZjUGpjcc
openreview.net
https://arxiv.org/pdf/2205.14135.pdf
arxiv.org
https://arxiv.org/pdf/2112.05682.pdf
arxiv.org
https://arxiv.org/pdf/1910.10683.pdf
arxiv.org
Softmax Linear Units Read at the source ↗
transformer-circuits.pub
https://arxiv.org/pdf/2002.05202.pdf
arxiv.org
https://arxiv.org/pdf/2203.00555.pdf
arxiv.org
https://arxiv.org/pdf/1910.07467.pdf
arxiv.org
https://arxiv.org/pdf/2104.09864.pdf
arxiv.org
Rotary Embeddings: A Relative Revolution Read at the source ↗
blog.eleuther.ai
https://huggingface.co/course/chapter6/5?fw=pt
huggingface.co
https://github.com/google/sentencepiece
github.com
https://arxiv.org/pdf/2108.12409.pdf
arxiv.org
https://arxiv.org/pdf/1707.06347.pdf
arxiv.org
https://arxiv.org/pdf/2209.14375.pdf
arxiv.org
https://arxiv.org/pdf/2112.09332.pdf
arxiv.org
https://storage.googleapis.com/deepmind-media/Teaching%20language%20models%20to%20support%20answers%20with%20verified%20quotes/Teaching%20language%20models%20to%20support%20answers%20with%20verified%20quotes.pdf
storage.googleapis.com
https://proceedings.neurips.cc/paper/2017/hash/d5e2c0adad503c91f91df240d0cd4e49-Abstract.html
proceedings.neurips.cc
https://proceedings.neurips.cc/paper/2020/file/1f89885d556929e98d3ef9b86448f951-Paper.pdf
proceedings.neurips.cc
https://arxiv.org/pdf/2212.08073.pdf
arxiv.org
https://arxiv.org/pdf/2206.14858.pdf
arxiv.org
https://arxiv.org/pdf/2107.03374.pdf
arxiv.org
https://arxiv.org/pdf/2203.02155.pdf
arxiv.org
https://arxiv.org/abs/1909.08593
arxiv.org
https://arxiv.org/pdf/2109.01652.pdf
arxiv.org
Does batch size matter? Read at the source ↗
blog.janestreet.com
https://arxiv.org/pdf/2302.08582.pdf
arxiv.org
https://arxiv.org/pdf/2203.03466.pdf
arxiv.org
https://arxiv.org/pdf/2201.11903.pdf
arxiv.org
https://arxiv.org/pdf/2102.07350.pdf
arxiv.org
https://proceedings.mlr.press/v70/shi17a.html
proceedings.mlr.press
https://arxiv.org/pdf/2202.08137.pdf
arxiv.org
https://arxiv.org/pdf/2302.04761.pdf
arxiv.org
https://arxiv.org/pdf/2207.14255.pdf
arxiv.org
https://arxiv.org/pdf/1904.09751.pdf
arxiv.org
https://www.trentonbricken.com/Tail-Free-Sampling/
trentonbricken.com