corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a087d2-ab50-7138-adc7-cde6ad50ee82

Decoder-only Language Models Architecture Evolution (Part I)

reinforcedknowledge.com · published 30 May 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at reinforcedknowledge.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
19
Words captured
5,443

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://arxiv.org/abs/1706.03762
arxiv.org
https://reinforcedknowledge.com/transformers-attention-is-all-you-need/
reinforcedknowledge.com
https://www.semanticscholar.org/paper/Improving-Language-Understanding-by-Generative-Radford-Narasimhan/cd18800a0fe0b668a1cc19f2ec95b5003d0a5035
semanticscholar.org
https://arxiv.org/abs/1312.6114v10
arxiv.org
https://arxiv.org/abs/1406.2661
arxiv.org
https://arxiv.org/abs/2006.11239
arxiv.org
https://www.semanticscholar.org/paper/Why-Does-Unsupervised-Pre-training-Help-Deep-Erhan-Courville/0d2336389dff3031910bd21dd1c44d1b4cd51725
semanticscholar.org
https://www.semanticscholar.org/paper/Language-Models-are-Unsupervised-Multitask-Learners-Radford-Wu/9405cc0d6169988371b2755e573cc28650d14dfe
semanticscholar.org
https://github.com/openai/gpt-2/blob/master/src/model.py
github.com
https://arxiv.org/abs/1603.05027
arxiv.org
https://www.semanticscholar.org/paper/Language-Models-are-Few-Shot-Learners-Brown-Mann/90abbc2cf38462b954ae1b772fac9532e2ccd8b0
semanticscholar.org
https://arxiv.org/abs/1901.11373
arxiv.org
https://arxiv.org/abs/1902.01007
arxiv.org
https://commoncrawl.org/overview
commoncrawl.org
https://en.wikipedia.org/wiki/MinHash
en.wikipedia.org
https://en.wikipedia.org/wiki/Locality-sensitive_hashing
en.wikipedia.org
https://arxiv.org/abs/1904.10509
arxiv.org
https://reinforcedknowledge.com/sparse-transformers/
reinforcedknowledge.com
https://arxiv.org/abs/1812.06162
arxiv.org