corpus.blog
43,029 blogs · 5,458,805 posts Claim your blog
Record · corpus.blog/posts/01a0877c-88ad-7297-9aef-de738d391919

Transformers in Natural Language Processing — A Brief Survey

Hello! I’m George (a.k.a. eigenfoo) | George Ho · published 23 May 2020

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at georgeho.org Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
30
Words captured
2,122

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://www.tensorflow.org/images/linear-relationships.png
tensorflow.org
http://arxiv.org/abs/1301.3781
arxiv.org
http://arxiv.org/abs/1310.4546
arxiv.org
https://nlp.stanford.edu/projects/glove/
nlp.stanford.edu
https://allennlp.org/elmo
allennlp.org
https://arxiv.org/abs/1708.02709
arxiv.org
https://medium.com/dair-ai/deep-learning-for-nlp-an-overview-of-recent-trends-d0d8f40a776d
medium.com
https://i.pinimg.com/originals/02/95/a3/0295a3be438ae68f604e53fc88c7edb4.png
i.pinimg.com
https://arxiv.org/pdf/1706.03762.pdf
arxiv.org
https://jalammar.github.io/illustrated-transformer/
jalammar.github.io
http://nlp.seas.harvard.edu/2018/04/03/attention.html
nlp.seas.harvard.edu
https://arxiv.org/pdf/1801.06146.pdf
arxiv.org
https://www.theverge.com/2019/2/14/18224704/ai-machine-learning-language-models-read-write-openai-gpt2
theverge.com
https://www.theverge.com/2019/11/7/20953040/openai-text-generation-ai-gpt-2-full-model-release-1-5b-parameters
theverge.com
https://openai.com/blog/language-unsupervised/
openai.com
https://openai.com/blog/better-language-models/
openai.com
http://jalammar.github.io/illustrated-gpt2/
jalammar.github.io
https://arxiv.org/pdf/1810.04805.pdf
arxiv.org
https://ai.googleblog.com/2018/11/open-sourcing-bert-state-of-art-pre.html
ai.googleblog.com
https://jalammar.github.io/illustrated-bert/
jalammar.github.io
https://arxiv.org/abs/1907.11692
arxiv.org
https://ai.facebook.com/blog/roberta-an-optimized-method-for-pretraining-self-supervised-nlp-systems/
ai.facebook.com
https://arxiv.org/pdf/1910.10683.pdf
arxiv.org
https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html
ai.googleblog.com
https://huggingface.co/transformers/bertology.html
huggingface.co
https://thegradient.pub/nlp-imagenet/
thegradient.pub
https://huggingface.co/transformers/summary.html
huggingface.co
https://github.com/huggingface/awesome-papers
github.com
https://ai.googleblog.com/2020/01/reformer-efficient-transformer.html
ai.googleblog.com
https://arxiv.org/abs/2005.14165
arxiv.org
Elsewhere on georgeho.org (1)