corpus.blog
41,715 blogs · 5,239,565 posts Claim your blog
Record · corpus.blog/posts/01a08723-5559-72a3-b5a7-b1e4dc35790b

Learn transformers

gordicaleksa.medium.com · published 7 February 2021

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at gordicaleksa.medium.com Wayback capture
1blogs citing
First cited
7 Feb 2021
Most recent
23 May 2021
Rank this month
not ranked
External links
91
Words captured
5,248

Cited by

Blog
In the post
Date
aleksagordic.com
Learn RL Read at the source ↗
23 May 2021
aleksagordic.com
Learn Geometric ML Read at the source ↗
7 Feb 2021

Links from this post

Link
Host
https://www.youtube.com/watch?v=S78LQebx6jo&list=PLBoQnSflObcmbfshq9oNs41vODgXG-608&ab_channel=TheAIEpiphany
youtube.com
https://github.com/gordicaleksa/pytorch-neural-style-transfer
github.com
https://github.com/gordicaleksa/pytorch-neural-style-transfer-fast
github.com
https://github.com/gordicaleksa/pytorch-naive-video-neural-style-transfer
github.com
https://github.com/gordicaleksa/pytorch-deepdream
github.com
Nvidia releases StyleGAN2, state-of-the-art generative image modeling
github.com
https://arxiv.org/abs/1703.06868
arxiv.org
https://github.com/gordicaleksa/pytorch-gans
github.com
https://github.com/gordicaleksa/pytorch-original-transformer
github.com
https://arxiv.org/abs/2010.11929
arxiv.org
https://arxiv.org/abs/1706.03762
arxiv.org
https://unsplash.com/@ricardoviana?utm_source=medium&utm_medium=referral
unsplash.com
Unsplash Read at the source ↗
unsplash.com
https://unsplash.com/@markusspiske?utm_source=medium&utm_medium=referral
unsplash.com
https://jalammar.github.io/visualizing-neural-machine-translation-mechanics-of-seq2seq-models-with-attention
jalammar.github.io
https://medium.com/@shashank7.iitd/understanding-attention-mechanism-35ff53fc328e
medium.com
https://towardsdatascience.com/attn-illustrated-attention-5ec4ad276ee3
towardsdatascience.com
https://medium.com/@Alibaba_Cloud/self-attention-mechanisms-in-natural-language-processing-9f28315ff905
medium.com
https://towardsdatascience.com/illustrated-self-attention-2d627e33b20a
towardsdatascience.com
https://arxiv.org/abs/1409.0473
arxiv.org
https://arxiv.org/abs/1508.04025
arxiv.org
https://unsplash.com/@maxdelsid?utm_source=medium&utm_medium=referral
unsplash.com
http://web.stanford.edu/class/cs224n/slides/cs224n-2019-lecture12-subwords.pdf
web.stanford.edu
https://unsplash.com/@amandagraphc?utm_source=medium&utm_medium=referral
unsplash.com
https://jalammar.github.io/illustrated-word2vec/
jalammar.github.io
https://machinelearningmastery.com/what-are-word-embeddings/
machinelearningmastery.com
https://arxiv.org/pdf/1301.3781.pdf
arxiv.org
https://papers.nips.cc/paper/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf
papers.nips.cc
https://nlp.stanford.edu/pubs/glove.pdf
nlp.stanford.edu
https://www.jmlr.org/papers/volume3/bengio03a/bengio03a.pdf
jmlr.org
https://arxiv.org/abs/1708.00107
arxiv.org
https://arxiv.org/abs/1802.05365
arxiv.org
https://techcrunch.com/2018/06/15/machines-learn-language-better-by-using-a-deep-understanding-of-words/
techcrunch.com
https://arxiv.org/abs/1801.06146
arxiv.org
https://arxiv.org/abs/1511.01432
arxiv.org
http://newsletter.ruder.io/
newsletter.ruder.io
https://unsplash.com/@roblaughter?utm_source=medium&utm_medium=referral
unsplash.com
https://jalammar.github.io/illustrated-transformer/
jalammar.github.io
https://www.youtube.com/watch?v=rURRYI66E54&ab_channel=Computerphile
youtube.com
https://www.youtube.com/watch?v=TQQlZhbC5ps&ab_channel=CodeEmporium
youtube.com
https://www.youtube.com/watch?v=4Bdc55j80l8&ab_channel=TheA.I.Hacker-MichaelPhi
youtube.com
https://www.youtube.com/watch?v=iDulhoQ2pro&ab_channel=YannicKilcher
youtube.com
https://lilianweng.github.io/lil-log/2018/06/24/attention-attention.html
lilianweng.github.io
https://jalammar.github.io/illustrated-bert/
jalammar.github.io
https://ai.googleblog.com/2018/11/open-sourcing-bert-state-of-art-pre.html
ai.googleblog.com
https://www.blog.google/products/search/search-language-understanding-bert/
blog.google
https://www.youtube.com/watch?v=xI0HHN5XKDo&ab_channel=CodeEmporium
youtube.com
https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
s3-us-west-2.amazonaws.com
https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
d4mucfpksywv.cloudfront.net
https://arxiv.org/abs/2005.14165
arxiv.org
https://www.youtube.com/watch?v=SY5PvZrJhLE&ab_channel=YannicKilcher
youtube.com
http://jalammar.github.io/illustrated-gpt2/
jalammar.github.io
How GPT3 Works - Visualizations and Animations Read at the source ↗
jalammar.github.io
https://openai.com/blog/language-unsupervised/
openai.com
https://openai.com/blog/better-language-models/
openai.com
https://openai.com/blog/ai-and-compute/
openai.com
https://openai.com/blog/preparing-for-malicious-uses-of-ai/
openai.com
http://www.incompleteideas.net/IncIdeas/BitterLesson.html
incompleteideas.net
https://www.theverge.com/21346343/gpt-3-explainer-openai-examples-errors-agi-potential
theverge.com
https://pagestlabs.substack.com/p/gpt-3-and-a-typology-of-hype
pagestlabs.substack.com
https://minimaxir.com/2020/07/gpt3-expectations/
minimaxir.com
Giving GPT-3 a Turing test Read at the source ↗
lacker.io
https://play.aidungeon.io/
play.aidungeon.io
https://app.inferkit.com/demo
app.inferkit.com
https://transformer.huggingface.co/
transformer.huggingface.co
https://www.tabnine.com/blog/deep/
tabnine.com
https://unsplash.com/@monti3l?utm_source=medium&utm_medium=referral
unsplash.com
https://medium.com/@Moscow25/the-best-deep-natural-language-papers-you-should-read-bert-gpt-2-and-looking-forward-1647f4438797
medium.com
https://medium.com/huggingface/encoder-decoders-in-transformers-a-hybrid-pre-trained-architecture-for-seq2seq-af4d7bf14bb8
medium.com
https://arxiv.org/abs/1901.02860
arxiv.org
https://arxiv.org/abs/1906.08237
arxiv.org
https://arxiv.org/abs/1907.11692
arxiv.org
https://arxiv.org/abs/1909.11942
arxiv.org
https://arxiv.org/abs/1910.10683
arxiv.org
https://arxiv.org/abs/1905.03197
arxiv.org
https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html
ai.googleblog.com
https://arxiv.org/abs/1904.10509
arxiv.org
https://arxiv.org/pdf/2004.05150
arxiv.org
https://arxiv.org/abs/2001.04451
arxiv.org
https://ai.googleblog.com/2020/01/reformer-efficient-transformer.html
ai.googleblog.com
https://towardsdatascience.com/illustrating-the-reformer-393575ac6ba0
towardsdatascience.com
https://colab.research.google.com/github/patrickvonplaten/blog/blob/master/notebooks/03_reformer.ipynb
colab.research.google.com
https://arxiv.org/abs/2006.04768
arxiv.org
https://github.com/huggingface/blog/blob/master/notebooks/02_how_to_generate.ipynb
github.com
https://github.com/gordicaleksa/pytorch-original-transformer/blob/main/The%20Annotated%20Transformer%20%2B%2B.ipynb
github.com
https://huggingface.co/transformers/notebooks.html
huggingface.co
https://github.com/huggingface/transformers/blob/master/notebooks/03-pipelines.ipynb
github.com
https://unsplash.com/@jakehills?utm_source=medium&utm_medium=referral
unsplash.com
https://medium.com/@gordicaleksa/get-started-with-ai-and-machine-learning-in-3-months-5236d5e0f230
medium.com
https://colah.github.io/posts/2020-05-University/
colah.github.io
https://blog.floydhub.com/tokenization-nlp/
blog.floydhub.com