corpus.blog
41,554 blogs · 4,654,352 posts Claim your blog
Record · corpus.blog/posts/01a087c0-1e67-71fd-9c84-06d765e983d1

Transformers from scratch

peterbloem.nl · published 1 September 2019

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at peterbloem.nl Wayback capture
6blogs citing
First cited
13 Oct 2018
Most recent
30 Oct 2025
Rank this month
not ranked
External links
27
Words captured
7,641

Cited by

Blog
In the post
Date
fvictorio.github.io
An underqualified reading list about the transformer architecture Read at the source ↗
30 Oct 2025
asun9.com
Machine Learning Jargon Read at the source ↗
4 Mar 2024
Home
Data Science Has a Variable Naming Problem Read at the source ↗
9 Nov 2023
AdilZtn
Masking in Deep Reinforcement Learning Read at the source ↗
31 Oct 2020
Sean's Blog
Natural Language Processing: Sentiment Analysis Read at the source ↗
13 Oct 2018
Max Halford
Links Read at the source ↗
—

Links from this post

Link
Host
https://codeberg.org/pbm/former
codeberg.org
https://dlvu.github.io/sa/
dlvu.github.io
https://mlvu.github.io/lecture06/
mlvu.github.io
https://mlvu.github.io/lecture07/
mlvu.github.io
https://pytorch.org/tutorials/beginner/deep_learning_60min_blitz.html
pytorch.org
https://github.com/pbloem/former/blob/b438731ceeaf6c468f8b961bb07c2adde3b54a9f/former/modules.py
github.com
https://github.com/pbloem/former/blob/master/experiments/classify.py
github.com
http://karpathy.github.io/2015/05/21/rnn-effectiveness/
karpathy.github.io
http://prize.hutter1.net/
prize.hutter1.net
https://towardsdatascience.com/how-to-sample-from-language-models-682bceb97277
towardsdatascience.com
https://openai.com/blog/better-language-models/
openai.com
Linklog | Understanding LSTM Networks Read at the source ↗
colah.github.io
https://arxiv.org/abs/1706.03762
arxiv.org
https://blog.keras.io/a-ten-minute-introduction-to-sequence-to-sequence-learning-in-keras.html
blog.keras.io
https://arxiv.org/abs/1810.04805
arxiv.org
https://www.bbc.com/news/technology-47249163
bbc.com
https://arxiv.org/abs/1901.02860
arxiv.org
https://openai.com/blog/sparse-transformer/
openai.com
https://github.com/NVIDIA/apex
github.com
https://pytorch.org/docs/stable/checkpoint.html
pytorch.org
https://medium.com/huggingface/training-larger-batches-practical-tips-on-1-gpu-multi-gpu-distributed-setups-ec88c3e51255
medium.com
http://jalammar.github.io/illustrated-transformer/
jalammar.github.io
http://nlp.seas.harvard.edu/2018/04/03/attention.html
nlp.seas.harvard.edu
https://content.iospress.com/articles/data-science/ds007
content.iospress.com
https://datajobs.com/data-science-repo/Recommender-Systems-[Netflix].pdf
datajobs.com
https://github.com/sidneyaraujomelo
github.com
https://github.com/pbloem/former/issues/8
github.com