corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a0879d-aa2a-717c-a18f-4d65a4889c9d

Understanding Transformer

luozhu.io · published 29 September 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at luozhu.io Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
49
Words captured
6,257

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
The Future of Humanity Read at the source ↗
luozhu.io
https://l2beat.com/scaling/summary
l2beat.com
https://en.wikipedia.org/wiki/Normandy_landings
en.wikipedia.org
https://vitalik.eth.limo/general/2024/01/30/cryptoai.html
vitalik.eth.limo
https://x.com/brian_armstrong/status/1829623778726592804
x.com
https://x.com/AISafetyMemes/status/1825742113121906918
x.com
https://github.com/LuozhuZhang
github.com
https://x.ai/blog/grok-2
x.ai
https://ai.meta.com/blog/meta-llama-3-1/
ai.meta.com
https://blog.google/products/gemini/
blog.google
https://www.anthropic.com/news/claude-3-family
anthropic.com
https://arxiv.org/abs/1706.03762
arxiv.org
https://aclanthology.org/D14-1179/
aclanthology.org
https://www.sciencedirect.com/topics/computer-science/long-distance-dependency?__cf_chl_tk=8ZX5kb.TLC2rAXdXSnwc6xUHT3ehQUEyoTCkyEuRAeY-1727438102-0.0.1.1-7721
sciencedirect.com
https://en.wikipedia.org/wiki/BLEU
en.wikipedia.org
https://arxiv.org/abs/1810.04805
arxiv.org
Improving language understanding with unsupervised learning Read at the source ↗
openai.com
GPT-3 powers the next generation of apps Read at the source ↗
openai.com
https://arxiv.org/abs/2010.11929
arxiv.org
https://arxiv.org/abs/1809.08895
arxiv.org
https://arxiv.org/abs/2102.05095
arxiv.org
https://github.com/LuozhuZhang/transformer-implementation/blob/main/encoder/imdb/training.py
github.com
https://huggingface.co/datasets/stanfordnlp/imdb
huggingface.co
https://en.wikipedia.org/wiki/Autoregressive_model
en.wikipedia.org
https://github.com/LuozhuZhang/transformer-implementation/blob/main/decoder/gpt/gpt.py
github.com
https://github.com/LuozhuZhang/transformer-implementation/blob/main/encoder_decoder/translator.py
github.com
https://en.wikipedia.org/wiki/Chinese_room
en.wikipedia.org
https://en.wikipedia.org/wiki/Euclidean_vector
en.wikipedia.org
https://github.com/pytorch/pytorch
github.com
https://github.com/tensorflow/tensorflow
github.com
https://huggingface.co/docs/transformers/main/en/tokenizer_summary
huggingface.co
https://en.wikipedia.org/wiki/Byte_pair_encoding
en.wikipedia.org
https://github.com/meta-llama/llama3/blob/main/llama/tokenizer.py
github.com
https://github.com/LuozhuZhang/transformer-implementation/blob/main/encoder/tf/tokenization/test.py
github.com
https://github.com/LuozhuZhang/transformer-implementation/blob/main/encoder/tf/tokenization/try.py
github.com
https://github.com/openai/gpt-3
github.com
https://en.wikipedia.org/wiki/Recurrent_neural_network
en.wikipedia.org
https://en.wikipedia.org/wiki/Scale_factor_(computer_science
en.wikipedia.org
https://luozhu.io/images/transformer/tf-18.png
luozhu.io
https://github.com/LuozhuZhang/transformer-implementation/blob/main/embedding/positional_embedding.py
github.com
https://github.com/LuozhuZhang/transformer-implementation/blob/main/embedding/input_embedding.py
github.com
https://en.wikipedia.org/wiki/Feedforward_neural_network
en.wikipedia.org
https://en.wikipedia.org/wiki/Rectifier_(neural_networks
en.wikipedia.org
https://www.youtube.com/watch?v=Gey9CG6R6w8
youtube.com
https://en.wikipedia.org/wiki/Regularization_(mathematics
en.wikipedia.org
https://en.wikipedia.org/wiki/Machine_translation
en.wikipedia.org
https://deepmind.google/discover/blog/alphastar-mastering-the-real-time-strategy-game-starcraft-ii/
deepmind.google
https://deepmind.google/discover/blog/competitive-programming-with-alphacode/
deepmind.google
https://www.semanticscholar.org/paper/Highly-accurate-protein-structure-prediction-with-Jumper-Evans/dc32a984b651256a8ec282be52310e6bd33d9815
semanticscholar.org