corpus.blog
41,554 blogs · 5,063,431 posts Claim your blog
Record · corpus.blog/posts/01a08739-6b76-71ef-943d-98525a8ce67f

Fast Attention Implementations

codekansas · published 29 June 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at ben.bolte.cc Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
26
Words captured
7,240

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://github.com/lucidrains/linformer
github.com
https://arxiv.org/abs/2006.04768
arxiv.org
https://paperswithcode.com/method/linformer
paperswithcode.com
https://github.com/lucidrains/performer-pytorch
github.com
https://arxiv.org/abs/2009.14794
arxiv.org
https://ai.googleblog.com/2020/10/rethinking-attention-with-performers.html
ai.googleblog.com
https://github.com/idiap/fast-transformers
github.com
https://github.com/lucidrains/linear-attention-transformer
github.com
https://linear-transformers.com/
linear-transformers.com
https://arxiv.org/pdf/2006.16236.pdf
arxiv.org
https://machinelearning.apple.com/research/attention-free-transformer
machinelearning.apple.com
https://arxiv.org/abs/2105.14103
arxiv.org
https://johanwind.github.io/2023/03/23/rwkv_details.html
johanwind.github.io
https://gist.github.com/mattiasarro/c925e789e0358436f3e6c12731f5a196
gist.github.com
Introducing RWKV - An RNN with the advantages of a transformer Read at the source ↗
huggingface.co
https://github.com/BlinkDL/RWKV-LM
github.com
https://github.com/BlinkDL/ChatRWKV
github.com
https://github.com/BlinkDL/RWKV-CUDA
github.com
https://arxiv.org/abs/2112.05682
arxiv.org
https://github.com/facebookresearch/xformers
github.com
https://github.com/HazyResearch/flash-attention
github.com
https://arxiv.org/abs/2205.14135
arxiv.org
https://facebookresearch.github.io/xformers/components/ops.html
facebookresearch.github.io
https://triton-lang.org/main/getting-started/tutorials/06-fused-attention.html
triton-lang.org
https://arxiv.org/pdf/2306.15595.pdf
arxiv.org
https://github.com/codekansas/ml-starter/blob/master/ml/models/embeddings.py
github.com
Elsewhere on ben.bolte.cc (5)