41554 blogs · 4,417,066 posts Claim your blog

Record · corpus.blog/posts/01a08796-fa1f-72f9-9f2c-71d473cb4987

A gentle introduction to Rotary Position Embedding

krasserm.github.io · published 13 December 2022

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at krasserm.github.io Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 9
Words captured: 2,564

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://colab.research.google.com/github/krasserm/krasserm.github.io/blob/gh-pages/notebooks/2022-12-13-rotary-position-embedding.ipynb

colab.research.google.com

https://arxiv.org/abs/1706.03762

arxiv.org

https://arxiv.org/abs/2104.09864

arxiv.org

https://jalammar.github.io/illustrated-transformer/

jalammar.github.io

https://arxiv.org/abs/2102.11090

arxiv.org

https://arxiv.org/abs/2006.16236

arxiv.org

https://github.com/lucidrains/rotary-embedding-torch

github.com

https://github.com/krasserm/perceiver-io/blob/aaf901f4c01de5f942e3ed321c68b439d09f0e8a/perceiver/model/core/position.py

github.com

https://github.com/huggingface/transformers/blob/d4bf9ee1ff0e85cb24feec4dd160af39b623d4b9/src/transformers/models/roformer/modeling_roformer.py

github.com