41,554 blogs · 4,969,865 posts Claim your blog

Record · corpus.blog/posts/01a087ab-9c1a-738d-9d0d-2c9aa7447585

Butterflies, Monarchs, Hyenas, and Lightning Fast BERT

n1o.github.io · published 12 July 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at n1o.github.io Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
External links: 7
Words captured: 2,457

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://hazyresearch.stanford.edu/blog/2024-05-20-m2-bert-retrieval

hazyresearch.stanford.edu

https://pytorch.org/docs/stable/generated/torch.nn.Conv1d.html

pytorch.org

https://arxiv.org/abs/2302.10866

arxiv.org

https://huggingface.co/togethercomputer/m2-bert-80M-32k-retrieval/blob/main/monarch_mixer_sequence_mixer.py

huggingface.co

https://arxiv.org/abs/2407.09941

arxiv.org

https://arxiv.org/abs/2312.00752

arxiv.org

https://arxiv.org/abs/2406.07522

arxiv.org

Elsewhere on n1o.github.io (2)

Longer Context for T5 Read at the source ↗

Paper overview: Hungry Hungry Hippos: Towards Language Modeling with State Space Models Read at the source ↗