corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a08c5f-b8a9-7324-93bb-5c75dd79aad4

Understanding Mixtral-8x7b

vtabbott.io · published 2 January 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at vtabbott.io Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
15
Words captured
492

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://x.com/vtabbott_/status/1741292811193065557?s=20
x.com
Mixtral of experts Read at the source ↗
mistral.ai
https://twitter.com/MistralAI
twitter.com
https://github.com/mistralai/mistral-src/tree/moe
github.com
https://openreview.net/forum?id=RyZB4qXEgt
openreview.net
https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard
huggingface.co
https://chat.lmsys.org/?arena
chat.lmsys.org
https://twitter.com/vtabbott_/status/1733457509632070027?s=20
twitter.com
https://www.youtube.com/watch?v=ghlIs8bVXU4
youtube.com
https://huggingface.co/docs/transformers/model_doc/mixtral
huggingface.co
https://hazyresearch.stanford.edu/blog/2023-01-12-flashattention-long-sequences
hazyresearch.stanford.edu
https://twitter.com/HazyResearch
twitter.com
https://arxiv.org/abs/1706.03762
arxiv.org
https://arxiv.org/pdf/2101.03961.pdf
arxiv.org
https://arxiv.org/pdf/2211.15841.pdf
arxiv.org