corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a07d5d-88d1-7203-af2c-4b784a56decb

Modular: Paged Attention & Prefix Caching Now Available in MAX Serve

Modular · published 6 February 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at modular.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
16
Words captured
591

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
Modular: ModCon 2026: Open source, open cloud, open silicon Read at the source ↗
modular.com
https://docs.modular.com/max/serve
docs.modular.com
https://github.com/modular/max/commit/b1b540c6d699cbecab0b50b47c17bf40cdbdd8fd
github.com
https://hub.docker.com/layers/modular/max-openai-api/25.1.0.dev2025020205/images/sha256-ca59f45568b326c5aa175b8d94b8e77aa81f0604c3d07e2c6b21245fa25176a4
hub.docker.com
https://github.com/modular/max/tree/main/pipelines/python
github.com
https://docs.modular.com/max/api/python/graph/
docs.modular.com
https://arxiv.org/pdf/1706.03762
arxiv.org
https://huggingface.co/blog/not-lain/kv-caching
huggingface.co
https://arxiv.org/pdf/2309.06180
arxiv.org
https://arxiv.org/pdf/2312.07104
arxiv.org
https://docs.modular.com/max/container/
docs.modular.com
https://docs.modular.com/max/tutorials/max-serve-local-to-cloud
docs.modular.com
https://docs.modular.com/max/serve/prefix-caching
docs.modular.com
https://discord.gg/modular
discord.gg
https://forum.modular.com/
forum.modular.com
https://www.modular.com/models
modular.com