Record · corpus.blog/posts/01a087a4-b0eb-70ec-9279-13437b712862

Efficient Memory Management for Large Language Model Serving with PagedAttention

Micah Lerner · published 11 January 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at micahlerner.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
External links: 25
Words captured: 1,411

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://dl.acm.org/doi/10.1145/3600006.3613165

dl.acm.org

ChatGPT, OpenAI’s conversational AI model Read at the source ↗

openai.com

https://bard.google.com

bard.google.com

https://ai.meta.com/llama/

ai.meta.com

Mixtral of experts

mistral.ai

https://www.businessinsider.com/how-much-chatgpt-costs-openai-to-run-estimate-report-2023-4

businessinsider.com

https://github.com/vllm-project/vllm

github.com

http://jalammar.github.io/illustrated-transformer/

jalammar.github.io

https://osanseviero.github.io/hackerllama/blog/posts/random_transformer/

osanseviero.github.io

https://stackoverflow.com/a/15851473

stackoverflow.com

https://stackoverflow.com/questions/628938/what-is-copy-on-write

stackoverflow.com

https://proceedings.neurips.cc/paper/2014/file/a14ac55a4f27472c5d894ec1c3c743d2-Paper.pdf

proceedings.neurips.cc

https://d2l.ai/chapter_recurrent-modern/beam-search.html

d2l.ai

https://platform.openai.com/docs/guides/prompt-engineering

platform.openai.com

https://github.com/vllm-project/vllm/tree/d0215a58e78572d91dadafe9d832a2db89b09a13/vllm/core

github.com

https://arxiv.org/pdf/1909.08053.pdf

arxiv.org

https://docs.vllm.ai/en/latest/getting_started/quickstart.html

docs.vllm.ai

https://github.com/vllm-project/vllm/blob/937e7b7d7c460c00805ac358a4873ec0653ab2f5/vllm/sequence.py

github.com

https://www.usenix.org/conference/osdi22/presentation/yu

usenix.org

https://sharegpt.com/

sharegpt.com

https://github.com/tatsu-lab/stanford_alpaca

github.com

At the Intersection of LLMs and Kernels - Research Roundup Read at the source ↗

charlesfrye.github.io

https://skypilot.readthedocs.io/en/latest/

skypilot.readthedocs.io

https://www.usenix.org/conference/nsdi23/presentation/yang-zongheng

usenix.org

https://twitter.com/micahlerner/status/1741989855041843504

twitter.com