Record · corpus.blog/posts/01a0d865-bff7-7210-9659-d8a2ff49e0ed

LLM Inference: a learning roadmap

fratepietro.com · published 22 September 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at fratepietro.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 20
Words captured: 1,785

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://www.youtube.com/watch?v=9tvJ_GYJA-o

youtube.com

https://huggingface.co/blog/martinigoyanes/llm-inference-at-scale-with-tgi

huggingface.co

https://bbycroft.net/llm

bbycroft.net

https://horace.io/brrr_intro.html

horace.io

https://damek.github.io/random/basic-facts-about-gpus/

damek.github.io

https://developer.nvidia.com/blog/mastering-llm-techniques-inference-optimization/

developer.nvidia.com

https://arxiv.org/abs/2210.17323

arxiv.org

https://arxiv.org/abs/2306.00978

arxiv.org

https://arxiv.org/abs/2309.06180

arxiv.org

https://arxiv.org/abs/2205.14135

arxiv.org

https://arxiv.org/abs/2403.02310

arxiv.org

https://arxiv.org/abs/2211.17192

arxiv.org

https://arxiv.org/abs/2311.04934

arxiv.org

https://www.usenix.org/conference/osdi22/presentation/yu

usenix.org

https://github.com/vllm-project/vllm

github.com

https://github.com/sgl-project/sglang

github.com

https://github.com/ggml-org/llama.cpp

github.com

https://github.com/antonellof/frink

github.com

https://www.bentoml.com/blog/the-shift-to-distributed-llm-inference

bentoml.com

Inside vLLM: Anatomy of a High-Throughput LLM Inference System Read at the source ↗

aleksagordic.com