56,966 blogs · 4,417,066 posts Claim your blog

Record · corpus.blog/posts/01a0875d-93f4-7051-86de-2f67d7747a70

Distributed LLM Inference with llm-d

cefboud.com · published 21 June 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at cefboud.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 11
Words captured: 2,582

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://www.envoyproxy.io/docs/envoy/latest/configuration/http/http_filters/ext_proc_filter

envoyproxy.io

https://gateway-api-inference-extension.sigs.k8s.io/

gateway-api-inference-extension.sigs.k8s.io

https://github.com/llm-d/llm-d-router/blob/f7e8852479d6b2902d3bd89d8d252187211ff801/docs/discovery.md

github.com

https://cefboud.com/assets/llm-d-arch.png

cefboud.com

https://github.com/llm-d/llm-d-router/blob/f7e8852479d6b2902d3bd89d8d252187211ff801/pkg/epp/framework/plugins/datalayer/extractor/metrics/factories.go

github.com

https://github.com/llm-d/llm-d-router/blob/20e61b8b461f7fa75911a14b3ec83ce63b4b469c/pkg/epp/framework/plugins/requestcontrol/dataproducer/tokenizer/README.md

github.com

https://cefboud.com/assets/kv-events.png

cefboud.com

https://docs.vllm.ai/en/stable/api/vllm/config/kv_events/

docs.vllm.ai

https://github.com/llm-d/llm-d-kv-cache/tree/main

github.com

https://cefboud.com/assets/pd-request-flow.png

cefboud.com

https://llm-d.ai/docs/architecture/advanced/disaggregation

llm-d.ai