Record · corpus.blog/posts/01a0bdcb-30ce-7078-9de7-05fe4c5c5746

Introducing llmaz: Easy, advanced inference platform for large language models on Kubernetes

pacoxu.wordpress.com · published 23 April 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at pacoxu.wordpress.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
External links: 19
Words captured: 595

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://github.com/InftyAI/llmaz

github.com

https://github.com/InftyAI/llmaz/releases/tag/v0.1.3

github.com

https://github.com/InftyAI/llmaz/releases

github.com

https://github.com/vllm-project/vllm

github.com

https://github.com/huggingface/text-generation-inference

github.com

https://github.com/sgl-project/sglang

github.com

https://github.com/ggerganov/llama.cpp

github.com

https://github.com/InftyAI/llmaz/blob/main/docs/support-backends.md

github.com

https://huggingface.co/

huggingface.co

https://www.modelscope.cn/

modelscope.cn

https://aigateway.envoyproxy.io/

aigateway.envoyproxy.io

https://github.com/open-webui/open-webui

github.com

https://github.com/InftyAI/llmaz/blob/main/docs/open-webui.md

github.com

https://github.com/kubernetes-sigs/lws/tree/main/docs/adoption

github.com

https://github.com/InftyAI/llmaz/blob/main/docs/examples/hpa/README.md

github.com

https://github.com/kubernetes/autoscaler/tree/master/cluster-autoscaler

github.com

https://github.com/kubernetes-sigs/karpenter

github.com

https://summer-ospp.ac.cn/org/prodetail/257c80102?lang=zh&list=pro

summer-ospp.ac.cn

https://summer-ospp.ac.cn/org/prodetail/257c80106?lang=zh&list=pro

summer-ospp.ac.cn