corpus.blog
Claim your blog
Record · corpus.blog/posts/01a08735-504a-7176-864a-4f9329961252

Load balancing OpenAI API calls with LiteLLM

baeke.info · published 16 April 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at baeke.info Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
14
Words captured
2,031

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/429
developer.mozilla.org
https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/provisioned-throughput
learn.microsoft.com
https://docs.litellm.ai/
docs.litellm.ai
https://github.com/Azure/apim-aoai-smart-loadbalancing
github.com
https://litellm.vercel.app/
litellm.vercel.app
https://python.useinstructor.com/
python.useinstructor.com
https://docs.pydantic.dev/latest/
docs.pydantic.dev
https://litellm.vercel.app/docs/providers
litellm.vercel.app
https://docs.litellm.ai/docs/routing
docs.litellm.ai
https://kubectl.docs.kubernetes.io/references/kustomize/
kubectl.docs.kubernetes.io
Publish and subscribe overview
docs.dapr.io
https://learn.microsoft.com/en-us/azure/aks/csi-secrets-store-driver
learn.microsoft.com
https://www.diagrid.io/conductor
diagrid.io
https://litellm.vercel.app/docs/proxy/demo
litellm.vercel.app
Elsewhere on baeke.info (8)