41554 blogs · 4,417,066 posts Claim your blog

Record · corpus.blog/posts/01a07d5d-72e8-7140-82cd-cd9250cb09f6

🚀 Accelerating LLM Inference with TGI on Intel Gaudi

Hugging Face · published 28 March 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at huggingface.co Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 13
Words captured: 647

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://github.com/huggingface/text-generation-inference/pull/3091

github.com

https://github.com/huggingface/tgi-gaudi

github.com

Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference Read at the source ↗

https://www.intel.com/content/www/us/en/developer/platform/gaudi/develop/overview.html

intel.com

https://aws.amazon.com/ec2/instance-types/dl1/

aws.amazon.com

https://ai.cloud.intel.com/

ai.cloud.intel.com

https://www.denvrdata.com/guadi2

denvrdata.com

https://www.ibm.com/cloud

ibm.com

https://www.dell.com/en-us/lp/intel-gaudi

dell.com

https://www.hpe.com/us/en/compute/proliant-xd680.html

hpe.com

https://www.supermicro.com/en/accelerators/intel

supermicro.com

https://huggingface.co/docs/text-generation-inference/backends/gaudi

huggingface.co

https://docs.habana.ai/en/latest/PyTorch/Inference_on_PyTorch/Quantization/Inference_Using_FP8.html

docs.habana.ai