corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a07d5d-72e8-7140-82cd-cd924102e368

No GPU left behind: Unlocking Efficiency with Co-located vLLM in TRL

Hugging Face · published 3 June 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at huggingface.co Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
17
Words captured
2,973

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://huggingface.co/papers/2402.03300
huggingface.co
https://github.com/huggingface/trl/pull/3394
github.com
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/vllm-colocate/gpus-design.png
huggingface.co
https://github.com/huggingface/trl/blob/fef915e36f12f759b384e4ab6f650208130aa232/trl/trainer/grpo_trainer.py
github.com
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/vllm-colocate/small-b.png
huggingface.co
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/vllm-colocate/small-tp.png
huggingface.co
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/vllm-colocate/med-b.png
huggingface.co
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/vllm-colocate/med-tp.png
huggingface.co
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/vllm-colocate/72b-tput.png
huggingface.co
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/vllm-colocate/blogpost_72b_rewards.png
huggingface.co
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/vllm-colocate/blogpost_72b_math500.png
huggingface.co
https://github.com/vllm-project/vllm/issues/15895
github.com
https://blog.vllm.ai/2025/01/10/dev-experience.html
blog.vllm.ai
https://github.com/vllm-project/vllm/commit/cc10281498fc2a6eb804274dcf22e6cb766f7aa7
github.com
https://github.com/vllm-project/vllm/issues/16564
github.com
https://github.com/vllm-project/vllm/pull/16889
github.com
https://github.com/vllm-project/vllm/issues/16993
github.com