Record · corpus.blog/posts/01a0b955-0823-717e-a936-82a757dfe2ab

Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no NCCL

Hugging Face · published 10 September 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at huggingface.co Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
External links: 9
Words captured: 6,528

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://github.com/huggingface/trl/pull/7017

github.com

LoRA Without Regret Read at the source ↗

thinkingmachines.ai

https://github.com/huggingface/hf-mount

github.com

https://docs.vllm.ai/en/latest/features/lora/?h=lora

docs.vllm.ai

https://github.com/sail-sg/Precision-RL

github.com

https://github.com/sail-sg/Precision-RL/tree/main/oat/scripts/lora

github.com

https://github.com/vllm-project/vllm/blob/main/vllm/v1/core/kv_cache_utils.py

github.com

https://github.com/AmineDiro/hfjobs-lora-buckets/blob/main/src/lora_proxy.py

github.com

https://github.com/AmineDiro/hf-mount-repro

github.com

Elsewhere on huggingface.co (14)

https://huggingface.co/docs/trl/en/async_grpo_trainer

huggingface.co

https://huggingface.co/docs/huggingface_hub/guides/jobs

huggingface.co

https://huggingface.co/docs/hub/storage-buckets

huggingface.co

https://huggingface.co/datasets/sail/Sanity-Test-R1D-1.5B

huggingface.co

https://huggingface.co/papers/2510.26788

huggingface.co

https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B

huggingface.co

https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/asyncgrpo-lora-hfjobs/fig0-r1-dp2-reward.png

huggingface.co

https://huggingface.co/spaces/aminediroHF/async-grpo-lora-buckets

huggingface.co

https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/asyncgrpo-lora-hfjobs/fig1-r1-dp2-trainer-bound.png

huggingface.co

https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/asyncgrpo-lora-hfjobs/fig2-r1-dp2-vs-tb16k-packing.png

huggingface.co

https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/asyncgrpo-lora-hfjobs/fig3-tb16k-vs-nockpt-crossover.png

huggingface.co

https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/asyncgrpo-lora-hfjobs/fig4-dp2-vs-dp3-inflight-cap.png

huggingface.co

https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/asyncgrpo-lora-hfjobs/fig5-all-runs-scoreboard.png

huggingface.co

https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/asyncgrpo-lora-hfjobs/fig6-reward-vs-wallclock.png

huggingface.co