41554 blogs · 4,417,066 posts Claim your blog

Record · corpus.blog/posts/01a07d5d-72e7-7112-bd07-c15524c4bd0b

Accelerate ND-Parallel: A guide to Efficient Multi-GPU Training

Hugging Face · published 8 August 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at huggingface.co Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 10
Words captured: 4,124

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://github.com/axolotl-ai-cloud/axolotl/

github.com

https://github.com/huggingface/accelerate/blob/main/examples/torch_native_parallelism/nd_parallel.py

github.com

https://github.com/axolotl-ai-cloud/axolotl/tree/main/examples/distributed-parallel

github.com

https://docs.axolotl.ai/docs/nd_parallelism.html

docs.axolotl.ai

https://github.com/huggingface/accelerate/blob/v1.10.0/src/accelerate/parallelism_config.py

github.com

https://martynassubonis.substack.com/p/tensor-and-fully-sharded-data-parallelism

martynassubonis.substack.com

https://huggingface.co/docs/accelerate/v1.10.0/en/package_reference/utilities

huggingface.co

https://openreview.net/forum?id=WsRHpHH4s0

openreview.net

https://huggingface.co/docs/accelerate/v1.10.0/en/package_reference/accelerator

huggingface.co

https://huggingface.co/docs/accelerate/main/en/concept_guides/context_parallelism

huggingface.co