corpus.blog
43,228 blogs · 5,519,570 posts Claim your blog
Record · corpus.blog/posts/01a0fe3f-8dcf-72d7-b943-a651a00f0c04

Scaling Multimodal Foundation Models in TorchMultimodal with Pytorch Distributed

PyTorch Blog · published 21 November 2022

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at pytorch.org Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
15
Words captured
2,235

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://arxiv.org/pdf/2001.08361.pdf
arxiv.org
https://arxiv.org/pdf/2010.11929.pdf
arxiv.org
https://arxiv.org/pdf/2111.06377.pdf
arxiv.org
https://openai.com/blog/clip/
openai.com
https://parti.research.google/
parti.research.google
https://arxiv.org/pdf/2201.07520.pdf
arxiv.org
https://flava-model.github.io/
flava-model.github.io
https://github.com/facebookresearch/multimodal/tree/main/torchmultimodal/models/flava
github.com
https://github.com/facebookresearch/multimodal/tree/main/examples/flava/native
github.com
https://openreview.net/pdf?id=U2exBrf_SJh
openreview.net
https://arxiv.org/abs/1910.02054
arxiv.org
https://github.com/pytorch/pytorch/blob/master/torch/distributed/fsdp/wrap.py
github.com
https://github.com/pytorch/pytorch/blob/75c0e3a471c19b883feca15fd4ecfabedf746691/torch/distributed/fsdp/fully_sharded_data_parallel.py
github.com
https://deploy-preview-1186--pytorch-dot-org-preview.netlify.app/blog/introducing-torchmultimodal/
deploy-preview-1186--pytorch-dot-org-preview.netlify.app
Fully Sharded Data Parallel: faster AI training with fewer GPUs Read at the source ↗
engineering.fb.com
Elsewhere on pytorch.org (8)