corpus.blog
41,554 blogs · 5,149,205 posts Claim your blog
Record · corpus.blog/posts/01a087d7-423d-70f1-bc61-94baf2358e25

Scaling Deep Learning

rohitbandaru.github.io · published 21 February 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at rohitbandaru.github.io Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
17
Words captured
1,814

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://github.com/google-research/bert/blob/master/README.md
github.com
https://arxiv.org/abs/1106.5730
arxiv.org
https://pytorch.org/tutorials/intermediate/ddp_tutorial.html
pytorch.org
https://www.tensorflow.org/guide/distributed_training
tensorflow.org
https://jax.readthedocs.io/en/latest/notebooks/Distributed_arrays_and_automatic_parallelization.html
jax.readthedocs.io
https://arxiv.org/abs/1811.03600
arxiv.org
https://www.reddit.com/r/MachineLearning/comments/gzb5uv/comment/fti44lv/?utm_source=share&utm_medium=web2x&context=3
reddit.com
https://pytorch.org/tutorials/intermediate/model_parallel_tutorial.html
pytorch.org
https://arxiv.org/abs/1811.06965
arxiv.org
https://arxiv.org/abs/1806.03377
arxiv.org
https://docs.aws.amazon.com/sagemaker/latest/dg/model-parallel-core-features.html
docs.aws.amazon.com
https://arxiv.org/abs/1909.08053
arxiv.org
https://www.youtube.com/watch?v=3XUG7cjte2U
youtube.com
How to Train Really Large Models on Many GPUs? Read at the source ↗
lilianweng.github.io
https://openai.com/blog/techniques-for-training-large-neural-networks/
openai.com
https://timdettmers.com/2014/10/09/deep-learning-data-parallelism/
timdettmers.com
https://huggingface.co/docs/transformers/v4.15.0/parallelism
huggingface.co