corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a087ec-e4f4-72ad-a3dc-85b6cb28871c

Optimizers: Momentum, Adam, and Learning Rate Schedules

thegustafson.com · published undated

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at thegustafson.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
9
Words captured
3,389

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
Gradients and How Machines Learn Read at the source ↗
thegustafson.com
GPUs, Floating Point, and Why Precision Matters Read at the source ↗
thegustafson.com
https://arxiv.org/abs/1412.6980
arxiv.org
https://arxiv.org/abs/1711.05101
arxiv.org
https://arxiv.org/abs/1608.03983
arxiv.org
https://arxiv.org/abs/1609.04747
arxiv.org
A Recipe for Training Neural Networks Read at the source ↗
karpathy.github.io
https://arxiv.org/abs/2203.15556
arxiv.org
https://arxiv.org/abs/2110.02861
arxiv.org