corpus.blog
41554 blogs · 4,644,446 posts Claim your blog
Record · corpus.blog/posts/01a0c50d-af77-710a-8a38-54977063e682

Rethinking SGD’s noise

Francis Bach · published 25 July 2022

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at francisbach.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
32
Words captured
5,013

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://projecteuclid.org/journals/annals-of-mathematical-statistics/volume-22/issue-3/A-Stochastic-Approximation-Method/10.1214/aoms/1177729586.full
projecteuclid.org
https://link.springer.com/book/9783540606994
link.springer.com
https://proceedings.neurips.cc/paper/2007/hash/0d3180d672e08b4c5312dcdafdf6ef36-Abstract.html
proceedings.neurips.cc
https://arxiv.org/pdf/2105.01650.pdf
arxiv.org
https://proceedings.mlr.press/v89/vaswani19a.html
proceedings.mlr.press
https://proceedings.mlr.press/v80/ma18a.html
proceedings.mlr.press
https://en.wikipedia.org/wiki/Markov_chain
en.wikipedia.org
https://link.springer.com/book/10.1007/978-1-4471-3267-7
link.springer.com
https://epubs.siam.org/doi/10.1137/0324039
epubs.siam.org
https://papers.nips.cc/paper/2011/hash/40008b9a5380fcacce3976bf7c08af5b-Abstract.html
papers.nips.cc
https://projecteuclid.org/journals/annals-of-statistics/volume-48/issue-3/Bridging-the-gap-between-constant-step-size-stochastic-gradient-descent/10.1214/19-AOS1850.full
projecteuclid.org
https://proceedings.neurips.cc/paper/2021/hash/b4a0e0fbaa9f16d8947c49f4e610b549-Abstract.html
proceedings.neurips.cc
https://francisbach.com/gradient-flows/
francisbach.com
https://francisbach.com/gradient-descent-neural-networks-global-convergence/
francisbach.com
https://francisbach.com/gradient-descent-for-wide-two-layer-neural-networks-implicit-bias/
francisbach.com
https://link.springer.com/book/10.1007/978-3-642-14394-6
link.springer.com
https://jmlr.org/papers/v20/17-526.html
jmlr.org
https://proceedings.mlr.press/v119/ali20a.html
proceedings.mlr.press
https://en.wikipedia.org/wiki/Ornstein%E2%80%93Uhlenbeck_process
en.wikipedia.org
https://en.wikipedia.org/wiki/Geometric_Brownian_motion
en.wikipedia.org
https://en.wikipedia.org/wiki/It%C3%B4_calculus
en.wikipedia.org
https://proceedings.mlr.press/v38/defossez15.html
proceedings.mlr.press
https://en.wikipedia.org/wiki/Black%E2%80%93Scholes_model
en.wikipedia.org
https://en.wikipedia.org/wiki/Law_of_the_iterated_logarithm
en.wikipedia.org
https://openreview.net/forum?id=Sy8gdB9xx
openreview.net
https://en.wikipedia.org/wiki/Langevin_dynamics
en.wikipedia.org
https://arxiv.org/pdf/1609.04836.pdf
arxiv.org
https://proceedings.neurips.cc/paper/2021/hash/f4661398cb1a3abd3ffe58600bf11322-Abstract.html
proceedings.neurips.cc
https://proceedings.mlr.press/v178/vivien22a.html
proceedings.mlr.press
https://open.spotify.com/track/1r6EJWSoh9Kzn6L38BhYS6?si=b352952e9bac4420
open.spotify.com
https://link.springer.com/content/pdf/10.1007/978-3-642-14394-6_5.pdf
link.springer.com
https://almostsuremath.com/2010/04/13/levys-characterization-of-brownian-motion/
almostsuremath.com