corpus.blog
43,134 blogs · 5,458,805 posts Claim your blog
Record · corpus.blog/posts/01a0877c-88ad-7297-9aef-de738c462c5c

Floating-Point Formats and Deep Learning

Hello! I’m George (a.k.a. eigenfoo) | George Ho · published 26 July 2020

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at georgeho.org Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
27
Words captured
1,599

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://knowyourmeme.com/photos/6052-its-more-likely-than-you-think
knowyourmeme.com
https://arxiv.org/abs/1502.02551
arxiv.org
https://arxiv.org/abs/1412.7024
arxiv.org
https://arxiv.org/abs/1809.00095
arxiv.org
https://medium.com/@moocaholic/fp64-fp32-fp16-bfloat16-tf32-and-other-members-of-the-zoo-a1ca7897d407
medium.com
https://en.wikipedia.org/wiki/Half-precision_floating-point_format
en.wikipedia.org
https://en.wikipedia.org/wiki/Single-precision_floating-point_format
en.wikipedia.org
https://en.wikipedia.org/wiki/Double-precision_floating-point_format
en.wikipedia.org
https://en.wikipedia.org/wiki/Floating-point_arithmetic
en.wikipedia.org
https://ieeexplore.ieee.org/document/8766229
ieeexplore.ieee.org
http://half.sourceforge.net/
half.sourceforge.net
https://cloud.google.com/blog/products/ai-machine-learning/bfloat16-the-secret-to-high-performance-on-cloud-tpus
cloud.google.com
https://arxiv.org/abs/1905.12322
arxiv.org
https://www.tensorflow.org/api_docs/python/tf
tensorflow.org
https://en.wikipedia.org/wiki/Cooper_Lake_(microarchitecture
en.wikipedia.org
https://www.techpowerup.com/260344/future-amd-gpu-architecture-to-implement-bfloat16-hardware
techpowerup.com
https://blogs.nvidia.com/blog/2020/05/14/tensorfloat-32-precision-format/
blogs.nvidia.com
https://developer.nvidia.com/blog/nvidia-ampere-architecture-in-depth/
developer.nvidia.com
https://developer.nvidia.com/blog/cuda-11-features-revealed/
developer.nvidia.com
https://www.tensorflow.org/guide/mixed_precision
tensorflow.org
https://github.com/NVIDIA/apex
github.com
https://developer.nvidia.com/automatic-mixed-precision
developer.nvidia.com
https://docs.nvidia.com/deeplearning/performance/mixed-precision-training/index.html
docs.nvidia.com
https://arxiv.org/abs/1710.03740
arxiv.org
https://developer.nvidia.com/blog/mixed-precision-training-deep-neural-networks/
developer.nvidia.com
https://en.wikipedia.org/wiki/Quadruple-precision_floating-point_format
en.wikipedia.org
https://en.wikipedia.org/wiki/Octuple-precision_floating-point_format
en.wikipedia.org