corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a0879a-6b80-714a-9faf-02419e75af34

From Kolmogorov to LLMs: The compression view of learning

liambai.com · published 8 June 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at liambai.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
33
Words captured
2,955

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://youtu.be/bctjSvn-OC8?si=Jf1Os9V04MIotRdq&t=48
youtu.be
https://www.youtube.com/watch?v=bctjSvn-OC8&t=48s&ab_channel=ComedyBites
youtube.com
https://en.wikipedia.org/wiki/Ilya_Sutskever
en.wikipedia.org
https://en.wikipedia.org/wiki/John_Carmack
en.wikipedia.org
https://github.com/dzyim/ilya-sutskever-recommended-reading
github.com
https://en.wikipedia.org/wiki/Floating-point_arithmetic
en.wikipedia.org
https://en.wikipedia.org/wiki/Normal_distribution
en.wikipedia.org
https://en.wikipedia.org/wiki/Shannon%27s_source_coding_theorem
en.wikipedia.org
https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.Ridge.html
scikit-learn.org
https://en.wikipedia.org/wiki/Mean_squared_error
en.wikipedia.org
https://developers.google.com/machine-learning/crash-course/overfitting/regularization
developers.google.com
https://en.wikipedia.org/wiki/Laplace_distribution
en.wikipedia.org
https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.Lasso.html
scikit-learn.org
https://mattmahoney.net/dc/textdata.html
mattmahoney.net
https://mattmahoney.net/dc/text.html
mattmahoney.net
https://go-compression.github.io/algorithms/arithmetic/
go-compression.github.io
https://en.wikipedia.org/wiki/ImageNet
en.wikipedia.org
https://www.openslr.org/12
openslr.org
https://compress-or-die.com/Understanding-PNG
compress-or-die.com
https://ollama.com/
ollama.com
https://en.wikipedia.org/wiki/Occam%27s_razor
en.wikipedia.org
http://www.incompleteideas.net/IncIdeas/BitterLesson.html
incompleteideas.net
https://en.wikipedia.org/wiki/Deep_Blue_(chess_computer
en.wikipedia.org
https://en.wikipedia.org/wiki/AlphaZero
en.wikipedia.org
https://x.com/karpathy/status/1884336943321997800?lang=en
x.com
https://www.lirmm.fr/~ashen/kolmbook-eng-scan.pdf
lirmm.fr
https://arxiv.org/abs/math/0406077
arxiv.org
https://dl.acm.org/doi/10.1145/168304.168306
dl.acm.org
https://scottaaronson.blog/?p=762
scottaaronson.blog
https://arxiv.org/abs/2309.10668
arxiv.org
https://en.wikipedia.org/wiki/Kolmogorov_complexity
en.wikipedia.org
https://en.wikipedia.org/wiki/Huffman_coding
en.wikipedia.org
https://en.wikipedia.org/wiki/Arithmetic_coding
en.wikipedia.org