corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a087ec-e4f4-72ad-a3dc-85b6cdb63ff5

Language Modeling as Next-Token Prediction

thegustafson.com · published undated

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at thegustafson.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
11
Words captured
3,381

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
Cross-Entropy, KL Divergence, and What Loss Functions Measure Read at the source ↗
thegustafson.com
Distributions, Softmax, and the Chain Rule of Words Read at the source ↗
thegustafson.com
N-gram Models and the Curse of Sparsity Read at the source ↗
thegustafson.com
https://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf
people.math.harvard.edu
https://www.princeton.edu/~wbialek/rome/refs/shannon_51.pdf
princeton.edu
https://arxiv.org/abs/2001.08361
arxiv.org
https://arxiv.org/abs/2203.15556
arxiv.org
https://arxiv.org/abs/2206.07682
arxiv.org
https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
cdn.openai.com
https://arxiv.org/abs/2005.14165
arxiv.org
https://pubs.aip.org/asa/jasa/article-abstract/62/S1/S63/642598
pubs.aip.org