corpus.blog
41554 blogs · 4,504,310 posts Claim your blog
Record · corpus.blog/posts/01a087b3-89bd-7041-a839-fd732453bdae

SFT, RL, and On-Policy Distillation Through a Distributional Lens

nrehiew.github.io · published 10 May 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at nrehiew.github.io Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
27
Words captured
3,711

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://nrehiew.github.io/blog/images/sft_distribution.svg
nrehiew.github.io
https://nrehiew.github.io/blog/images/rl_distribution.svg
nrehiew.github.io
https://arxiv.org/abs/2601.18734
arxiv.org
https://nrehiew.github.io/blog/images/opsd_token.png
nrehiew.github.io
LoRA Without Regret Read at the source ↗
thinkingmachines.ai
Coding Models Are Doing Too Much Read at the source ↗
nrehiew.github.io
https://arxiv.org/abs/2510.18874
arxiv.org
https://nrehiew.github.io/blog/images/toy_reverseKL.png
nrehiew.github.io
https://arxiv.org/abs/2601.02151
arxiv.org
https://arxiv.org/abs/2507.05386
arxiv.org
https://arxiv.org/abs/2505.11711
arxiv.org
https://arxiv.org/abs/2510.04454
arxiv.org
https://arxiv.org/abs/2509.04259
arxiv.org
https://nrehiew.github.io/blog/images/on_policy.svg
nrehiew.github.io
https://arxiv.org/pdf/2306.13649
arxiv.org
https://arxiv.org/abs/2604.01193
arxiv.org
https://arxiv.org/abs/2306.08543
arxiv.org
https://nrehiew.github.io/blog/images/reward_entropy_plots.svg
nrehiew.github.io
https://arxiv.org/abs/1011.0686
arxiv.org
https://arxiv.org/abs/2501.17161
arxiv.org
https://arxiv.org/abs/2602.15763
arxiv.org
https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/DeepSeek_V4.pdf
huggingface.co
https://arxiv.org/abs/2601.02780
arxiv.org
https://nrehiew.github.io/blog/images/mimo_v2_flash.png
nrehiew.github.io
https://x.com/willccbb/status/2050038277454143918
x.com
On-Policy Distillation Read at the source ↗
thinkingmachines.ai
https://arxiv.org/abs/2305.20050
arxiv.org