corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a07df3-ecc9-70ed-9df1-2ee5348ccf0c

The State Of LLMs 2025: Progress, Problems, and Predictions

Ahead of AI · published 30 December 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at magazine.sebastianraschka.com Wayback capture
3blogs citing
First cited
4 Jan 2026
Most recent
14 Jul 2026
Rank this month
not ranked
Links from this post
61
Words captured
6,934

Cited by

Blog
In the post
Date
alexfurrier.dev
If AI Coding Trends Continue, I’ll Be Merging 20 PRs a Day Read at the source ↗
14 Jul 2026
seroter.com
Daily Reading List – January 5, 2026 (#693) Read at the source ↗
6 Jan 2026
@adlrocha Beyond The Code | Substack
@adlrocha - Beyond Benchmaxxing: Why the Future of AI is Inference-Time Search Read at the source ↗
4 Jan 2026

Links from this post

Link
Host
https://arxiv.org/abs/2501.12948
arxiv.org
https://substackcdn.com/image/fetch/$s_!Kcvi!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F89f0ab43-20be-4c4d-a0f7-1a107d380222_1496x1464.png
substackcdn.com
https://arxiv.org/abs/2412.19437
arxiv.org
https://substackcdn.com/image/fetch/$s_!Tc8v!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8ca64a21-f608-4aba-9920-5a8f8216ae27_1600x386.png
substackcdn.com
https://static-content.springer.com/esm/art%3A10.1038%2Fs41586-025-09422-z/MediaObjects/41586_2025_9422_MOESM1_ESM.pdf
static-content.springer.com
https://substackcdn.com/image/fetch/$s_!2b0j!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fadaa546e-94d1-4dfe-b05d-f23e43847211_1358x288.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!Uvve!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fde63e3fa-a7f1-41ea-ad03-17e4515f1d6e_1600x1400.png
substackcdn.com
The State of Reinforcement Learning for LLM Reasoning Read at the source ↗
magazine.sebastianraschka.com
https://substackcdn.com/image/fetch/$s_!ZBQ-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93f6ea05-d650-4ec7-8972-b1975ffbc508_1082x580.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!GlDd!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23917c54-bf6b-4554-9db7-9b7360b69f11_1600x576.png
substackcdn.com
From DeepSeek V3 to V3.2: Architecture, Sparse Attention, and RL Updates Read at the source ↗
magazine.sebastianraschka.com
https://arxiv.org/html/2511.22570v1
arxiv.org
https://substackcdn.com/image/fetch/$s_!OUnU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8d671b5e-667d-4464-8c30-8ca1b15967e3_1600x980.jpeg
substackcdn.com
https://mng.bz/Nwr7
mng.bz
https://arxiv.org/abs/2106.09685
arxiv.org
https://substackcdn.com/image/fetch/$s_!0iaE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2c75b06d-9d95-4b51-b039-adb385fad15d_1600x1308.png
substackcdn.com
https://github.com/rasbt/LLMs-from-scratch/blob/main/appendix-E/01_main-chapter-code/appendix-E.ipynb
github.com
https://arxiv.org/abs/2305.18290
arxiv.org
https://substackcdn.com/image/fetch/$s_!cmbH!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bc549ca-4491-408f-ad9b-ab6bdb289957_1600x1363.png
substackcdn.com
https://github.com/rasbt/LLMs-from-scratch/blob/main/ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb
github.com
https://arxiv.org/abs/2512.13961
arxiv.org
https://arxiv.org/abs/2503.14476
arxiv.org
https://arxiv.org/abs/2503.20783
arxiv.org
https://fengyao.notion.site/off-policy-rl
fengyao.notion.site
https://arxiv.org/abs/2512.02556
arxiv.org
https://substackcdn.com/image/fetch/$s_!9MeZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1d86dee8-3feb-42d7-9c8c-032338ff8ea3_1600x463.png
substackcdn.com
https://github.com/rasbt/reasoning-from-scratch/tree/main/ch06/02_rlvr_grpo_scripts_original
github.com
https://github.com/rasbt/reasoning-from-scratch/tree/main/ch06/02_rlvr_grpo_scripts_intro
github.com
https://github.com/rasbt/reasoning-from-scratch
github.com
The Big LLM Architecture Comparison Read at the source ↗
magazine.sebastianraschka.com
https://substackcdn.com/image/fetch/$s_!Tzat!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd25e75d2-1a8e-4279-8e54-cb7224cd0f33_1167x1600.jpeg
substackcdn.com
Beyond Standard LLMs Read at the source ↗
magazine.sebastianraschka.com
https://deepmind.google/models/gemini-diffusion
deepmind.google
https://github.com/inclusionAI/LLaDA2.0
github.com
https://substackcdn.com/image/fetch/$s_!aGuq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff390d4ee-9cb8-48fa-aab7-ecdfc1590685_1742x1292.png
substackcdn.com
https://arxiv.org/abs/2508.10925
arxiv.org
https://arxiv.org/abs/1902.10811
arxiv.org
https://substackcdn.com/image/fetch/$s_!hM4a!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F434a2db6-bfeb-4579-8961-f2baaf592b30_1388x882.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!7w1V!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F59b0b5ba-c041-4e07-a354-f748113b85ea_960x1600.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!IxSY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdedc255c-7eef-4367-a908-c2d6d7f0b0e1_1067x1600.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!wCE7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F01f101ad-9526-4fc5-9ed9-7de240179289_1688x1034.png
substackcdn.com
https://www.theinformation.com/articles/openai-anthropic-discuss-data-deals-biotech-companies
theinformation.com
https://substackcdn.com/image/fetch/$s_!7EYB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa6d20218-9621-43c5-885b-deae884c60af_1648x744.png
substackcdn.com
https://amzn.to/4fqvn0D
amzn.to
https://substackcdn.com/image/fetch/$s_!zoqK!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4e5d049-9504-4003-a033-30e8dd9f9814_1600x1231.png
substackcdn.com
https://github.com/rasbt/LLMs-from-scratch
github.com
https://substackcdn.com/image/fetch/$s_!CEM3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F878e59d9-50cc-4cc8-b9a0-6b3c3a61eae9_1178x1596.png
substackcdn.com
https://mng.bz/M96o
mng.bz
https://substackcdn.com/image/fetch/$s_!x6eg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02d7af11-324a-4489-8768-6c93252024ee_2048x1619.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!avvc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa903f056-2386-456a-af93-3b6343fcca92_2048x1680.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!2TLW!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15ffa69f-f8ac-43e9-a106-629707d373ab_1622x1152.png
substackcdn.com
https://www.nature.com/articles/d41586-025-02343-x
nature.com
https://deepmind.google/blog/advanced-version-of-gemini-with-deep-think-officially-achieves-gold-medal-standard-at-the-international-mathematical-olympiad/
deepmind.google
https://www.atomproject.ai/
atomproject.ai
https://magazine.sebastianraschka.com/i/168650848/mistral
magazine.sebastianraschka.com
https://magazine.sebastianraschka.com/i/168650848/qwen-next
magazine.sebastianraschka.com
https://magazine.sebastianraschka.com/i/168650848/kimi-linear
magazine.sebastianraschka.com
From GPT-2 to gpt-oss: Analyzing the Architectural Advances Read at the source ↗
magazine.sebastianraschka.com
https://modelcontextprotocol.io/docs/getting-started/intro
modelcontextprotocol.io
https://www.linuxfoundation.org/press/linux-foundation-announces-the-formation-of-the-agentic-ai-foundation
linuxfoundation.org
https://substackcdn.com/image/fetch/$s_!NNUi!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8480ea33-a65e-4e81-8359-4a17d9c7aaf1_2048x1364.jpeg
substackcdn.com