corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a07df3-ecc9-70ed-9df1-2ee533a4ac05

A Dream of Spring for Open-Weight LLMs: 10 Architectures from Jan-Feb 2026

Ahead of AI · published 25 February 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at magazine.sebastianraschka.com Wayback capture
3blogs citing
First cited
1 Mar 2026
Most recent
6 Apr 2026
Rank this month
not ranked
Links from this post
103
Words captured
5,749

Cited by

Blog
In the post
Date
mz00
The Average of Everything (136) Read at the source ↗
6 Apr 2026
Sebastian Raschka
Inside the LLM Architecture Gallery Read at the source ↗
14 Mar 2026
AI for Software Engineers | Logan Thorneloe | Substack
Better Agents Mean Better Surveillance | Weekend Reads 3 Read at the source ↗
1 Mar 2026

Links from this post

Link
Host
The Big LLM Architecture Comparison Read at the source ↗
magazine.sebastianraschka.com
https://www.arcee.ai/blog/trinity-large
arcee.ai
https://huggingface.co/arcee-ai/Trinity-Large-Preview
huggingface.co
https://magazine.sebastianraschka.com/i/168650848/12-mixture-of-experts-moe
magazine.sebastianraschka.com
https://substackcdn.com/image/fetch/$s_!1nDx!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c68bf21-24c8-4a35-a2e8-cf35fb550d00_2013x2048.png
substackcdn.com
https://huggingface.co/arcee-ai/Trinity-Large-Preview/blob/main/config.json
huggingface.co
https://github.com/arcee-ai/trinity-large-tech-report
github.com
https://www.arxiv.org/abs/2602.17004
arxiv.org
https://magazine.sebastianraschka.com/p/the-big-llm-architecture-comparison?open=false
magazine.sebastianraschka.com
https://substackcdn.com/image/fetch/$s_!3Qs5!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdaad2f01-0865-4537-bfd4-20b9294a6423_2048x1019.png
substackcdn.com
https://magazine.sebastianraschka.com/i/168650848/31-sliding-window-attention
magazine.sebastianraschka.com
https://substackcdn.com/image/fetch/$s_!BqHN!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5fc4207-e7c4-4098-9356-3adfcb4535aa_1292x704.png
substackcdn.com
https://magazine.sebastianraschka.com/i/168650848/22-qk-norm
magazine.sebastianraschka.com
https://magazine.sebastianraschka.com/i/168650848/71-no-positional-embeddings-nope
magazine.sebastianraschka.com
https://magazine.sebastianraschka.com/i/168650848/7-smollm3
magazine.sebastianraschka.com
https://magazine.sebastianraschka.com/i/168650848/122-gated-deltanet-gated-attention-hybrid
magazine.sebastianraschka.com
https://magazine.sebastianraschka.com/i/168650848/6-qwen3
magazine.sebastianraschka.com
https://magazine.sebastianraschka.com/i/168650848/93-attention-bias-and-attention-sinks
magazine.sebastianraschka.com
https://substackcdn.com/image/fetch/$s_!Sh9e!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce426af9-8d38-4d8f-949c-03bf1be847ea_2048x1274.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!Vu48!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1f3238c-cd59-4fd0-b714-45e2c06cba72_2048x1311.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!kPU0!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79d68d7a-06d6-49ea-a7b7-be997fc898a7_2048x1032.png
substackcdn.com
https://huggingface.co/moonshotai/Kimi-K2.5
huggingface.co
https://arxiv.org/abs/2602.02276
arxiv.org
https://substackcdn.com/image/fetch/$s_!PPYP!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7003acf5-f336-47ac-8612-d607982b3cb4_2048x1116.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!1GLm!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa625230b-b07b-49ce-b832-07b02757a97e_2048x1056.png
substackcdn.com
Understanding Multimodal LLMs Read at the source ↗
magazine.sebastianraschka.com
https://substackcdn.com/image/fetch/$s_!v4WJ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbcab6365-5964-42f7-899e-f4762afb7e5c_2048x1214.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!Se06!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F232f8303-4ad1-4185-83c3-4b3edfb97857_2048x630.png
substackcdn.com
https://arxiv.org/abs/2602.10604
arxiv.org
https://huggingface.co/stepfun-ai/Step-3.5-Flash
huggingface.co
https://substackcdn.com/image/fetch/$s_!yFMn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F568b6eb7-2b26-4062-9c10-8ccdb9f42a6a_2048x1136.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!blxi!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5f6a2274-0f4f-4144-b6a7-4770baf1575c_2330x1152.png
substackcdn.com
https://arxiv.org/abs/2404.19737
arxiv.org
https://substackcdn.com/image/fetch/$s_!csBk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2416e3bd-8628-42da-b8bc-2cead9970971_2048x1284.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!LXEO!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F67e6113e-d5cc-4923-adf8-98e54b15ccc7_2048x1103.png
substackcdn.com
https://github.com/QwenLM/Qwen3-Coder/blob/main/qwen3_coder_next_tech_report.pdf
github.com
https://substackcdn.com/image/fetch/$s_!YmMb!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7e87dd27-c422-4998-9149-59322246e41d_2048x1737.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!hhKs!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a4ddae7-a910-4c26-a944-8ea18505fd39_2048x1100.png
substackcdn.com
https://arxiv.org/abs/2412.06464
arxiv.org
https://arxiv.org/abs/2505.06708
arxiv.org
https://arxiv.org/abs/2309.00071
arxiv.org
https://substackcdn.com/image/fetch/$s_!AZvw!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5fa5ba0-394a-4971-98ce-1a1c412156df_1553x2048.png
substackcdn.com
https://magazine.sebastianraschka.com/i/177848019/24-qwen3-next
magazine.sebastianraschka.com
https://z.ai/blog/glm-5
z.ai
https://substackcdn.com/image/fetch/$s_!0CCO!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9dbe4e70-931f-48d0-a688-cf26ddbc53da_1998x2048.png
substackcdn.com
https://www.arxiv.org/abs/2602.15763
arxiv.org
https://substackcdn.com/image/fetch/$s_!z0ga!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd57575f6-fae5-41b3-934e-a80272560533_1785x746.png
substackcdn.com
From DeepSeek V3 to V3.2: Architecture, Sparse Attention, and RL Updates Read at the source ↗
magazine.sebastianraschka.com
https://substackcdn.com/image/fetch/$s_!WGLc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc26b96bc-0f79-4b9b-9036-d8edd77684e7_2048x975.png
substackcdn.com
https://github.com/vectara/hallucination-leaderboard/tree/main
github.com
https://substackcdn.com/image/fetch/$s_!kiAM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F57a8f38e-7f23-4cfa-b41c-1e896896423a_2048x907.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!cZzX!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F470e2710-c4f2-4e55-91fc-6c9c1205e3e3_2048x773.png
substackcdn.com
https://artificialanalysis.ai
artificialanalysis.ai
https://openrouter.ai/rankings
openrouter.ai
https://huggingface.co/MiniMaxAI/MiniMax-M2.5
huggingface.co
https://substackcdn.com/image/fetch/$s_!FkTZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa8cc2298-de91-4697-b179-e66300ed804c_2048x1682.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!08S5!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8ff453d0-b0dd-4ffb-8ce2-6de9b273036d_2048x954.png
substackcdn.com
https://www.reddit.com/r/singularity/comments/1rbl95k/has_any_expert_found_a_good_reason_yet_why_the/
reddit.com
Why we no longer evaluate SWE-bench Verified Read at the source ↗
openai.com
https://substackcdn.com/image/fetch/$s_!m5Th!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb4b93355-6524-4497-b94a-87d6b6fd6c6a_2048x1420.png
substackcdn.com
https://artificialanalysis.ai/models/minimax-m2-5
artificialanalysis.ai
https://substackcdn.com/image/fetch/$s_!QfSY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9ea29021-fc2f-4d2a-ad7d-3e6498f36d03_2196x1168.png
substackcdn.com
https://huggingface.co/Nanbeige/Nanbeige4.1-3B
huggingface.co
https://substackcdn.com/image/fetch/$s_!BP3i!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5cf6695-abdc-4092-8740-a9d10ac0d8f2_2048x1682.png
substackcdn.com
https://www.atomproject.ai
atomproject.ai
https://substackcdn.com/image/fetch/$s_!SyMU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff161ab06-2d79-45a0-84d3-2d77ce06f496_2048x1379.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!z4LM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ea1f917-5eb1-422d-bed0-be43ed24ef9c_2048x1056.png
substackcdn.com
https://arxiv.org/abs/2602.13367
arxiv.org
https://substackcdn.com/image/fetch/$s_!1Rqg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe97be65d-e615-4357-a7dc-6fbd2b5cce75_2048x1327.png
substackcdn.com
https://huggingface.co/Qwen/Qwen3.5-397B-A17B
huggingface.co
https://substackcdn.com/image/fetch/$s_!VuQE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5db47a23-92b0-492a-884d-c099270f8d81_2048x1281.png
substackcdn.com
https://huggingface.co/Qwen/Qwen3.5-27B
huggingface.co
https://huggingface.co/Qwen/Qwen3.5-35B-A3B
huggingface.co
https://huggingface.co/Qwen/Qwen3.5-122B-A10B
huggingface.co
https://huggingface.co/inclusionAI/Ling-2.5-1T
huggingface.co
https://huggingface.co/inclusionAI/Ring-2.5-1T
huggingface.co
https://substackcdn.com/image/fetch/$s_!cFbq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e302e92-81a0-4cfd-8ce2-9a20e8250d6b_2048x1028.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!H9JY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e33c430-8aad-4f2c-a2f8-30a6c594d2fe_2048x1012.png
substackcdn.com
https://cohere.com/blog/cohere-labs-tiny-aya
cohere.com
https://huggingface.co/CohereLabs/tiny-aya-base
huggingface.co
https://huggingface.co/CohereLabs/tiny-aya-global
huggingface.co
https://huggingface.co/CohereLabs/tiny-aya-fire
huggingface.co
https://huggingface.co/CohereLabs/tiny-aya-water
huggingface.co
https://huggingface.co/CohereLabs/tiny-aya-earth
huggingface.co
https://substackcdn.com/image/fetch/$s_!pHgU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30a8c812-9dd5-4a7f-8748-2cd5b9b8b789_2048x792.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!sSOa!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5277c9dc-7fc8-429d-bb8d-2e5fa5005b92_2048x1098.png
substackcdn.com
https://github.com/rasbt/LLMs-from-scratch/tree/main/ch05/15_tiny-aya
github.com
https://substackcdn.com/image/fetch/$s_!a8-a!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1353dea3-4f5e-4605-b5a7-e5fb5316c612_2048x1590.png
substackcdn.com
https://github.com/rasbt/LLMs-from-scratch/blob/main/ch05/15_tiny-aya/standalone-tiny-aya-plus-kv-cache.ipynb
github.com
https://substackcdn.com/image/fetch/$s_!10Cq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F08c9caab-58de-472c-96fe-1812d4368740_2048x1447.png
substackcdn.com
https://huggingface.co/sarvamai/sarvam-30b
huggingface.co
https://huggingface.co/sarvamai/sarvam-105b
huggingface.co
https://www.sarvam.ai/blogs/sarvam-30b-105b
sarvam.ai
https://substackcdn.com/image/fetch/$s_!qeeI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1f8a8cd-de00-4a8e-8311-ed9fa4c3cce1_2986x1608.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!ETqw!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1fdd1d8-1031-47be-9222-7ee082b05cb0_1694x816.png
substackcdn.com
https://arxiv.org/abs/2405.04434
arxiv.org
https://substackcdn.com/image/fetch/$s_!BGOs!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffdc91b42-5594-48a9-b24f-2f59a78ef222_1444x1236.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!AXZh!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe184c7d0-ea82-4f16-8f4e-ea3a4ddeb5bb_1460x1310.png
substackcdn.com
https://magazine.sebastianraschka.com/subscribe
magazine.sebastianraschka.com
https://amzn.to/4fqvn0D
amzn.to
https://mng.bz/Nwr7
mng.bz
https://substackcdn.com/image/fetch/$s_!RCl_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F27a118a0-5da6-4486-b1f0-3743754d0a77_8106x4044.webp
substackcdn.com
https://www.amazon.com/Build-Large-Language-Model-Scratch/dp/1633437167
amazon.com