Skip to content
corpus.blog
Sign in Claim your blog
Record · sebastianraschka.com

LLM Architecture Gallery

Sebastian Raschka · 64 min read

A post on sebastianraschka.com is cited by 1 distinct blog to date (corpus.blog, measured 11 October 2026).

A record is what was published and who pointed at it. The text of the post is not shown here: read it at the source, or at its Wayback capture.

Read at sebastianraschka.com (opens in a new tab) Wayback capture (opens in a new tab)

1blog citing

Citing blogs and links by period
Period Blogs Links
All time11
Last 90 days11
Last 30 days11
Last 7 days00
Figures for this page
First cited25 Sept 2026
Latest citation25 Sept 2026
Words blogs link it with1
External links324
Length14,673

Words blogs link it with

The words blogs link this page with, by how many different blogs use them.

  • llm architecture gallery1 blog

Cited by 1 blog in 1 post

One row per blog, the most recently citing first. Each shows the blog's newest citing post; open a row for the others.

Blog
Newest citing post
Date
downes.ca1 post
GPUs: Rent vs Buy

linked as “LLM Architecture Gallery”

Read at downes.ca (opens in a new tab)
25 Sept 2026

Links from this post

Link
Host
https://github.com/rasbt/LLMs-from-scratch/issues/new?labels=architecture-gallery&title=Architecture%20Gallery%3A%20 Who cites this page
github.com
https://rasbt.gumroad.com/l/llm-gallery
rasbt.gumroad.com
https://huggingface.co/openai-community/gpt2-xl/blob/main/config.json Who cites this page
huggingface.co
https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf Who cites this page
cdn.openai.com
https://github.com/rasbt/LLMs-from-scratch/tree/main/ch05/07_gpt_to_llama Who cites this page
github.com
https://huggingface.co/meta-llama/Meta-Llama-3-8B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/meta-llama/Meta-Llama-3-8B/blob/main/LICENSE Who cites this page
huggingface.co
https://arxiv.org/pdf/2407.21783 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/llama-3-instruct-8b Who cites this page
artificialanalysis.ai
https://huggingface.co/meta-llama/Llama-3.2-1B/blob/main/LICENSE.txt Who cites this page
huggingface.co
https://artificialanalysis.ai/models/llama-3-2-instruct-1b Who cites this page
artificialanalysis.ai
https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/blob/main/config.json Who cites this page
huggingface.co
https://arxiv.org/pdf/2501.00656 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/olmo-2-7b Who cites this page
artificialanalysis.ai
https://huggingface.co/deepseek-ai/DeepSeek-V3/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/deepseek-ai/DeepSeek-V3/blame/main/LICENSE-MODEL Who cites this page
huggingface.co
https://arxiv.org/pdf/2412.19437 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/deepseek-v3 Who cites this page
artificialanalysis.ai
https://huggingface.co/deepseek-ai/DeepSeek-R1/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/deepseek-ai/DeepSeek-R1/blob/main/LICENSE Who cites this page
huggingface.co
https://arxiv.org/pdf/2501.12948 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/deepseek-r1-0120 Who cites this page
artificialanalysis.ai
https://github.com/rasbt/LLMs-from-scratch/tree/main/ch05/12_gemma3 Who cites this page
github.com
https://huggingface.co/google/gemma-3-27b-it/blob/main/config.json Who cites this page
huggingface.co
https://ai.google.dev/gemma/prohibited_use_policy Who cites this page
ai.google.dev
https://arxiv.org/pdf/2503.19786 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/gemma-3-27b Who cites this page
artificialanalysis.ai
https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Base-2503/blob/main/config.json Who cites this page
huggingface.co
Mistral Small 3.1 Who cites this page
mistral.ai
https://artificialanalysis.ai/models/mistral-small-3-1 Who cites this page
artificialanalysis.ai
https://huggingface.co/meta-llama/Llama-4-Maverick-17B-128E-Instruct/blob/main/config.json Who cites this page
huggingface.co
The Llama 4 herd: The beginning of a new era of natively multimodal AI innovation Read at ai.meta.com (opens in a new tab)
ai.meta.com
https://artificialanalysis.ai/models/llama-4-maverick Who cites this page
artificialanalysis.ai
https://huggingface.co/Qwen/Qwen3-0.6B-Base/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3-0.6B-Base/blob/main/LICENSE Who cites this page
huggingface.co
https://artificialanalysis.ai/models/qwen3-0.6b-instruct Who cites this page
artificialanalysis.ai
https://github.com/rasbt/LLMs-from-scratch/tree/main/ch05/11_qwen3 Who cites this page
github.com
https://huggingface.co/Qwen/Qwen3-235B-A22B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3-235B-A22B/blob/main/LICENSE Who cites this page
huggingface.co
https://arxiv.org/pdf/2505.09388 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/qwen3-235b-a22b-instruct Who cites this page
artificialanalysis.ai
https://huggingface.co/Qwen/Qwen3-30B-A3B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3-30B-A3B/blob/main/LICENSE Who cites this page
huggingface.co
https://artificialanalysis.ai/models/qwen3-30b-a3b-instruct Who cites this page
artificialanalysis.ai
https://huggingface.co/Qwen/Qwen3-32B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3-32B/blob/main/LICENSE Who cites this page
huggingface.co
https://artificialanalysis.ai/models/qwen3-32b-instruct Who cites this page
artificialanalysis.ai
https://huggingface.co/Qwen/Qwen3-4B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3-4B/blob/main/LICENSE Who cites this page
huggingface.co
https://artificialanalysis.ai/models/qwen3-4b-instruct Who cites this page
artificialanalysis.ai
https://huggingface.co/Qwen/Qwen3-8B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3-8B/blob/main/LICENSE Who cites this page
huggingface.co
https://artificialanalysis.ai/models/qwen3-8b-instruct Who cites this page
artificialanalysis.ai
https://huggingface.co/HuggingFaceTB/SmolLM3-3B-Base/blob/main/config.json Who cites this page
huggingface.co
SmolLM3: smol, multilingual, long-context reasoner Read at huggingface.co (opens in a new tab)
huggingface.co
https://huggingface.co/moonshotai/Kimi-K2-Base/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/moonshotai/Kimi-K2-Base/blame/main/LICENSE Who cites this page
huggingface.co
https://arxiv.org/pdf/2507.20534 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/kimi-k2?ref=danmackinlay.name Who cites this page
artificialanalysis.ai
https://huggingface.co/zai-org/GLM-4.5/blob/main/config.json Who cites this page
huggingface.co
https://www.arxiv.org/pdf/2508.06471 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/glm-4.5 Who cites this page
artificialanalysis.ai
https://huggingface.co/openai/gpt-oss-120b/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/openai/gpt-oss-120b/blob/main/LICENSE Who cites this page
huggingface.co
https://cdn.openai.com/pdf/419b6906-9da6-406c-a19d-1bb078ac7637/oai_gpt-oss_model_card.pdf Who cites this page
cdn.openai.com
https://artificialanalysis.ai/models/gpt-oss-120b Who cites this page
artificialanalysis.ai
https://huggingface.co/openai/gpt-oss-20b/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/openai/gpt-oss-20b/blob/main/LICENSE Who cites this page
huggingface.co
https://artificialanalysis.ai/models/gpt-oss-20b Who cites this page
artificialanalysis.ai
https://huggingface.co/google/gemma-3-270m/blob/main/config.json Who cites this page
huggingface.co
https://artificialanalysis.ai/models/gemma-3-270m Who cites this page
artificialanalysis.ai
https://huggingface.co/xai-org/grok-2/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3-Next-80B-A3B-Instruct/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3-Next-80B-A3B-Instruct/blob/main/LICENSE Who cites this page
huggingface.co
https://artificialanalysis.ai/models/qwen3-next-80b-a3b-instruct Who cites this page
artificialanalysis.ai
https://huggingface.co/MiniMaxAI/MiniMax-M2/blob/main/config.json Who cites this page
huggingface.co
https://arxiv.org/abs/2605.26494 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/minimax-m2 Who cites this page
artificialanalysis.ai
https://huggingface.co/moonshotai/Kimi-Linear-48B-A3B-Base/blob/main/config.json Who cites this page
huggingface.co
https://arxiv.org/pdf/2510.26692 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/kimi-linear-48b-a3b-instruct Who cites this page
artificialanalysis.ai
https://github.com/rasbt/LLMs-from-scratch/tree/main/ch05/13_olmo3 Who cites this page
github.com
https://huggingface.co/allenai/Olmo-3-32B-Think/blob/main/config.json Who cites this page
huggingface.co
https://arxiv.org/pdf/2512.13961 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/olmo-3-32b-think Who cites this page
artificialanalysis.ai
https://huggingface.co/allenai/Olmo-3-1025-7B/blob/main/config.json Who cites this page
huggingface.co
https://artificialanalysis.ai/models/olmo-3-7b-instruct Who cites this page
artificialanalysis.ai
https://huggingface.co/deepseek-ai/DeepSeek-V3.2/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/deepseek-ai/DeepSeek-V3.2/blob/main/LICENSE Who cites this page
huggingface.co
https://arxiv.org/pdf/2512.02556 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/deepseek-v3-2 Who cites this page
artificialanalysis.ai
https://huggingface.co/mistralai/Mistral-Large-3-675B-Instruct-2512/blob/main/params.json Who cites this page
huggingface.co
https://artificialanalysis.ai/models/mistral-large-3 Who cites this page
artificialanalysis.ai
https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16/blob/main/config.json Who cites this page
huggingface.co
https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-nemotron-open-model-license/ Who cites this page
nvidia.com
https://research.nvidia.com/labs/nemotron/files/NVIDIA-Nemotron-3-Nano-Technical-Report.pdf Who cites this page
research.nvidia.com
https://artificialanalysis.ai/models/nvidia-nemotron-3-nano-30b-a3b Who cites this page
artificialanalysis.ai
https://huggingface.co/XiaomiMiMo/MiMo-V2-Flash/blob/main/config.json Who cites this page
huggingface.co
https://arxiv.org/pdf/2601.02780 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/mimo-v2-flash Who cites this page
artificialanalysis.ai
https://huggingface.co/zai-org/GLM-4.7/blob/main/config.json Who cites this page
huggingface.co
https://artificialanalysis.ai/models/glm-4-7-non-reasoning Who cites this page
artificialanalysis.ai
https://huggingface.co/arcee-ai/Trinity-Large-Base/blob/main/config.json Who cites this page
huggingface.co
https://arxiv.org/pdf/2602.17004 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/trinity-large-thinking Who cites this page
artificialanalysis.ai
https://huggingface.co/zai-org/GLM-5/blob/main/config.json Who cites this page
huggingface.co
https://arxiv.org/pdf/2602.15763?ref=connortumbleson.com Who cites this page
arxiv.org
https://artificialanalysis.ai/models/glm-5-non-reasoning Who cites this page
artificialanalysis.ai
https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16/blob/main/config.json Who cites this page
huggingface.co
https://research.nvidia.com/labs/nemotron/files/NVIDIA-Nemotron-3-Super-Technical-Report.pdf Who cites this page
research.nvidia.com
https://artificialanalysis.ai/models/nvidia-nemotron-3-super-120b-a12b Who cites this page
artificialanalysis.ai
https://huggingface.co/google/gemma-4-31B-it/blob/main/config.json Who cites this page
huggingface.co
https://ai.google.dev/gemma/docs/core/model_card_4 Who cites this page
ai.google.dev
https://artificialanalysis.ai/models/gemma-4-31b-non-reasoning Who cites this page
artificialanalysis.ai
https://huggingface.co/google/gemma-4-26B-A4B-it/blob/main/config.json Who cites this page
huggingface.co
https://artificialanalysis.ai/models/gemma-4-26b-a4b-non-reasoning Who cites this page
artificialanalysis.ai
https://huggingface.co/google/gemma-4-12B-it/blob/main/config.json Who cites this page
huggingface.co
https://developers.googleblog.com/gemma-4-12b-the-developer-guide/ Who cites this page
developers.googleblog.com
https://artificialanalysis.ai/models/gemma-4-12b-non-reasoning Who cites this page
artificialanalysis.ai
https://huggingface.co/meta-llama/Llama-3.2-3B/blob/main/LICENSE.txt Who cites this page
huggingface.co
https://artificialanalysis.ai/models/llama-3-2-instruct-3b Who cites this page
artificialanalysis.ai
https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B-Instruct/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B-Instruct/blob/main/LICENSE Who cites this page
huggingface.co
https://artificialanalysis.ai/models/qwen3-coder-30b-a3b-instruct Who cites this page
artificialanalysis.ai
https://huggingface.co/moonshotai/Kimi-K2.5/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/moonshotai/Kimi-K2.5/blob/main/LICENSE Who cites this page
huggingface.co
https://arxiv.org/pdf/2602.02276 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/kimi-k2-5-non-reasoning Who cites this page
artificialanalysis.ai
https://huggingface.co/stepfun-ai/Step-3.5-Flash/blob/main/config.json Who cites this page
huggingface.co
https://arxiv.org/pdf/2602.10604 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/step-3-5-flash Who cites this page
artificialanalysis.ai
https://huggingface.co/Nanbeige/Nanbeige4.1-3B/blob/main/config.json Who cites this page
huggingface.co
https://arxiv.org/pdf/2602.13367 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/nanbeige4-1-3b Who cites this page
artificialanalysis.ai
https://huggingface.co/MiniMaxAI/MiniMax-M2.5/blob/main/config.json Who cites this page
huggingface.co
https://artificialanalysis.ai/models/minimax-m2-5 Who cites this page
artificialanalysis.ai
https://github.com/rasbt/LLMs-from-scratch/tree/main/ch05/15_tiny-aya Who cites this page
github.com
https://huggingface.co/CohereLabs/tiny-aya-base/blob/main/config.json Who cites this page
huggingface.co
https://arxiv.org/pdf/2603.11510 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/tiny-aya-global Who cites this page
artificialanalysis.ai
https://huggingface.co/inclusionAI/Ling-2.5-1T/blob/main/config.json Who cites this page
huggingface.co
https://github.com/rasbt/LLMs-from-scratch/tree/main/ch05/16_qwen3.5 Who cites this page
github.com
https://huggingface.co/Qwen/Qwen3.5-397B-A17B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3.5-397B-A17B/blob/main/LICENSE Who cites this page
huggingface.co
https://artificialanalysis.ai/models/qwen3-5-397b-a17b-non-reasoning Who cites this page
artificialanalysis.ai
https://huggingface.co/sarvamai/sarvam-30b/blob/main/config.json Who cites this page
huggingface.co
Open-Sourcing Sarvam 30B and 105B Read at sarvam.ai (opens in a new tab)
sarvam.ai
https://artificialanalysis.ai/models/sarvam-30b Who cites this page
artificialanalysis.ai
https://huggingface.co/sarvamai/sarvam-105b/blob/main/config.json Who cites this page
huggingface.co
https://artificialanalysis.ai/models/sarvam-105b Who cites this page
artificialanalysis.ai
https://huggingface.co/microsoft/phi-4/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/microsoft/phi-4/blob/main/LICENSE Who cites this page
huggingface.co
https://arxiv.org/pdf/2412.08905 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/phi-4 Who cites this page
artificialanalysis.ai
https://huggingface.co/NX-AI/xLSTM-7b/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/NX-AI/xLSTM-7b/blob/main/LICENSE Who cites this page
huggingface.co
https://arxiv.org/abs/2503.13427 Who cites this page
arxiv.org
https://huggingface.co/zai-org/GLM-4.5-Air/blob/main/config.json Who cites this page
huggingface.co
https://artificialanalysis.ai/models/glm-4-5-air Who cites this page
artificialanalysis.ai
https://huggingface.co/ByteDance/Ouro-2.6B-Thinking/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/ByteDance/Ouro-2.6B-Thinking/blob/main/README.md Who cites this page
huggingface.co
https://arxiv.org/abs/2510.25741 Who cites this page
arxiv.org
https://huggingface.co/PrimeIntellect/INTELLECT-3/blob/main/config.json Who cites this page
huggingface.co
https://storage.googleapis.com/intellect-3-paper/INTELLECT_3_Technical_Report.pdf Who cites this page
storage.googleapis.com
https://artificialanalysis.ai/models/intellect-3 Who cites this page
artificialanalysis.ai
https://huggingface.co/meituan-longcat/LongCat-Flash-Lite/blob/main/config.json Who cites this page
huggingface.co
https://arxiv.org/abs/2601.21204 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/longcat-flash-lite Who cites this page
artificialanalysis.ai
https://huggingface.co/mistralai/Mistral-Small-4-119B-2603/blob/main/config.json Who cites this page
huggingface.co
Introducing Mistral Small 4 Who cites this page
mistral.ai
https://artificialanalysis.ai/models/mistral-small-4 Who cites this page
artificialanalysis.ai
https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/blog/nvidia/nemotron-3-nano-4b Who cites this page
huggingface.co
https://artificialanalysis.ai/models/nvidia-nemotron-3-nano-4b Who cites this page
artificialanalysis.ai
https://huggingface.co/MiniMaxAI/MiniMax-M2.7/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/MiniMaxAI/MiniMax-M2.7/blob/main/LICENSE Who cites this page
huggingface.co
https://artificialanalysis.ai/models/minimax-m2-7 Who cites this page
artificialanalysis.ai
https://github.com/rasbt/LLMs-from-scratch/blob/main/ch05/17_gemma4/standalone-gemma4-plus-kvcache.ipynb Who cites this page
github.com
https://huggingface.co/google/gemma-4-E2B-it/blob/main/config.json Who cites this page
huggingface.co
https://artificialanalysis.ai/models/gemma-4-e2b-non-reasoning Who cites this page
artificialanalysis.ai
https://huggingface.co/google/gemma-4-E4B-it/blob/main/config.json Who cites this page
huggingface.co
https://artificialanalysis.ai/models/gemma-4-e4b-non-reasoning Who cites this page
artificialanalysis.ai
https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash/blob/main/LICENSE Who cites this page
huggingface.co
https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash/blob/main/DeepSeek_V4.pdf Who cites this page
huggingface.co
https://artificialanalysis.ai/models/deepseek-v4-flash?ref=bogdandeac.com Who cites this page
artificialanalysis.ai
https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/LICENSE Who cites this page
huggingface.co
https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/DeepSeek_V4.pdf Who cites this page
huggingface.co
https://artificialanalysis.ai/models/deepseek-v4-pro Who cites this page
artificialanalysis.ai
https://huggingface.co/poolside/Laguna-XS.2/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/poolside/Laguna-XS.2/blob/main/LICENSE.md Who cites this page
huggingface.co
https://poolside.ai/assets/laguna/laguna-m1-xs2-technical-report.pdf Who cites this page
poolside.ai
https://huggingface.co/Zyphra/ZAYA1-8B/blob/main/config.json Who cites this page
huggingface.co
https://arxiv.org/abs/2605.05365 Who cites this page
arxiv.org
https://huggingface.co/zai-org/GLM-5.1/blob/main/config.json Who cites this page
huggingface.co
https://artificialanalysis.ai/models/glm-5-1 Who cites this page
artificialanalysis.ai
https://huggingface.co/Qwen/Qwen3.6-35B-A3B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3.6-35B-A3B/blob/main/LICENSE Who cites this page
huggingface.co
https://qwen.ai/blog?id=qwen3.6-35b-a3b&ref=blog.matthewbrunelle.com Who cites this page
qwen.ai
https://artificialanalysis.ai/models/qwen3-6-35b-a3b Who cites this page
artificialanalysis.ai
https://huggingface.co/moonshotai/Kimi-K2.6/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/moonshotai/Kimi-K2.6/blob/main/LICENSE Who cites this page
huggingface.co
Kimi K2.6 Tech Blog: Advancing Open-Source Coding Read at kimi.com (opens in a new tab)
kimi.com
https://artificialanalysis.ai/models/kimi-k2-6 Who cites this page
artificialanalysis.ai
https://huggingface.co/Qwen/Qwen3.6-27B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3.6-27B/blob/main/LICENSE Who cites this page
huggingface.co
https://qwen.ai/blog?id=qwen3.6-27b Who cites this page
qwen.ai
https://artificialanalysis.ai/models/qwen3-6-27b?ref=thewatershed.markpesce.com Who cites this page
artificialanalysis.ai
https://huggingface.co/XiaomiMiMo/MiMo-V2.5/blob/main/config.json Who cites this page
huggingface.co
https://mimo.xiaomi.com/mimo-v2-5/
mimo.xiaomi.com
https://artificialanalysis.ai/models/mimo-v2-5-0424 Who cites this page
artificialanalysis.ai
https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro/blob/main/config.json Who cites this page
huggingface.co
https://artificialanalysis.ai/models/mimo-v2-5-pro Who cites this page
artificialanalysis.ai
https://huggingface.co/inclusionAI/Ling-2.6-1T/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/inclusionAI/Ling-2.6-1T Who cites this page
huggingface.co
https://artificialanalysis.ai/models/ling-2-6-1t Who cites this page
artificialanalysis.ai
https://huggingface.co/tencent/Hy3-preview/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/tencent/Hy3-preview/blob/main/LICENSE Who cites this page
huggingface.co
https://www.tencent.com/en-us/articles/2202320.html
tencent.com
https://artificialanalysis.ai/models/hy3-non-reasoning Who cites this page
artificialanalysis.ai
https://huggingface.co/ibm-granite/granite-4.1-30b/blob/main/config.json Who cites this page
huggingface.co
Granite 4.1 LLMs: How They’re Built Read at huggingface.co (opens in a new tab)
huggingface.co
https://artificialanalysis.ai/models/granite-4-1-30b/ Who cites this page
artificialanalysis.ai
https://huggingface.co/CohereLabs/command-a-plus-05-2026-w4a4/blob/main/config.json Who cites this page
huggingface.co
https://cohere.com/blog/command-a-plus?utm_source=www.soumendrak.com Who cites this page
cohere.com
https://artificialanalysis.ai/models/command-a-plus Who cites this page
artificialanalysis.ai
https://huggingface.co/LiquidAI/LFM2.5-1.2B-Thinking/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/LiquidAI/LFM2.5-1.2B-Thinking/blob/main/LICENSE Who cites this page
huggingface.co
https://www.liquid.ai/blog/lfm2-5-1-2b-thinking-on-device-reasoning-under-1gb Who cites this page
liquid.ai
https://artificialanalysis.ai/models/lfm2-5-1-2b-thinking Who cites this page
artificialanalysis.ai
https://huggingface.co/LiquidAI/LFM2.5-350M/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/LiquidAI/LFM2.5-350M/blob/main/LICENSE Who cites this page
huggingface.co
https://www.liquid.ai/blog/lfm2-5-350m-no-size-left-behind Who cites this page
liquid.ai
https://huggingface.co/LiquidAI/LFM2.5-8B-A1B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/LiquidAI/LFM2.5-8B-A1B/blob/main/LICENSE Who cites this page
huggingface.co
https://www.liquid.ai/blog/lfm2-5-8b-a1b Who cites this page
liquid.ai
https://artificialanalysis.ai/models/lfm2-5-8b-a1b Who cites this page
artificialanalysis.ai
https://huggingface.co/JetBrains/Mellum2-12B-A2.5B-Thinking/blob/main/config.json Who cites this page
huggingface.co
https://arxiv.org/abs/2605.31268 Who cites this page
arxiv.org
https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4/blob/main/config.json Who cites this page
huggingface.co
https://research.nvidia.com/labs/nemotron/files/NVIDIA-Nemotron-3-Ultra-Technical-Report.pdf Who cites this page
research.nvidia.com
https://artificialanalysis.ai/models/nvidia-nemotron-3-ultra-550b-a55b Who cites this page
artificialanalysis.ai
https://huggingface.co/CohereLabs/North-Mini-Code-1.0/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/blog/CohereLabs/introducing-north-mini-code Who cites this page
huggingface.co
https://artificialanalysis.ai/models/north-mini-code Who cites this page
artificialanalysis.ai
https://huggingface.co/moonshotai/Kimi-K2.7-Code/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/moonshotai/Kimi-K2.7-Code/blob/main/LICENSE Who cites this page
huggingface.co
https://huggingface.co/moonshotai/Kimi-K2.7-Code Who cites this page
huggingface.co
https://artificialanalysis.ai/models/kimi-k2-7-code Who cites this page
artificialanalysis.ai
https://huggingface.co/MiniMaxAI/MiniMax-M3/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/MiniMaxAI/MiniMax-M3/blob/main/LICENSE Who cites this page
huggingface.co
https://arxiv.org/abs/2606.13392 Who cites this page
arxiv.org
https://artificialanalysis.ai/models/minimax-m3 Who cites this page
artificialanalysis.ai
https://huggingface.co/WeiboAI/VibeThinker-3B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/WeiboAI/VibeThinker-3B/blob/main/LICENSE Who cites this page
huggingface.co
https://arxiv.org/abs/2606.16140 Who cites this page
arxiv.org
https://huggingface.co/zai-org/GLM-5.2/blob/main/config.json Who cites this page
huggingface.co
https://artificialanalysis.ai/models/glm-5-2 Who cites this page
artificialanalysis.ai
https://huggingface.co/poolside/Laguna-XS-2.1/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/poolside/Laguna-XS-2.1/blob/main/LICENSE.md Who cites this page
huggingface.co
https://huggingface.co/poolside/Laguna-XS-2.1 Who cites this page
huggingface.co
https://huggingface.co/Soofi-Project/Soofi-S-Base/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Soofi-Project/Soofi-S-Base Who cites this page
huggingface.co
https://arxiv.org/abs/2607.09424 Who cites this page
arxiv.org
https://huggingface.co/thinkingmachines/Inkling/blob/main/config.json Who cites this page
huggingface.co
https://www.apache.org/licenses/LICENSE-2.0 Who cites this page
apache.org
Inkling: Our Open-Weights Model Read at thinkingmachines.ai (opens in a new tab)
thinkingmachines.ai
https://huggingface.co/badtheorylabs/BTL-3/blob/main/adapter_config.json Who cites this page
huggingface.co
https://huggingface.co/badtheorylabs/BTL-3/blob/main/LICENSE Who cites this page
huggingface.co
https://huggingface.co/fdtn-ai/antares-1b/blob/main/config.json Who cites this page
huggingface.co
https://cisco-foundation-ai.github.io/antares/technical-report.pdf Who cites this page
cisco-foundation-ai.github.io
https://huggingface.co/poolside/Laguna-S-2.1/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/poolside/Laguna-S-2.1/blob/main/LICENSE.md Who cites this page
huggingface.co
https://poolside.ai/blog/introducing-laguna-s-2-1 Who cites this page
poolside.ai
https://huggingface.co/Motif-Technologies/Motif-3-Beta/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Motif-Technologies/Motif-3-Beta/blob/main/README.md Who cites this page
huggingface.co
https://artificialanalysis.ai/models/motif-0714 Who cites this page
artificialanalysis.ai
https://huggingface.co/Nanbeige/Nanbeige4.2-3B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Nanbeige/Nanbeige4.2-3B/blob/main/Nanbeige42_report.pdf Who cites this page
huggingface.co
https://huggingface.co/upstage/Solar-Open2-250B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/upstage/Solar-Open2-250B/blob/main/LICENSE Who cites this page
huggingface.co
https://huggingface.co/upstage/Solar-Open2-250B/blob/main/Solar_Open_2_Tech_Report.pdf Who cites this page
huggingface.co
https://huggingface.co/moonshotai/Kimi-K3/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/moonshotai/Kimi-K3/blob/main/LICENSE Who cites this page
huggingface.co
https://github.com/MoonshotAI/Kimi-K3/blob/main/k3_tech_report.pdf Who cites this page
github.com
https://artificialanalysis.ai/models/kimi-k3 Who cites this page
artificialanalysis.ai
https://huggingface.co/inclusionAI/Ling-3.0-flash/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/inclusionAI/Ling-3.0-flash Who cites this page
huggingface.co
https://artificialanalysis.ai/models/ling-3-0-flash Who cites this page
artificialanalysis.ai
https://huggingface.co/meta-models/Muse-Glimmer-30B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/meta-models/Muse-Glimmer-30B/blob/main/LICENSE Who cites this page
huggingface.co
https://research.meta.ai/static/muse-glimmer-methodology
research.meta.ai
https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4/blob/main/config.json Who cites this page
huggingface.co
https://openmdw.ai/license/1-1/ Who cites this page
openmdw.ai
https://huggingface.co/Qwen/Qwen3.8-27B/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3.8-27B/blob/main/LICENSE Who cites this page
huggingface.co
https://huggingface.co/ornith-ai/Ornith-1.5-35B-A3B/blob/main/config.json Who cites this page
huggingface.co
https://ornith.ai/ornith_1_5.html Who cites this page
ornith.ai
https://huggingface.co/zai-org/GLM-5.3-Flash/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/zai-org/GLM-5.3-Flash/blob/main/LICENSE Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3.8-Flash-Next/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/Qwen/Qwen3.8-Flash-Next/blob/main/LICENSE Who cites this page
huggingface.co
https://github.com/QwenLM/Qwen3.8-Flash-Next/blob/main/tech_report.pdf Who cites this page
github.com
https://artificialanalysis.ai/models/qwen3-8-flash-next Who cites this page
artificialanalysis.ai
https://huggingface.co/tencent/Hy4-preview/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/tencent/Hy4-preview/blob/main/LICENSE Who cites this page
huggingface.co
https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash/blob/main/LICENSE Who cites this page
huggingface.co
https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash/blob/main/DeepSeek_V41_Tech_Report.pdf Who cites this page
huggingface.co
https://huggingface.co/SHSLab/Step-5-Preview-BF16/blob/main/config.json Who cites this page
huggingface.co
https://www.stepfun.com/step-5-preview Who cites this page
stepfun.com
https://artificialanalysis.ai/models/step-5 Who cites this page
artificialanalysis.ai
https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL/resolve/main/MiMo_V2_6_technical_report.pdf Who cites this page
huggingface.co
https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Pro-RL/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Pro-RL/resolve/main/MiMo_V2_6_technical_report.pdf Who cites this page
huggingface.co
https://artificialanalysis.ai/models/mimo-v2-6-pro Who cites this page
artificialanalysis.ai
https://fireworks.ai/blog/ember-1 Who cites this page
fireworks.ai
https://huggingface.co/NaiveAI/Naive-N0.5-Flash/blob/main/config.json Who cites this page
huggingface.co
https://huggingface.co/NaiveAI/Naive-N0.5-Flash/blob/main/LICENSE Who cites this page
huggingface.co
https://naive.ai/en/research/
naive.ai
https://huggingface.co/Aleph-Alpha/Kolibri-1/blob/main/config.json Who cites this page
huggingface.co
https://aleph-alpha.com/downloads/tech-report.pdf Who cites this page
aleph-alpha.com
Elsewhere on sebastianraschka.com (149)
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/changelog/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/rss.xml
sebastianraschka.com
From GPT-2 to gpt-oss: Analyzing the Architectural Advances Read at magazine.sebastianraschka.com (opens in a new tab)
magazine.sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/kv-cache-calculations/
sebastianraschka.com
Multi-Head Attention (MHA) Read at sebastianraschka.com (opens in a new tab)
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=gpt-2-xl-1-5b
sebastianraschka.com
The Big LLM Architecture Comparison Read at magazine.sebastianraschka.com (opens in a new tab)
magazine.sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/aa-intelligence-index/
sebastianraschka.com
https://sebastianraschka.com/llms-from-scratch/ch04/09_rmsnorm/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/gqa/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=llama-3-8b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=llama-3-2-1b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/qk-norm/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=olmo-2-7b
sebastianraschka.com
Multi-Head Latent Attention (MLA) Read at sebastianraschka.com (opens in a new tab)
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/moe/
sebastianraschka.com
Multi-Token Prediction (MTP) Read at sebastianraschka.com (opens in a new tab)
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=deepseek-v3
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=deepseek-r1
sebastianraschka.com
Sliding Window Attention (SWA) Read at sebastianraschka.com (opens in a new tab)
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=gemma-3-27b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=mistral-small-3-1-24b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=llama-4-maverick
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=qwen3-0-6b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=qwen3-235b-a22b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=qwen3-30b-a3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=qwen3-32b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=qwen3-4b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=qwen3-8b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/nope/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=smollm3-3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=kimi-k2
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=glm-4-5-355b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=gpt-oss-120b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=gpt-oss-20b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=gemma-3-270m
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=grok-2-5-270b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/gated-attention/
sebastianraschka.com
Hybrid Attention Read at sebastianraschka.com (opens in a new tab)
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=qwen3-next-80b-a3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=minimax-m2-230b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/shortconv/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/attention-residuals/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=kimi-linear-48b-a3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=olmo-3-32b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=olmo-3-7b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/deepseek-sparse-attention/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=deepseek-v3-2
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=mistral-large-3
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=nemotron-3-nano-30b-a3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=xiaomi-mimo-v2-flash-309b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=glm-4-7-355b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=arcee-ai-trinity-large-400b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=glm-5-744b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/latent-moe/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=nemotron-3-super-120b-a12b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=gemma-4-31b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=gemma-4-26b-a4b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=gemma-4-12b
sebastianraschka.com
A Dream of Spring for Open-Weight LLMs: 10 Architectures from Jan-Feb 2026 Read at magazine.sebastianraschka.com (opens in a new tab)
magazine.sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=llama-3-2-3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=qwen3-coder-flash-30b-a3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=kimi-k2-5
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=step-3-5-flash-196b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=nanbeige-4-1-3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=minimax-m2-5-230b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=tiny-aya-3-35b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=ling-2-5-1t
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=qwen3-5-397b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=sarvam-30b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=sarvam-105b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=phi-4
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=xlstm-7b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=glm-4-5-air
sebastianraschka.com
Looped Transformer Read at sebastianraschka.com (opens in a new tab)
sebastianraschka.com
https://sebastianraschka.com/llms-from-scratch/ch04/10_rope/
sebastianraschka.com
https://sebastianraschka.com/llms-from-scratch/ch04/11_silu/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=ouro-thinking-2-6b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=intellect-3
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=longcat-flash-lite-68-5b-a3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=mistral-small-4
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=nemotron-3-nano-4b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=minimax-m2-7-230b
sebastianraschka.com
Recent Developments in LLM Architectures: KV Sharing, mHC, and Compressed Attention Read at magazine.sebastianraschka.com (opens in a new tab)
magazine.sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/kv-sharing/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/per-layer-embeddings/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=gemma-4-e2b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=gemma-4-e4b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/csa-hca/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/mhc/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=deepseek-v4-flash
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=deepseek-v4-pro
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/attention-budgeting/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=laguna-xs-2
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/compressed-convolutional-attention/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=zaya1-8b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=glm-5-1
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=qwen3-6-35b-a3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=kimi-k2-6
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=qwen3-6-27b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=xiaomi-mimo-v2-5-310b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=xiaomi-mimo-v2-5-pro-1-02t
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=ling-2-6-1t
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=tencent-hy3-preview-295b-a21b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=granite-4-1-30b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=command-a-218b-a25b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=lfm2-5-1-2b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=lfm2-5-350m
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=lfm2-5-8b-a1b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=jetbrains-mellum2-thinking-12b-a2-5b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=nemotron-3-ultra-550b-a55b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=north-mini-code-30b-a3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=kimi-k2-7-code
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=minimax-m3-428b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=vibethinker-3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/indexshare/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=glm-5-2
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=laguna-xs-2-1
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=soofi-s-30b-a3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=inkling
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=btl-3-27b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=antares-1b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=laguna-s-2-1
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/polynorm/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=motif-3-beta
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=nanbeige-4-2-3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=solar-open-2
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=kimi-k3
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=ling-3-0-flash
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=muse-glimmer-30b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=nemotron-3-5-lightning-30b-a3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=qwen3-8-27b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=ornith-1-5-35b-a3b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=glm-5-3-flash
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/qwen-sparse-attention/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/gated-residuals/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=qwen3-8-flash-next-125b-a6b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=tencent-hy4-preview-770b-a49b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=deepseek-v4-1-flash
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=step-5-preview-600b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=xiaomi-mimo-v2-6-flash-rl-309b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=xiaomi-mimo-v2-6-pro-rl-1-02t
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=ember-1
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=naive-n0-5-flash-309b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/memory-calculator/?model=kolibri-1-78b
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/active-parameter-ratio/
sebastianraschka.com
https://sebastianraschka.com/llm-architecture-gallery/attention-mechanism-distribution/
sebastianraschka.com
From DeepSeek V3 to V3.2: Architecture, Sparse Attention, and RL Updates Read at magazine.sebastianraschka.com (opens in a new tab)
magazine.sebastianraschka.com

Something wrong here? Report a problem