corpus.blog
Claim your blog
Record · corpus.blog/posts/01a08756-3778-70f6-8656-6855042608ee

A system programmer’s guide to LLM inference

blog.xiangpeng.systems · published 8 June 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at blog.xiangpeng.systems Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
21
Words captured
6,910

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://www.bauplanlabs.com
bauplanlabs.com
https://spiraldb.com
spiraldb.com
https://huggingface.co/unsloth/Qwen3.6-35B-A3B-MTP-GGUF
huggingface.co
Qwen Team Open-Sources Qwen3.6-35B-A3B: A Sparse MoE Vision-Language Model with 3B Active Parameters and Agentic Coding Capabilities
marktechpost.com
https://en.wikipedia.org/wiki/Qwen
en.wikipedia.org
https://github.com/ggml-org/llama.cpp/wiki/Tensor-Encoding-Schemes
github.com
https://unsloth.ai/docs/basics/unsloth-dynamic-2.0-ggufs
unsloth.ai
https://huggingface.co/docs/safetensors/index?ref=abacusnoir.com
huggingface.co
https://github.com/ggml-org/ggml/blob/master/docs/gguf.md
github.com
https://huggingface.co/Qwen/Qwen3-Next-80B-A3B-Instruct
huggingface.co
The Big LLM Architecture Comparison Read at the source ↗
magazine.sebastianraschka.com
https://vllm.ai/blog/2025-09-11-qwen3-next
vllm.ai
https://apxml.com/models/qwen36-35b-a3b
apxml.com
https://huggingface.co/Qwen/Qwen3.6-35B-A3B
huggingface.co
https://simonwillison.net/2026/Apr/20/claude-token-counts/
simonwillison.net
https://en.wikipedia.org/wiki/Byte_pair_encoding
en.wikipedia.org
https://vucense.com/dev-corner/gguf-quantization-explained-q4-k-m-vs-q8-0-vs-f16-2026/
vucense.com
https://en.wikipedia.org/wiki/Bfloat16_floating-point_format
en.wikipedia.org
https://en.wikichip.org/wiki/x86/avx512_vnni
en.wikichip.org
https://developer.arm.com/architectures/instruction-sets/intrinsics/vusdotq_s32
developer.arm.com
https://deepwiki.com/ggml-org/llama.cpp/6.3-quantization-techniques
deepwiki.com