corpus.blog
41554 blogs · 4,450,554 posts Claim your blog
Record · corpus.blog/posts/01a0d8d5-10ea-7048-aa79-0396657626dc

Transformers now runs llama.cpp quants

Hugging Face · published 22 September 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at huggingface.co Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
36
Words captured
2,489

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://github.com/ggml-org/llama.cpp
github.com
https://github.com/ml-explore/mlx
github.com
https://x.com/huggingface?ref_src=twsrc%5Etfw
x.com
https://t.co/lsIxLoUneU
t.co
https://x.com/julien_c/status/2047647522173104145?ref_src=twsrc%5Etfw
x.com
https://huggingface.co/ggml-org
huggingface.co
https://huggingface.co/unsloth
huggingface.co
https://huggingface.co/lmstudio-community
huggingface.co
https://huggingface.co/bartowski
huggingface.co
https://huggingface.co/docs/kernels/index
huggingface.co
https://github.com/ggml-org/ggml/blob/master/docs/gguf.md
github.com
https://huggingface.co/unsloth/Qwen3.5-4B-GGUF/tree/main
huggingface.co
https://huggingface.co/docs/hub/gguf
huggingface.co
https://huggingface.co/kernels/ggml-org/ggml-quantization
huggingface.co
https://huggingface.co/docs/transformers/main/en/quantization/gguf
huggingface.co
https://huggingface.co/docs/transformers/main/en/serve-cli/serving
huggingface.co
https://www.jan.ai/docs/desktop/remote-models/custom-endpoint
jan.ai
https://pi.dev
pi.dev
https://github.com/ggml-org/llama.cpp/tree/master/tools/llama-bench
github.com
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/transformers-llama-cpp-quants/benchmark-comparison.svg
huggingface.co
GGML and llama.cpp join HF to ensure the long-term progress of Local AI Read at the source ↗
huggingface.co
https://huggingface.co/kernels/ggml-org/ggml-norm
huggingface.co
https://huggingface.co/kernels/ggml-org/ggml-attn
huggingface.co
https://huggingface.co/kernels/ggml-org/ggml-gated-delta-net
huggingface.co
https://huggingface.co/kernels/transformers-community/topk
huggingface.co
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/transformers-llama-cpp-quants/layer-kernel-benchmark.svg
huggingface.co
https://github.com/huggingface/transformers/pull/48814
github.com
https://github.com/huggingface/transformers/pull/47975
github.com
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/transformers-llama-cpp-quants/generation-loop-benchmark.svg
huggingface.co
https://github.com/huggingface/transformers/issues
github.com
https://huggingface.co/ArthurZ
huggingface.co
https://huggingface.co/cyrilvallez
huggingface.co
https://huggingface.co/sayakpaul
huggingface.co
https://huggingface.co/ariG23498
huggingface.co
https://huggingface.co/pcuenq
huggingface.co
https://huggingface.co/lysandre
huggingface.co