corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a0875d-0d61-70ed-a496-a59235364d20

Optimizing gpt-oss-120b speed on consumer hardware

carteakey.dev · published 21 September 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at carteakey.dev Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
24
Words captured
4,878

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://github.com/carteakey/l3ms/blob/main/run-models/run-llama-cpp-gpt-oss-120b-optimized.sh
github.com
https://huggingface.co/ggml-org/gpt-oss-120b-GGUF
huggingface.co
https://www.reddit.com/r/LocalLLaMA/comments/162pgx9/what_do_yall_consider_acceptable_tokens_per/
reddit.com
https://www.reddit.com/r/LocalLLaMA/
reddit.com
Local LLM Inference Optimization: The Complete Guide Read at the source ↗
carteakey.dev
https://carteakey.dev/snippets/headless-mode-cachyos
carteakey.dev
zellij Read at the source ↗
zellij.dev
https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md
github.com
https://github.com/carteakey/lllms/blob/86e316ce4a15f4fc60ab9bb422d0fd000ba228b8/build-llama-cpp.sh
github.com
https://github.com/ggml-org/llama.cpp/blob/master/tools/server/README.md
github.com
https://github.com/ggml-org/llama.cpp/pull/15077
github.com
https://github.com/carteakey/l3ms/tree/main/bench-models
github.com
https://github.com/carteakey/l3ms
github.com
https://www.reddit.com/r/LocalLLaMA/comments/1nn72ji/comment/nfihoid
reddit.com
https://github.com/ggml-org/llama.cpp/discussions/15396
github.com
https://www.reddit.com/r/LocalLLaMA/comments/1ng0fmv/psarfc_kv_cache_quantization_forces_excess
reddit.com
https://www.reddit.com/r/LocalLLaMA/comments/1n4pt0x/topk_0_vs_100_on_gptoss120b
reddit.com
https://www.reddit.com/r/LocalLLaMA/comments/1ndit0a/1631_toksec_on_gpt_oss_120b
reddit.com
https://www.reddit.com/r/LocalLLaMA/comments/1mke7ef/120b_runs_awesome_on_just_8gb_vram
reddit.com
https://github.com/ggml-org/llama.cpp/discussions/15077
github.com
https://github.com/ggml-org/llama.cpp/discussions/9996
github.com
https://github.com/ggml-org/llama.cpp/discussions/572
github.com
https://github.com/ggml-org/llama.cpp
github.com
https://artificialanalysis.ai/methodology/intelligence-benchmarking
artificialanalysis.ai