corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a0d80b-3bc5-739f-8e85-32793f448325

Custom Models in Oh My Pi: vLLM, llama.cpp, SGLang and More

doug.sh · published 23 September 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at doug.sh Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
14
Words captured
2,315

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
Tuning a Local Coding Agent: Oh My Pi and Qwen3.8-27B on Two RTX 3090s Read at the source ↗
doug.sh
https://github.com/alphastorm/omp-ninfer
github.com
https://github.com/maximhq/bifrost
github.com
https://github.com/can1357/oh-my-pi/releases/tag/v18.2.7
github.com
https://github.com/can1357/oh-my-pi/releases/tag/v18.3.0
github.com
https://github.com/can1357/oh-my-pi/blob/v18.3.0/docs/models.md
github.com
https://github.com/can1357/oh-my-pi/blob/v18.3.0/docs/settings.md
github.com
https://github.com/can1357/oh-my-pi/blob/v18.3.0/docs/environment-variables.md
github.com
https://github.com/can1357/oh-my-pi/blob/v18.3.0/packages/catalog/src/compat/rules/classes/qwen.kdl
github.com
https://github.com/can1357/oh-my-pi/blob/v18.3.0/packages/catalog/src/compat/rules/providers/llama.cpp.kdl
github.com
https://github.com/can1357/oh-my-pi/blob/v18.3.0/packages/catalog/src/compat/rules/providers/local.kdl
github.com
https://docs.sglang.io/docs/advanced_features/server_arguments
docs.sglang.io
https://lemonade-server.ai/docs/api/openai/
lemonade-server.ai
https://github.com/Neroued/ninfer/blob/master/docs/serving.md
github.com