corpus.blog
Claim your blog
Record · corpus.blog/posts/01a08750-7005-7060-aafe-173668b6a280

Setting Up a Local LLM

Miloslav Homer - Miloslav Homer · published 16 December 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at blog.miloslavhomer.cz Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
109
Words captured
4,239

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://www.videocardbenchmark.net/gpu.php?gpu=GeForce+GTX+1050+Ti&id=3595
videocardbenchmark.net
https://developer.nvidia.com/cuda-legacy-gpus
developer.nvidia.com
https://docs.nvidia.com/cuda/
docs.nvidia.com
https://pytorch.org/
pytorch.org
https://github.com/ggml-org/ggml
github.com
https://ollama.com
ollama.com
https://flipper.prose.sh/ollama
flipper.prose.sh
https://openwebui.com/
openwebui.com
https://www.wireguard.com/quickstart/
wireguard.com
https://github.com/leejet/stable-diffusion.cpp/tree/master
github.com
https://huggingface.co/silveroxides/Chroma-GGUF
huggingface.co
https://www.debian.org/releases/trixie/
debian.org
https://www.xfce.org/
xfce.org
https://wiki.debian.org/NvidiaGraphicsDrivers
wiki.debian.org
https://docs.nvidia.com/cuda/cuda-installation-guide-linux/
docs.nvidia.com
https://jamesakl.com/posts/cuda-ontology/
jamesakl.com
https://www.reddit.com/r/learnmachinelearning/comments/1dz7w1y/what_exactly_are_parameters/
reddit.com
https://www.datacamp.com/tutorial/quantization-for-large-language-models
datacamp.com
https://www.hyperstack.cloud/blog/case-study/how-much-vram-do-you-need-for-llms
hyperstack.cloud
https://huggingface.co/docs/transformers/index
huggingface.co
https://huggingface.co/mistralai/Mistral-7B-v0.1
huggingface.co
Introducing Mistral 3
mistral.ai
https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct
huggingface.co
https://huggingface.co/Qwen/Qwen3-8B
huggingface.co
https://huggingface.co/Qwen/Qwen2.5-7B
huggingface.co
https://huggingface.co/Qwen/Qwen2.5-7B-Instruct
huggingface.co
https://huggingface.co/deepseek-ai/DeepSeek-R1-0528-Qwen3-8B?ref=danmackinlay.name
huggingface.co
https://www.datacamp.com/blog/distillation-llm
datacamp.com
https://huggingface.co/tiiuae/Falcon3-7B-Instruct
huggingface.co
https://huggingface.co/google/gemma-2-9b
huggingface.co
https://huggingface.co/collections/HuggingFaceTB/smollm
huggingface.co
https://ollama.com/library/llava
ollama.com
https://ollama.com/search?c=embedding
ollama.com
https://huggingface.co/meta-llama/Llama-Prompt-Guard-2-22M
huggingface.co
https://www.evidentlyai.com/llm-guide/llm-benchmarks
evidentlyai.com
https://www.reddit.com/r/singularity/comments/1lx8p1j/heres_a_list_of_llm_benchmarks_because_why_not/
reddit.com
https://scale.com/leaderboard/humanitys_last_exam
scale.com
https://www.forecastbench.org/leaderboards/human_leaderboard_overall.html?ref=foxy-scout.com
forecastbench.org
https://ollama.com/library/gemma3
ollama.com
https://docs.openwebui.com/
docs.openwebui.com
https://www.librechat.ai/
librechat.ai
https://www.reddit.com/r/selfhosted/comments/1jltdjq/openwebui_vs_librechat/
reddit.com
https://stackoverflow.com/questions/52731543/how-can-i-properly-use-pyenv-and-venv
stackoverflow.com
https://github.com/pgvector/pgvector
github.com
https://docs.sqlalchemy.org/en/20/core/engines.html
docs.sqlalchemy.org
https://docs.openwebui.com/getting-started/env-configuration
docs.openwebui.com
https://pyodide.org/en/stable/
pyodide.org
https://github.com/AIXerum/faster-whisper
github.com
https://github.com/ollama/ollama
github.com
https://pkg.go.dev/cmd/cgo
pkg.go.dev
Calling C code from go Read at the source ↗
karthikkaranth.me
https://tensorflow.org/
tensorflow.org
Introduction to ggml Read at the source ↗
huggingface.co
https://github.com/ggml-org/llama.cpp/issues/10157
github.com
https://docs.ollama.com/import
docs.ollama.com
https://huggingface.co/
huggingface.co
https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct/tree/main
huggingface.co
https://huggingface.co/docs/hub/en/ollama
huggingface.co
https://github.com/ollama/ollama/blob/main/go.mod
github.com
https://github.com/TheTitanrain/w32
github.com
https://github.com/gabriel-vasile
github.com
https://github.com/bytedance/sonic
github.com
https://github.com/cloudwego
github.com
https://github.com/search?q=repo%3Abytedance%2Fsonic++language%3AAssembly&type=code&p=1
github.com
https://github.com/bytedance/sonic/commit/fbe08281903b2334909bcae6f3ddb954056c6be4
github.com
https://firecrawl.dev
firecrawl.dev
https://www.langchain.com/
langchain.com
https://github.com/triton-lang/triton
github.com
https://pypi.org/project/colbert-ai/
pypi.org
https://github.com/huggingface/sentence-transformers
github.com
https://github.com/RapidAI/RapidOCR
github.com
https://github.com/microsoft/SpeechT5
github.com
http://www.festvox.org/cmu_arctic/
festvox.org
https://github.com/leejet/stable-diffusion.cpp
github.com
https://github.com/imanoop7/Ollama-OCR
github.com
https://huggingface.co/silveroxides/Chroma-GGUF?show_file_info=chroma-unlocked-v37%2Fchroma-unlocked-v37-Q2_K-marduk191.gguf
huggingface.co
https://huggingface.co/comfyanonymous/flux_text_encoders
huggingface.co
https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/ae.safetensors
huggingface.co
https://www.reddit.com/r/StableDiffusion/comments/z6y6n4/whats_a_vae/
reddit.com
https://github.com/leejet/stable-diffusion.cpp/blob/master/docs/chroma.md
github.com
https://github.com/xetdata/xet-core
github.com
https://git-lfs.com/
git-lfs.com
https://github.com/ggml-org/llama.cpp/discussions/12513
github.com
https://github.com/ggml-org/llama.cpp/discussions/11989
github.com
https://huggingface.co/mistralai/Ministral-3-8B-Instruct-2512/blob/main/config.json
huggingface.co
https://huggingface.co/mistralai/Ministral-3-8B-Base-2512
huggingface.co
https://huggingface.co/mistralai/Ministral-3-8B-Reasoning-2512
huggingface.co
https://huggingface.co/mistralai/Ministral-3-8B-Reasoning-2512/blob/main/SYSTEM_PROMPT.txt
huggingface.co
https://huggingface.co/mistralai/Ministral-3-8B-Reasoning-2512/blob/main/chat_template.jinja
huggingface.co
https://docs.ollama.com/modelfile
docs.ollama.com
https://pkg.go.dev/text/template
pkg.go.dev
https://ollama.com/library/ministral-3?ref=thomasvitale.com
ollama.com
https://www.reddit.com/r/LocalLLaMA/comments/1dm2jm2/why_cant_ollama_just_run_ggfu_models_directly/
reddit.com
https://huggingface.co/ggml-org/SmolLM3-3B-GGUF/blob/main/SmolLM3-Q4_K_M.gguf
huggingface.co
https://scale.com/leaderboard/mask
scale.com
https://www.virologytest.ai/
virologytest.ai
https://livebench.ai/
livebench.ai
https://livecodebenchpro.com/
livecodebenchpro.com
https://aider.chat/docs/leaderboards/
aider.chat
https://cybench.github.io/
cybench.github.io
https://arcprize.org/leaderboard
arcprize.org
https://geobench.org/
geobench.org
https://videommmu.github.io/
videommmu.github.io
https://balrogai.com/
balrogai.com
https://github.com/vectara/hallucination-leaderboard?tab=readme-ov-file
github.com
https://lechmazur.github.io/leaderboard1.html
lechmazur.github.io
https://cbrower.dev/vpct
cbrower.dev
https://andonlabs.com/evals/vending-bench
andonlabs.com
https://simple-bench.com/
simple-bench.com
Elsewhere on blog.miloslavhomer.cz (1)