corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a08c61-5d65-7392-9e8e-40fabb31febd

Running AI Models on Your PC: A Guide to Local Large Language Models (LLMs)

Weisser Zwerg · published 2 November 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at weisser-zwerg.dev Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
50
Words captured
3,214

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://www.deeplearning.ai/the-batch/alibaba-releases-qwen-2-5-models-raising-the-bar-for-open-weight-llms/
deeplearning.ai
https://www.nvidia.com/en-ph/geforce/products/10series/geforce-gtx-1080
nvidia.com
https://docs.anaconda.com/miniconda/miniconda-install
docs.anaconda.com
https://stackoverflow.com/questions/77030544/how-do-i-increase-the-cell-width-of-the-jupyter-version-7
stackoverflow.com
https://huggingface.co/Qwen
huggingface.co
https://huggingface.co
huggingface.co
Which Quantization Method is Right for You? (GPTQ vs. GGUF vs. AWQ) Read at the source ↗
newsletter.maartengrootendorst.com
https://blog.demofox.org/2017/11/21/floating-point-precision
blog.demofox.org
https://en.wikipedia.org/wiki/Stochastic_gradient_descent
en.wikipedia.org
https://www.nomic.ai/gpt4all
nomic.ai
https://ollama.com
ollama.com
https://huggingface.co/bartowski/Qwen2.5-7B-Instruct-GGUF
huggingface.co
https://huggingface.co/bartowski/Qwen2.5-7B-Instruct-GGUF/blob/main/Qwen2.5-7B-Instruct-Q5_K_L.gguf
huggingface.co
https://github.com/ggerganov/llama.cpp
github.com
https://www.nomic.ai
nomic.ai
https://docs.gpt4all.io/
docs.gpt4all.io
https://docs.gpt4all.io/gpt4all_desktop/quickstart.html
docs.gpt4all.io
https://www.heise.de/select/ix/2023/10/2322914442478696032
heise.de
https://www.mercity.ai/blog-post/guide-to-fine-tuning-llms-with-lora-and-qlora
mercity.ai
https://course19.fast.ai/videos/?lesson=4
course19.fast.ai
https://www.fast.ai
fast.ai
https://docs.gpt4all.io/gpt4all_desktop/localdocs.html
docs.gpt4all.io
https://docs.gpt4all.io/gpt4all_api_server/home.html
docs.gpt4all.io
OpenAI compatibility Read at the source ↗
ollama.com
https://github.com/open-webui/open-webui
github.com
https://massedcompute.com
massedcompute.com
https://docs.openwebui.com
docs.openwebui.com
https://dev.to/best_codes/5-best-ai-models-you-can-run-locally-on-your-device-475h
dev.to
https://llm.extractum.io/
llm.extractum.io
https://www.amazon.de/Razer-Externes-Grafikkarten-Geh%C3%A4use-Thunderbolt/dp/B07D4NBPBC
amazon.de
https://www.amazon.de/SoNNeT-Breakaway-750ex-Graka-GPU-750WEX-TB3/dp/B08Q755RQS
amazon.de
Generative AI using eGPU on Slackware Linux Read at the source ↗
tumfatig.net
https://www.youtube.com/@fahdmirza/videos
youtube.com
https://www.youtube.com/watch?v=r8D_fV3LGwc
youtube.com
https://www.youtube.com/watch?v=boOqdylKx28
youtube.com
https://www.youtube.com/watch?v=lN_0PTMvbvM
youtube.com
https://www.youtube.com/watch?v=K6jcXivindU
youtube.com
https://www.youtube.com/watch?v=yLAIWsb5-ls
youtube.com
https://www.youtube.com/watch?v=6ZCHwKzBd7o
youtube.com
https://www.youtube.com/watch?v=O3ATShq2PG8
youtube.com
https://llmshowdown.vercel.app/
llmshowdown.vercel.app
https://whatllm.vercel.app
whatllm.vercel.app
https://artificialanalysis.ai/
artificialanalysis.ai
https://deepinfra.com/pricing
deepinfra.com
https://www.youtube.com/watch?v=lrBapVo3OmU
youtube.com
https://www.youtube.com/@skillcurb/videos
youtube.com
https://www.youtube.com/watch?v=FosFd0w9yt8
youtube.com
https://massedcompute.com/about-us
massedcompute.com
https://www.together.ai/products
together.ai
https://towardsdatascience.com/how-to-set-up-anaconda-and-jupyter-notebook-the-right-way-de3b7623ea4a
towardsdatascience.com