corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a08c5d-81da-7162-b34c-a85fbe770e84

50+ Open-Source Options for Running LLMs Locally

vinlam.com · published 8 November 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at vinlam.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
64
Words captured
2,181

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://github.com/vince-lam/awesome-local-llms
github.com
https://github.com/nomic-ai/gpt4all
github.com
https://github.com/janhq/jan
github.com
https://twitter.com/janframework
twitter.com
https://discord.com/invite/FTk2MvZwJH
discord.com
https://jan.ai/guides
jan.ai
https://github.com/orgs/janhq/projects/5/views/16
github.com
https://github.com/janhq/jan/releases/tag/v0.4.8
github.com
https://jan.ai/guides/using-models/import-manually/
jan.ai
https://github.com/janhq/nitro/
github.com
https://github.com/h2oai/h2ogpt
github.com
https://github.com/h2oai/h2ogpt/blob/main/docs/README_LangChain.md
github.com
https://gpt.h2o.ai/
gpt.h2o.ai
https://github.com/h2oai/h2ogpt/blob/main/README.md
github.com
https://github.com/Bin-Huang/chatbox
github.com
https://github.com/Mintplex-Labs/anything-llm
github.com
https://github.com/joaomdmoura/crewAI
github.com
https://microsoft.github.io/autogen/
microsoft.github.io
https://github.com/ggerganov/llama.cpp
github.com
https://github.com/ggerganov/ggml/blob/master/docs/gguf.md
github.com
https://github.com/haotian-liu/LLaVA
github.com
https://github.com/abetlen/llama-cpp-python
github.com
https://github.com/ggerganov/llama.cpp?tab=readme-ov-file
github.com
https://huggingface.co/docs/hub/en/models-downloading
huggingface.co
https://github.com/ollama/ollama
github.com
https://github.com/ollama/ollama?tab=readme-ov-file
github.com
https://github.com/ollama/ollama/blob/main/README.md
github.com
https://github.com/ollama/ollama/blob/main/docs/faq.md
github.com
https://github.com/huggingface/transformers
github.com
https://github.com/mlc-ai/mlc-llm
github.com
https://github.com/vllm-project/vllm
github.com
https://github.com/Mozilla-Ocho/llamafile
github.com
https://github.com/LostRuins/koboldcpp
github.com
https://github.com/turboderp/exllamav2
github.com
https://github.com/simonw/llm
github.com
https://openwebui.com/
openwebui.com
https://docs.openwebui.com/
docs.openwebui.com
https://github.com/ollama-webui/ollama-webui
github.com
https://github.com/open-webui/open-webui
github.com
https://chat-preview.lobehub.com/welcome
chat-preview.lobehub.com
https://github.com/lobehub/lobe-chat/
github.com
https://chat-docs.lobehub.com/en/usage/features/local-llm
chat-docs.lobehub.com
https://github.com/oobabooga/text-generation-webui
github.com
https://github.com/oobabooga/text-generation-webui/wiki
github.com
https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web
github.com
https://github.com/imartinez/privateGPT
github.com
https://github.com/lobehub/lobe-chat
github.com
https://github.com/PromtEngineer/localGPT
github.com
https://github.com/mudler/LocalAI
github.com
https://github.com/danny-avila/LibreChat
github.com
https://github.com/nat/openplayground
github.com
https://github.com/huggingface/chat-ui
github.com
https://github.com/SillyTavern/SillyTavern
github.com
OpenAI compatibility Read at the source ↗
ollama.com
https://continue.dev/
continue.dev
https://jan.ai/docs/local-models/ollama
jan.ai
https://medium.com/@vince-lam
medium.com
https://buymeacoffee.com/vincelam
buymeacoffee.com
https://codellama.h2o.ai/
codellama.h2o.ai
https://ollama.ai/library
ollama.ai
https://github.com/janhq/awesome-local-ai
github.com
https://www.reddit.com/r/LocalLLaMA/
reddit.com
https://huyenchip.com/2024/03/14/ai-oss.html
huyenchip.com
https://huyenchip.com/llama-police
huyenchip.com