Record · corpus.blog/posts/01a0875f-dd24-728a-8d3b-06047fd4c0cb

Running Open Source LLMs In Python - A Practical Guide

christophergs.com · published 21 January 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at christophergs.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
External links: 24
Words captured: 4,278

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://github.com/ggerganov/llama.cpp

github.com

https://github.com/vllm-project/vllm

github.com

https://ollama.ai/

ollama.ai

https://lmstudio.ai/

lmstudio.ai

https://llama-cpp-python.readthedocs.io/

llama-cpp-python.readthedocs.io

https://github.com/ggerganov

github.com

https://github.com/ggerganov/ggml

github.com

https://github.com/ggerganov/llama.cpp?tab=readme-ov-file

github.com

https://medium.com/@gonchogo/how-to-install-llama-cpp-with-cuda-on-windows-05008d14f603

medium.com

https://huggingface.com

huggingface.com

https://github.com/ggerganov/ggml/blob/master/docs/gguf.md

github.com

https://huggingface.co/TheBloke/Mixtral-8x7B-Instruct-v0.1-GGUF

huggingface.co

https://huggingface.co/TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

huggingface.co

https://chat.lmsys.org/

chat.lmsys.org

Mixtral of experts

mistral.ai

https://huggingface.co/meta-llama/Llama-2-7b

huggingface.co

https://huggingface.co/docs/huggingface_hub/guides/cli

huggingface.co

https://stackoverflow.com/questions/32855927/how-does-call-actually-work

stackoverflow.com

https://www.saxifrage.xyz/post/prompt-engineering

saxifrage.xyz

https://github.com/abetlen/llama-cpp-python/blob/main/llama_cpp/llama_chat_format.py

github.com

https://www.reddit.com/r/LocalLLaMA/comments/18ljvxb/llm_prompt_format_comparisontest_mixtral_8x7b

reddit.com

https://jinja.palletsprojects.com/en/3.1.x/

jinja.palletsprojects.com

https://github.com/ggerganov/llama.cpp/blob/master/grammars/README.md

github.com

https://www.latent.space/p/idefics

latent.space