Record · corpus.blog/posts/01a0c534-6286-73e6-b0cf-8e2b3f9901af

augmenting a containerized large language model (LLM) with text files for context

graphthinking.blogspot.com · published 26 December 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at graphthinking.blogspot.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 49
Words captured: 1,914

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

small offline large language model -- TinyChatEngine from MIT's Han lab Read at the source ↗

graphthinking.blogspot.com

https://news.ycombinator.com/item?id=38678773

news.ycombinator.com

Mistral 7B LLM (5.6GB) with llama.cpp in a Docker image Read at the source ↗

graphthinking.blogspot.com

https://news.ycombinator.com/item?id=38759877

news.ycombinator.com

https://ai.google/discover/palm2/

ai.google

https://arxiv.org/abs/2108.07258

arxiv.org

https://arxiv.org/abs/2312.10997

arxiv.org

https://arxiv.org/abs/2305.14314

arxiv.org

https://colab.research.google.com/drive/1PEQyJO1-f6j0S_XJ8DV50NkpzasXkrzd?usp=sharing

colab.research.google.com

https://arxiv.org/abs/2005.11401v4

arxiv.org

https://docs.nvidia.com/ai-enterprise/workflows-generative-ai/0.1.0/technical-brief.html

docs.nvidia.com

https://blog.langchain.dev/tutorial-chatgpt-over-your-data/

blog.langchain.dev

https://python.langchain.com/docs/modules/data_connection/document_loaders/

python.langchain.com

https://www.reddit.com/r/LangChain/comments/15q5jzv/how_should_i_chunk_text_from_a_textbook_for_the/

reddit.com

https://qdrant.tech/

qdrant.tech

https://python.langchain.com/docs/use_cases/question_answering/local_retrieval_qa

python.langchain.com

https://python.langchain.com/docs/modules/data_connection/vectorstores/

python.langchain.com

https://news.ycombinator.com/item?id=38760430

news.ycombinator.com

https://github.com/run-llama/llama_index

github.com

https://docs.llamaindex.ai/en/stable/examples/low_level/oss_ingestion_retrieval.html

docs.llamaindex.ai

https://docs.llamaindex.ai/en/latest/examples/low_level/ingestion.html

docs.llamaindex.ai

https://news.ycombinator.com/item?id=38764186

news.ycombinator.com

https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF

huggingface.co

https://github.com/ggerganov/llama.cpp

github.com

https://github.com/facebookresearch/faiss

github.com

https://www.reddit.com/r/LocalLLaMA/comments/16cbimi/yet_another_rag_system_implementation_details_and/

reddit.com

https://semaphoreci.com/blog/local-llm

semaphoreci.com

https://github.com/facebookresearch/llama-recipes/?tab=readme-ov-file

github.com

Llama 2 is here - get it on Hugging Face Read at the source ↗

huggingface.co

https://www.promptingguide.ai/techniques/rag

promptingguide.ai

https://blogs.nvidia.com/blog/what-is-retrieval-augmented-generation/

blogs.nvidia.com

https://ai.meta.com/blog/retrieval-augmented-generation-streamlining-the-creation-of-intelligent-natural-language-processing-models/

ai.meta.com

Chunking Strategies for LLM Applications Read at the source ↗

pinecone.io

https://github.com/google/sentencepiece

github.com

https://www.sbert.net/index.html

sbert.net

https://github.com/facebookresearch/faiss/wiki/Getting-started

github.com

https://www.trychroma.com/

trychroma.com

https://docs.trychroma.com/telemetry

docs.trychroma.com

https://notebooklm.google/

notebooklm.google

https://ollama.ai/blog/ollama-is-now-available-as-an-official-docker-image

ollama.ai

https://hub.docker.com/r/ollama/ollama

hub.docker.com

https://github.com/jmorganca/ollama

github.com

https://medium.com/@thakermadhav/build-your-own-rag-with-mistral-7b-and-langchain-97d0c92fa146

medium.com

https://medium.com/@rubentak/talk-to-your-files-in-a-local-rag-application-using-mistral-7b-langchain-and-chroma-db-no-2b4ba77358e0

medium.com

https://www.llamaindex.ai/

llamaindex.ai

https://github.com/pgvector/pgvector

github.com

https://github.com/imartinez/privateGPT

github.com

https://github.com/PromtEngineer/localGPT

github.com

https://www.reddit.com/r/LocalLLaMA/

reddit.com