41554 blogs · 4,417,066 posts Claim your blog

Record · corpus.blog/posts/01a08c57-e257-70a7-8f3f-2d143a329aff

Fine tune Mistral 7B with the RTX 4090 and serve it with Nx

toranbillups.com · published 21 October 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at toranbillups.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 16
Words captured: 843

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://hexdocs.pm/bumblebee/fine_tuning.html

hexdocs.pm

https://huggingface.co/mistralai/Mistral-7B-v0.1

huggingface.co

https://github.com/Lightning-AI/lit-gpt

github.com

https://github.com/Lightning-AI/lit-gpt/blob/main/tutorials/download_mistral.md

github.com

https://toranbillups.com/blog/archive/2023/10/15/fine-tune-llama-2-and-serve-with-nx/

toranbillups.com

https://huggingface.co/jondurbin/airoboros-m-7b-3.1.2

huggingface.co

https://pypi.org/project/mathjson-solver/

pypi.org

https://www.nvidia.com/en-us/geforce/graphics-cards/40-series/rtx-4090/

nvidia.com

https://huggingface.co

huggingface.co

https://github.com/toranb/pgvector-search/blob/mistral7b/lib/search/application.ex

github.com

https://github.com/toranb/pgvector-search/blob/mistral7b/lib/search_web/live/page_live.ex

github.com

https://hexdocs.pm/nx/Nx.Serving.html

hexdocs.pm

https://twitter.com/jon_durbin

twitter.com

https://huggingface.co/datasets/jondurbin/airoboros-3.1/viewer/default/train?q=math+json&row=402

huggingface.co

https://twitter.com/sean_moriarity/

twitter.com

https://github.com/elixir-nx/bumblebee/pull/264

github.com