41554 blogs · 4,417,066 posts Claim your blog

Record · corpus.blog/posts/01a08c71-a423-7217-9d1e-76a89c17f2aa

How to fine tune and serve LLMs simply, quickly and cost effectively using Ray + DeepSpeed + HuggingFace

Anyscale · published 10 April 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at anyscale.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 16
Words captured: 2,506

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://aiascendant.substack.com/p/taiwan-is-pandora-gpus-are-unobtainium

aiascendant.substack.com

http://openai.com

openai.com

http://anthropic.com/

anthropic.com

https://cohere.ai/

cohere.ai

https://openai.com/pricing

openai.com

https://arxiv.org/pdf/2301.13188.pdf

arxiv.org

https://www.techradar.com/news/samsung-workers-leaked-company-secrets-by-using-chatgpt

techradar.com

ray.io

https://www.databricks.com/blog/2023/03/24/hello-dolly-democratizing-magic-chatgpt-open-models.html

databricks.com

https://github.com/lm-sys/FastChat

github.com

https://huggingface.co/EleutherAI/gpt-j-6b

huggingface.co

https://docs.ray.io/en/master/ray-air/examples/gptj_serving.html

docs.ray.io

https://www.deepspeed.ai/

deepspeed.ai

https://docs.ray.io/en/master/ray-air/examples/gptj_deepspeed_fine_tuning.html

docs.ray.io

https://raysummit.anyscale.com/

raysummit.anyscale.com

https://github.com/ray-project/ray-educational-materials/blob/main/NLP_workloads/Text_generation/LLM_finetuning_and_batch_inference.ipynb

github.com