corpus.blog
Claim your blog
Record · corpus.blog/posts/01a0fdec-2f34-70ca-8cf3-fc4523aa4866

The Path to Achieve Ultra-Low Inference Latency With LLaMA 65B on PyTorch/XLA

PyTorch Blog · published 28 June 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at pytorch.org Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
22
Words captured
2,347

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://arxiv.org/pdf/1706.03762.pdf
arxiv.org
https://ai.facebook.com/blog/large-language-model-llama-meta-ai/
ai.facebook.com
https://ai.facebook.com/
ai.facebook.com
https://openai.com/blog/gpt-3-apps
openai.com
https://arxiv.org/pdf/2203.15556.pdf?ref=bounded-regret.ghost.io
arxiv.org
https://arxiv.org/pdf/2204.02311.pdf
arxiv.org
https://arxiv.org/pdf/2302.13971.pdf
arxiv.org
https://github.com/facebookresearch/llama
github.com
https://github.com/huggingface/transformers/blob/v4.27.2/src/transformers/models/opt/modeling_opt.py
github.com
https://storage.googleapis.com/tpu-pytorch/wheels/tpuvm/torch-nightly+20230422-cp38-cp38-linux_x86_64.whl
storage.googleapis.com
https://storage.googleapis.com/tpu-pytorch/wheels/tpuvm/torch_xla-nightly+20230422-cp38-cp38-linux_x86_64.whl
storage.googleapis.com
https://github.com/pytorch-tpu/llama/tree/blog
github.com
https://github.com/facebookresearch/fairscale
github.com
https://github.com/facebookresearch/llama/blob/main/llama/model.py
github.com
https://github.com/pytorch/pytorch/issues/93173
github.com
https://arxiv.org/pdf/2306.00978.pdf
arxiv.org
https://arxiv.org/pdf/2305.12356.pdf
arxiv.org
https://arxiv.org/pdf/2304.01433.pdf
arxiv.org
https://github.com/pytorch/xla/issues/4839
github.com
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?ref=aidancooper.co.uk
huggingface.co
https://github.com/pytorch/xla
github.com
https://colab.sandbox.google.com/github/pytorch/xla/blob/master/contrib/colab/getting-started.ipynb
colab.sandbox.google.com
Elsewhere on pytorch.org (3)