corpus.blog
41,554 blogs · 5,038,968 posts Claim your blog
Record · corpus.blog/posts/01a0d036-4fab-739c-9607-079d084755ca

How is LLaMa.cpp possible?

Finbarr Timbers · published 16 March 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at finbarr.ca Wayback capture
5blogs citing
First cited
19 Oct 2023
Most recent
26 Aug 2026
Rank this month
not ranked
External links
20
Words captured
1,442

Cited by

Blog
In the post
Date
LangChain
Using LangSmith to Support Fine-tuning Read at the source ↗
26 Aug 2026
nravic.com
2023 Reading Retrospective Read at the source ↗
1 Jan 2024
chsasank.com
Hardware Design for LLM Inference: Von Neumann Bottleneck Read at the source ↗
30 Dec 2023
kipply
Things Read | Sept/Oct 2023 Read at the source ↗
2 Nov 2023
openml.fyi
Ghosts in the machine Read at the source ↗
19 Oct 2023

Links from this post

Link
Host
https://finbarrtimbers.substack.com/
finbarrtimbers.substack.com
https://github.com/ggerganov/llama.cpp
github.com
https://github.com/facebookresearch/llama
github.com
https://twitter.com/rgerganov/status/1635604465603473408
twitter.com
https://simonwillison.net/2023/Mar/11/llama/
simonwillison.net
https://twitter.com/miolini/status/1634982361757790209
twitter.com
https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf
nvidia.com
https://images.nvidia.com/aem-dam/Solutions/geforce/ada/ada-lovelace-architecture/nvidia-ada-gpu-architecture-whitepaper-1.03.pdf
images.nvidia.com
https://kipp.ly/blog/transformer-inference-arithmetic/
kipp.ly
https://kipp.ly/blog/transformer-param-count/
kipp.ly
https://www.macworld.com/article/783678/m2-vs-m1-chip-performance-graphics-ram.html
macworld.com
https://tlkh.dev/benchmarking-the-apple-m1-max
tlkh.dev
https://web.eece.maine.edu/~vweaver/group/green_machines.html
web.eece.maine.edu
https://forums.raspberrypi.com/viewtopic.php?t=281183
forums.raspberrypi.com
Large Transformer Model Inference Optimization Read at the source ↗
lilianweng.github.io
https://arxiv.org/abs/2009.06732
arxiv.org
https://twitter.com/kaushikpatnaik?lang=en
twitter.com
https://twitter.com/arthurallshire
twitter.com
https://twitter.com/stanislavfort
twitter.com
https://twitter.com/banburismus_
twitter.com
Elsewhere on finbarr.ca (1)