Record · corpus.blog/posts/01a0878a-1fbc-707e-95fc-edbe4426da6d

llama2 in Rust, with Metal and Rayon

jakub-m.github.io · published 25 October 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at jakub-m.github.io Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
External links: 31
Words captured: 1,069

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://github.com/jakub-m/llama2-rs

github.com

https://github.com/karpathy/llama2.c

github.com

https://github.com/rayon-rs/rayon

github.com

https://huggingface.co/datasets/roneneldan/TinyStories

huggingface.co

https://mermaid.live/edit

mermaid.live

https://docs.rs/memmap2/latest/memmap2/

docs.rs

https://doc.rust-lang.org/core/arch/aarch64/fn.vfma_n_f32.html

doc.rust-lang.org

https://developer.arm.com/architectures/instruction-sets/intrinsics/vfma_n_f32

developer.arm.com

https://developer.arm.com/documentation/ddi0602/2025-06/SIMD-FP-Instructions/FMUL--by-element---Floating-point-multiply--by-element--

developer.arm.com

https://docs.rs/rayon/1.11.0/rayon/iter/index.html

docs.rs

https://mermaid.live

mermaid.live

https://crates.io/crates/cargo-instruments

crates.io

https://github.com/jakub-m/llama2-rs/blob/047c73611a65fdbcf7f61cf1d019c557800280e9/Makefile

github.com

https://github.com/jakub-m/llama2-rs/blob/047c73611a65fdbcf7f61cf1d019c557800280e9/Cargo.toml

github.com

https://github.com/jakub-m/llama2-rs/commit/44fce5a

github.com

https://docs.rs/rayon/latest/rayon/iter/trait.ParallelBridge.html

docs.rs

https://github.com/jakub-m/llama2-rs/commit/f4d9041

github.com

https://github.com/jakub-m/llama2-rs/commit/8eda5d5

github.com

https://docs.rs/rayon/1.11.0/rayon/iter/trait.IndexedParallelIterator.html

docs.rs

https://github.com/jakub-m/llama2-rs/commit/b596ff4

github.com

https://doc.rust-lang.org/std/thread/fn.available_parallelism.html

doc.rust-lang.org

https://github.com/jakub-m/llama2-rs/commit/1c16e28

github.com

https://vinithavn.medium.com/from-multi-head-to-latent-attention-the-evolution-of-attention-mechanisms-64e3c0505f24

vinithavn.medium.com

https://towardsdatascience.com/positional-embeddings-in-transformers-a-math-guide-to-rope-alibi/

towardsdatascience.com

https://huggingface.co/spaces/hesamation/primer-llm-embedding

huggingface.co

https://medium.com/@s_boudefel/exploring-swiglu-the-activation-function-powering-modern-llms-9697f88221e7

medium.com

https://developer.apple.com/documentation/metal/setting-up-a-command-structure

developer.apple.com

https://developer.apple.com/documentation/metal/choosing-a-resource-storage-mode-for-apple-gpus

developer.apple.com

https://developer.apple.com/library/archive/documentation/3DDrawing/Conceptual/MTLBestPracticesGuide/ResourceOptions.html

developer.apple.com

LLM.int8() and Emergent Features Read at the source ↗

timdettmers.com

https://huggingface.co/blog/hf-bitsandbytes-integration]

huggingface.co