Record · corpus.blog/posts/01a0877c-4f7d-709c-90ad-c4fe613e6d85

Optimization adventures: making a parallel Rust workload even faster with data-oriented design (and other tricks)

gendignoux.com · published 2 December 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at gendignoux.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 69
Words captured: 5,921

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

Optimization adventures: making a parallel Rust workload 10x faster with (or without) Rayon Read at the source ↗

gendignoux.com

https://docs.rs/rayon/

docs.rs

https://github.com/gendx/paralight

github.com

https://matklad.github.io/2023/04/09/can-you-trust-a-compiler-to-optimize-your-code.html

matklad.github.io

https://doc.rust-lang.org/std/primitive.i64.html

doc.rust-lang.org

https://docs.rs/num/0.4.3/num/struct.BigInt.html

docs.rs

https://docs.rs/num/0.4.3/num/rational/type.BigRational.html

docs.rs

https://docs.rs/num-bigint/0.4.6/src/num_bigint/biguint.rs.html

docs.rs

https://docs.rs/num-bigint/0.4.6/src/num_bigint/lib.rs.html

docs.rs

https://gendignoux.com/blog/images/rust-data-oriented-design/diagram-small-vec-u64.Xsh3SI5ehIGX.svg

gendignoux.com

https://docs.rs/smallvec/

docs.rs

https://github.com/rust-num/num-bigint/pull/210

github.com

https://github.com/gendx/num-bigint

github.com

https://doc.rust-lang.org/cargo/reference/overriding-dependencies.html

doc.rust-lang.org

https://www.reddit.com/r/rust/comments/12hlshh/introducing_zunepng_extremely_fast_png_decoding/

reddit.com

https://www.reddit.com/r/rust/comments/12ks0ka/png_crate_gets_an_ultrafast_compression_mode_up/

reddit.com

Huffman revisited, Part 4 : Multi-bytes decoding Read at the source ↗

fastcompression.blogspot.com

STV-rs: Single Transferable Vote implementation in Rust Read at the source ↗

gendignoux.com

https://gendignoux.com/blog/images/rust-data-oriented-design/diagram-vec-vec.95LJvLz-5-H3.svg

gendignoux.com

https://github.com/dbartolini/data-oriented-design

github.com

https://github.com/gendx/stv-rs/blob/v0.5.0/testdata/ballots/random/rand_hypergeometric.blt

github.com

https://gendignoux.com/blog/images/rust-data-oriented-design/diagram-data-oriented-vec-vec.JAixWBCVHuHj.svg

gendignoux.com

https://gendignoux.com/blog/images/rust-data-oriented-design/diagram-bit-packing.a3ktu16C3hq-.svg

gendignoux.com

https://github.com/gendx/stv-rs/commit/ab40f0e797bb5a4053f07dd297f70b2cfee5c17d

github.com

https://github.com/gendx/stv-rs/commit/f15c357add6ccc834a293ec91a6490e793a1154a

github.com

https://blog.rust-lang.org/2022/10/28/gats-stabilization.html

blog.rust-lang.org

https://docs.rs/rayon/1.10.0/rayon/iter/trait.IndexedParallelIterator.html

docs.rs

https://docs.rs/rayon/1.10.0/rayon/iter/trait.IntoParallelIterator.html

docs.rs

https://docs.rs/rayon/1.10.0/rayon/iter/trait.ParallelIterator.html

docs.rs

https://en.wikipedia.org/wiki/Branch_predictor

en.wikipedia.org

https://gendignoux.com/blog/images/rust-data-oriented-design/diagram-allocated-unsorted.YmQ5ZBlvXtZ0.svg

gendignoux.com

https://gendignoux.com/blog/images/rust-data-oriented-design/diagram-allocated-sorted.UxZGZkYRysGA.svg

gendignoux.com

https://gendignoux.com/blog/images/rust-data-oriented-design/diagram-allocated-sorted-cloned.VmIZvI9phc7b.svg

gendignoux.com

https://rust-lang.github.io/rust-clippy/stable/index.html

rust-lang.github.io

https://www.youtube.com/watch?v=YB6LTaGRQJg

youtube.com

Arenas in Rust Read at the source ↗

manishearth.github.io

https://xkcd.com/1172/

xkcd.com

https://creativecommons.org/licenses/by-nc/2.5/

creativecommons.org

https://www.hyrumslaw.com/

hyrumslaw.com

https://docs.rs/num/0.4.3/num/type.BigRational.html

docs.rs

https://en.wikipedia.org/wiki/Greatest_common_divisor

en.wikipedia.org

https://docs.rs/num-rational/0.4.2/src/num_rational/lib.rs.html

docs.rs

https://github.com/gendx/stv-rs/commit/0b8b43359a3d1cc016477778948dcd631a4d68ce

github.com

https://github.com/gendx/stv-rs/commit/ed19dc2bca893e97a1c67616881b2e2421f1082b

github.com

Making a const version of Rust's array::from_fn - How hard can it be? Read at the source ↗

gendignoux.com

https://nnethercote.github.io/perf-book/build-configuration.html

nnethercote.github.io

https://docs.rs/log/

docs.rs

https://docs.rs/env_logger/

docs.rs

https://docs.rs/log/0.4.22/log/macro.trace.html

docs.rs

https://docs.rs/log/0.4.22/log/

docs.rs

https://docs.rs/log/0.4.22/log/macro.log_enabled.html

docs.rs

https://doc.rust-lang.org/cargo/reference/profiles.html

doc.rust-lang.org

https://github.com/johnthagen/min-sized-rust

github.com

https://doc.rust-lang.org/std/panic/fn.catch_unwind.html

doc.rust-lang.org

https://doc.rust-lang.org/rustc/profile-guided-optimization.html

doc.rust-lang.org

https://en.wikipedia.org/wiki/Overfitting

en.wikipedia.org

https://blog.rust-lang.org/inside-rust/2020/11/11/exploring-pgo-for-the-rust-compiler

blog.rust-lang.org

https://doc.rust-lang.org/rustc/codegen-options/index.html

doc.rust-lang.org

https://jemalloc.net/

jemalloc.net

https://lib.rs/crates/jemallocator

lib.rs

https://github.com/gendx/stv-rs/tree/30201c08e945cdaea3fba9e30b1ba1d040bfc90a

github.com

https://github.com/gendx/stv-rs/tree/473bcd652372e341e934b630dd71c02ec65fd5fa

github.com

https://gendignoux.com/blog/images/rust-data-oriented-design/plot-stv.30201c0-parallel-rand2x10.OAEbcBNvy8zB.svg

gendignoux.com

https://gendignoux.com/blog/images/rust-data-oriented-design/plot-stv.473bcd6-parallel-rand2x10.OD8zhsdTu2Gu.svg

gendignoux.com

https://gendignoux.com/blog/images/rust-data-oriented-design/plot-stv.30201c0-parallel-hypergeometric.R0l-K1kZkYWX.svg

gendignoux.com

https://gendignoux.com/blog/images/rust-data-oriented-design/plot-stv.473bcd6-parallel-hypergeometric.wswcmO1ag0h0.svg

gendignoux.com

https://infosec.exchange/@gendx/113584228631814718

infosec.exchange

https://lobste.rs/s/yb4rvi/optimization_adventures_making

lobste.rs

https://www.reddit.com/r/rust/comments/1h4zbde/optimization_adventures_making_a_parallel_rust/

reddit.com