Record · corpus.blog/posts/01a0877c-4f7d-709c-90ad-c4fe60b09c21

The power of interning: making a time series database 2000x smaller in Rust

gendignoux.com · published 3 March 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at gendignoux.com Wayback capture

2blogs citing

First cited: 4 Oct 2025
Most recent: 4 Oct 2025
Rank this month: not ranked
Links from this post: 108
Words captured: 16,745

Cited by

Blog

In the post

Date

Nick Babcock

The serde optimization gauntlet: Wasm and arenas Read at the source ↗

4 Oct 2025

Max Halford

Links Read at the source ↗

—

Links from this post

Link

Host

https://gendignoux.com/blog/tags.html

gendignoux.com

https://prim.iledefrance-mobilites.fr/en

prim.iledefrance-mobilites.fr

https://prim.iledefrance-mobilites.fr/en/catalogue-data?type=api

prim.iledefrance-mobilites.fr

https://prim.iledefrance-mobilites.fr/en/apis/idfm-ivtr-requete_globale

prim.iledefrance-mobilites.fr

https://prim.iledefrance-mobilites.fr/en/apis/idfm-disruptions_bulk

prim.iledefrance-mobilites.fr

https://prim.iledefrance-mobilites.fr/en/reutilisations

prim.iledefrance-mobilites.fr

https://ratpstatus.fr/

ratpstatus.fr

https://gendignoux.com/blog/images/rust-interning-2000x/ratp-status-2025-01-28.aUIZIqVMnogK.png

gendignoux.com

https://github.com/wincelau/ratpstatus

github.com

https://github.com/wincelau/ratpstatus/tree/main/datas

github.com

https://en.wikipedia.org/wiki/Interning_(computer_science

en.wikipedia.org

https://gendignoux.com/blog/images/rust-interning-2000x/string-interning.lrRCNfxir2Qy.svg

gendignoux.com

https://doc.rust-lang.org/rust-by-example/scope/borrow/alias.html

doc.rust-lang.org

https://doc.rust-lang.org/reference/interior-mutability.html

doc.rust-lang.org

https://doc.rust-lang.org/std/cell/struct.RefCell.html

doc.rust-lang.org

https://github.com/gendx/rust-interning/commit/5297faabef807c535bba8c29ca665c72957f3ca0

github.com

https://doc.rust-lang.org/rust-by-example/generics.html

doc.rust-lang.org

https://doc.rust-lang.org/std/cmp/trait.Eq.html

doc.rust-lang.org

https://doc.rust-lang.org/std/hash/trait.Hash.html

doc.rust-lang.org

https://doc.rust-lang.org/std/cmp/trait.PartialEq.html

doc.rust-lang.org

https://github.com/gendx/rust-interning/commit/f532ef9aa822a77de496b8fae44b1642db47bef8

github.com

https://stackoverflow.com/questions/5004162/what-does-it-mean-for-a-data-structure-to-be-intrusive

stackoverflow.com

https://github.com/gendx/rust-interning/commit/59fae78b25aa2cfd013992c68f3692a2336f7f23

github.com

https://matklad.github.io/2020/03/22/fast-simple-rust-interner.html

matklad.github.io

https://github.com/gendx/rust-interning/commit/84d79e72fd0ec828d975ffeeed1f10d6cd1db906

github.com

https://doc.rust-lang.org/std/cmp/trait.PartialOrd.html

doc.rust-lang.org

https://doc.rust-lang.org/std/cmp/trait.Ord.html

doc.rust-lang.org

https://github.com/rust-lang/rust/issues/26925

github.com

https://github.com/rust-lang/rust/issues/7671

github.com

https://rust-lang.github.io/rust-clippy/master/index.html

rust-lang.github.io

https://doc.rust-lang.org/std/primitive.slice.html

doc.rust-lang.org

https://github.com/gendx/rust-interning/commit/bdb00b523433db5f1f4a3150507f3b05eef76de5

github.com

https://github.com/gendx/rust-interning/commit/c8ac2611348f271c8deffeb26b11aee022387baa

github.com

https://github.com/gendx/rust-interning/commit/8914a64497362cab7847796d60a27aeb117134b5

github.com

https://github.com/gendx/rust-interning/commit/fcff0d5f1e9bc1089382170f5ed7f097190c48de

github.com

https://en.wikipedia.org/wiki/Universally_unique_identifier

en.wikipedia.org

https://docs.rs/uuid/

docs.rs

https://docs.rs/chrono/

docs.rs

https://tools.ietf.org/html/rfc3339

tools.ietf.org

https://docs.rs/chrono-tz/

docs.rs

https://en.wikipedia.org/wiki/Daylight_saving_time

en.wikipedia.org

https://github.com/gendx/rust-interning/commit/2031f428a7d91019486d896e25824c17b1f0ce8f

github.com

https://github.com/gendx/rust-interning/commit/ad29181ff2ce5c0dff8d6d4e7010244456b60842

github.com

https://docs.rs/serde/

docs.rs

https://tools.ietf.org/html/rfc8949

tools.ietf.org

https://docs.rs/ciborium/

docs.rs

https://tools.ietf.org/html/rfc8259

tools.ietf.org

https://docs.rs/serde_json/

docs.rs

https://postcard.jamesmunns.com/

postcard.jamesmunns.com

https://docs.rs/postcard/

docs.rs

https://docs.rs/bincode/

docs.rs

https://docs.rs/serde/1.0.217/serde/trait.Serialize.html

docs.rs

https://doc.rust-lang.org/std/rc/struct.Rc.html

doc.rust-lang.org

https://docs.rs/serde/1.0.217/serde/trait.Serializer.html

docs.rs

https://serde.rs/impl-deserialize.html

serde.rs

https://docs.rs/serde/1.0.217/serde/trait.Deserialize.html

docs.rs

https://docs.rs/serde/1.0.217/serde/trait.Deserializer.html

docs.rs

https://docs.rs/serde/1.0.217/serde/de/trait.Visitor.html

docs.rs

https://docs.rs/serde/1.0.217/serde/de/trait.SeqAccess.html

docs.rs

https://github.com/gendx/rust-interning/commit/b5013e6ceed00263e4744ea4f6a7ce27b1e83b8d

github.com

https://docs.rs/simd-json/

docs.rs

https://doc.rust-lang.org/std/process/struct.Command.html

doc.rust-lang.org

https://doc.rust-lang.org/std/process/struct.Stdio.html

doc.rust-lang.org

https://www.man7.org/linux/man-pages/man7/pipe.7.html

man7.org

https://gendignoux.com/blog/images/rust-interning-2000x/pipes-writing.rcvX_WUfg9Zh.svg

gendignoux.com

https://gendignoux.com/blog/images/rust-interning-2000x/pipes-full.WTvcH5bPcbn8.svg

gendignoux.com

https://doc.rust-lang.org/std/io/trait.Write.html

doc.rust-lang.org

https://doc.rust-lang.org/std/io/trait.Read.html

doc.rust-lang.org

https://doc.rust-lang.org/stable/std/thread/fn.scope.html

doc.rust-lang.org

https://github.com/gendx/rust-interning/commit/b7281f5da83da3235ec88348a409aefe17c15ac9

github.com

https://gendignoux.com/blog/images/rust-interning-2000x/histogram-sizes-b7281f5.AVEOpxGMp-tq.svg

gendignoux.com

https://gendignoux.com/blog/images/rust-interning-2000x/histogram-times-b7281f5.ghE9gu7LV6EA.svg

gendignoux.com

https://webassembly.org/

webassembly.org

https://github.com/serde-rs/serde/issues/297

github.com

https://github.com/serde-rs/serde/issues/1648

github.com

https://github.com/dtolnay/request-for-implementation/issues/3

github.com

https://docs.rs/serde_tuple/

docs.rs

https://github.com/gendx/rust-interning/commit/a9924e982e24805bf7f1cdbe417e4da4e10d4158

github.com

https://github.com/gendx/rust-interning/commit/cec535911616652401202d6d7ff4367cb938123c

github.com

https://github.com/gendx/rust-interning/commit/356bc0af128b19365a18145a12f816e90f9686d3

github.com

https://gendignoux.com/blog/images/rust-interning-2000x/histogram-sizes-b7281f5-356bc0a.S5UoLPSeolh-.svg

gendignoux.com

https://postcard.jamesmunns.com/wire-format

postcard.jamesmunns.com

https://en.wikipedia.org/wiki/Delta_encoding

en.wikipedia.org

https://github.com/gendx/rust-interning/commit/4ea388f81630ba8750b258e824a120f37979549c

github.com

https://gendignoux.com/blog/images/rust-interning-2000x/histogram-sizes-356bc0a-4ea388f.Ek14Qs--wRbq.svg

gendignoux.com

https://en.wikipedia.org/wiki/Run-length_encoding

en.wikipedia.org

https://github.com/gendx/rust-interning/commit/d09835640cce8f0ee6f9d849cc8f60c7d07bd01e

github.com

https://gendignoux.com/blog/images/rust-interning-2000x/histogram-sizes-4ea388f-d098356.uHWcoLxoRSjR.svg

gendignoux.com

https://github.com/gendx/rust-interning

github.com

https://github.com/wincelau/ratpstatus/tree/ef028cce567b6ce9183a185e699206e0f483b99d

github.com

https://github.com/wincelau/ratpstatus/tree/ef028cce567b6ce9183a185e699206e0f483b99d/datas/json

github.com

https://lib.rs/keywords/interning

lib.rs

https://lucumr.pocoo.org/2025/1/24/build-it-yourself/

lucumr.pocoo.org

https://doc.rust-lang.org/std/collections/struct.HashMap.html

doc.rust-lang.org

https://github.com/rust-lang/rust/issues/56167

github.com

https://docs.rs/hashbrown/latest/hashbrown/struct.HashMap.html

docs.rs

https://docs.rs/compact_str/latest/compact_str/struct.CompactString.html

docs.rs

https://doc.rust-lang.org/reference/dynamically-sized-types.html

doc.rust-lang.org

https://doc.rust-lang.org/std/borrow/trait.Borrow.html

doc.rust-lang.org

https://doc.rust-lang.org/std/convert/trait.Into.html

doc.rust-lang.org

https://doc.rust-lang.org/std/primitive.str.html

doc.rust-lang.org

https://doc.rust-lang.org/std/string/struct.String.html

doc.rust-lang.org

https://doc.rust-lang.org/std/boxed/struct.Box.html

doc.rust-lang.org

https://doc.rust-lang.org/std/borrow/enum.Cow.html

doc.rust-lang.org

https://github.com/gendx/rust-interning/commit/279e2cb4696b8082453a3aa718527940a85a1d41

github.com

https://www.reddit.com/r/rust/comments/1j2nfwt/the_power_of_interning_making_a_time_series/

reddit.com

https://infosec.exchange/@gendx/114099583779462472

infosec.exchange

https://lobste.rs/s/mlseaq/power_interning_making_time_series

lobste.rs