41554 blogs · 4,417,066 posts Claim your blog

Record · corpus.blog/posts/01a087e1-a194-7378-91be-d255ac69dcbe

Efficiently ingesting thousands of JSON files into a Delta table

Sitegui's Blog · published 9 June 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at sitegui.dev Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 12
Words captured: 1,628

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

Dissecting a delta table: just a bunch of JSON and parquet files Read at the source ↗

https://crates.io/crates/tokio

crates.io

https://crates.io/crates/aws-sdk-s3

crates.io

https://crates.io/crates/zstd

crates.io

https://crates.io/crates/arrow-json

crates.io

https://crates.io/crates/parquet

crates.io

https://crates.io/crates/deltalake

crates.io

https://crates.io/crates/flume

crates.io

https://git.sitegui.dev/sitegui/ingest-many-json-files/src/commit/2a0e3155c25e7b14b4b98e49affb346676f28469/rust/src/ingest.rs

git.sitegui.dev

https://git.sitegui.dev/sitegui/ingest-many-json-files/src/commit/c46e28ceb16191250cc504f6c280ca3a4c7ed4f0/spark/main.py

git.sitegui.dev

https://git.sitegui.dev/sitegui/ingest-many-json-files/src/commit/c46e28ceb16191250cc504f6c280ca3a4c7ed4f0/rust/src/main.rs

git.sitegui.dev

https://git.sitegui.dev/sitegui/ingest-many-json-files/src/commit/c46e28ceb16191250cc504f6c280ca3a4c7ed4f0/local-s3/src/main.rs

git.sitegui.dev