corpus.blog
43,771 blogs · 5,563,491 posts Claim your blog
Record · corpus.blog/posts/01a08756-3778-70f6-8656-6855099aff1a

Use StringView to make DataFusion faster

blog.xiangpeng.systems · published 13 September 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at blog.xiangpeng.systems Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
76
Words captured
8,635

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://www.influxdata.com/blog/faster-queries-with-stringview-part-one-influxdb/
influxdata.com
https://www.influxdata.com/blog/faster-queries-with-stringview-part-two-influxdb/
influxdata.com
https://arrow.apache.org/docs/format/Columnar.html
arrow.apache.org
https://github.com/apache/arrow-rs
github.com
https://arrow.apache.org/
arrow.apache.org
https://datafusion.apache.org/
datafusion.apache.org
https://benchmark.clickhouse.com/
benchmark.clickhouse.com
https://www.influxdata.com/blog/flight-datafusion-arrow-parquet-fdap-architecture-influxdb/
influxdata.com
https://db.in.tum.de/~freitag/papers/p29-neumann-cidr20.pdf
db.in.tum.de
https://crates.io/crates/arrow/52.2.0
crates.io
https://datafusion.apache.org/user-guide/configs.html
datafusion.apache.org
https://github.com/apache/datafusion/issues/11682
github.com
https://x.com/andy_pavlo/status/1813258735965643203
x.com
https://www.tum.de/
tum.de
https://engineering.fb.com/2024/02/20/developer-tools/velox-apache-arrow-15-composable-data-management/
engineering.fb.com
Why we have rewritten the string data type Read at the source ↗
pola.rs
https://duckdb.org/2021/12/03/duck-arrow.html
duckdb.org
Why German Strings are Everywhere Read at the source ↗
cedardb.com
https://parquet.apache.org/
parquet.apache.org
https://iceberg.apache.org
iceberg.apache.org
https://delta.io
delta.io
https://docs.rs/parquet/latest/parquet/data_type/struct.ByteArray.html
docs.rs
https://en.wikipedia.org/wiki/UTF-8
en.wikipedia.org
https://doc.rust-lang.org/std/str/fn.from_utf8.html
doc.rust-lang.org
https://www.vldb.org/pvldb/vol17/p148-zeng.pdf
vldb.org
https://en.wikipedia.org/wiki/ASCII
en.wikipedia.org
https://github.com/apache/arrow-rs/pull/6009/files
github.com
https://github.com/apache/arrow-rs/issues/6033
github.com
https://en.wikipedia.org/wiki/Reference_counting
en.wikipedia.org
https://github.com/apache/arrow-rs/pull/6043
github.com
https://github.com/apache/arrow-rs/pull/6039
github.com
https://github.com/spiraldb/vortex/pull/504
github.com
https://godbolt.org/
godbolt.org
https://github.com/aoli-al
github.com
https://doc.rust-lang.org/std/ptr/fn.copy_nonoverlapping.html
doc.rust-lang.org
https://godbolt.org/z/685YPsd5G
godbolt.org
https://github.com/apache/arrow-rs/issues/6034
github.com
https://docs.rs/arrow/latest/arrow/compute/kernels/cmp/index.html
docs.rs
https://docs.rs/arrow/latest/arrow/compute/fn.min.html
docs.rs
https://docs.rs/arrow/latest/arrow/compute/kernels/comparison/fn.like.html
docs.rs
https://github.com/apache/arrow-rs/issues/5374
github.com
https://www.vldb.org/pvldb/vol11/p2209-kersten.pdf
vldb.org
https://docs.rs/arrow/latest/arrow/compute/fn.take.html
docs.rs
https://arrow.apache.org/rust/arrow/compute/kernels/filter/fn.filter.html
arrow.apache.org
https://github.com/apache/datafusion/issues/11628
github.com
https://docs.rs/arrow/latest/arrow/array/struct.GenericByteViewArray.html
docs.rs
https://docs.rs/datafusion/latest/datafusion/physical_plan/coalesce_batches/struct.CoalesceBatchesExec.html
docs.rs
https://github.com/apache/datafusion/pull/11587
github.com
https://doc.rust-lang.org/reference/attributes/codegen.html
doc.rust-lang.org
https://en.wikipedia.org/wiki/Register_allocation
en.wikipedia.org
https://docs.rs/arrow/latest/arrow/array/trait.Array.html
docs.rs
https://docs.rs/arrow/latest/arrow/compute/fn.concat_batches.html
docs.rs
https://github.com/apache/arrow-rs/pull/6136
github.com
https://docs.rs/arrow/latest/arrow/array/struct.DictionaryArray.html
docs.rs
https://docs.rs/arrow/latest/arrow/array/builder/struct.GenericByteViewBuilder.html
docs.rs
https://github.com/apache/datafusion/blob/main/benchmarks/queries/clickbench/queries.sql
github.com
https://github.com/apache/datafusion/issues/7000
github.com
https://github.com/apache/datafusion/pull/11794
github.com
https://github.com/tustvold
github.com
https://github.com/ariesdevil
github.com
https://github.com/RinChanNOWWW
github.com
https://github.com/ClSlaid
github.com
https://github.com/2010YOUY01
github.com
https://github.com/chloro-pn
github.com
https://github.com/a10y
github.com
https://github.com/Kev1n8
github.com
https://github.com/Weijun-H
github.com
https://github.com/PsiACE
github.com
https://github.com/tshauck
github.com
https://github.com/xinlifoobar
github.com
https://github.com/apache/arrow-rs/blob/master/parquet/src/arrow/buffer/offset_buffer.rs
github.com
https://github.com/apache/arrow-rs/issues/5904
github.com
https://github.com/apache/arrow-rs/issues/5995
github.com
https://github.com/apache/datafusion/issues/11752
github.com
https://github.com/apache/arrow-rs/pull/5900
github.com
https://github.com/apache/arrow-rs/issues/6094
github.com