corpus.blog
43,317 blogs · 5,519,570 posts Claim your blog
Record · corpus.blog/posts/01a0821a-2f68-7361-b796-73ed6bd5f1f6

Cubed: Bounded-memory serverless array processing in xarray

Xarray · published 28 June 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at xarray.dev Wayback capture
1blogs citing
First cited
3 Apr 2024
Most recent
3 Apr 2024
Rank this month
not ranked
External links
45
Words captured
3,612

Cited by

Blog
In the post
Date
tom-e-white.com
Optimizing Cubed Read at the source ↗
3 Apr 2024

Links from this post

Link
Host
https://github.com/tomwhite/cubed
github.com
https://pangeo.io/architecture.html
pangeo.io
https://github.com/pystatgen/sgkit
github.com
http://www.hadoopbook.com/
hadoopbook.com
https://github.com/pydata/xarray/pull/7019
github.com
https://medium.com/pangeo/dask-distributed-and-pangeo-better-performance-for-everyone-thanks-to-science-software-63f85310a36b
medium.com
https://blog.coiled.io/blog/shuffling-large-data-at-constant-memory
blog.coiled.io
https://tom-e-white.com/cubed/array_api.html
tom-e-white.com
https://data-apis.org/array-api/latest/
data-apis.org
https://tom-e-white.com/cubed/operations.html
tom-e-white.com
https://rechunker.readthedocs.io/en/latest/algorithm.html
rechunker.readthedocs.io
https://tom-e-white.com/cubed/generated/cubed.Spec.html
tom-e-white.com
https://www.cloudflare.com/en-gb/learning/serverless/what-is-serverless/
cloudflare.com
https://github.com/tomwhite/cubed/issues/136
github.com
https://lithops-cloud.github.io/docs/
lithops-cloud.github.io
https://github.com/tomwhite/cubed/tree/main/examples
github.com
https://github.com/tomwhite/cubed/tree/main/examples/modal
github.com
https://github.com/tomwhite/cubed/tree/main/examples/dataflow
github.com
https://github.com/xarray-contrib/cubed-xarray
github.com
http://stephanhoyer.com/2015/06/11/xray-dask-out-of-core-labeled-arrays/
stephanhoyer.com
https://github.com/pydata/xarray/issues/328
github.com
https://gist.github.com/TomNicholas/c6a28f7c22c6981f75bce280d3e28283
gist.github.com
https://github.com/dask/dask/issues/10384
github.com
https://tom-e-white.com/cubed/user-guide/memory.html
tom-e-white.com
https://tom-e-white.com/cubed/generated/cubed.measure_reserved_memory.html
tom-e-white.com
https://medium.com/pangeo/optimizing-cubed-7a0b8f65f5b7
medium.com
https://docs.dask.org/en/stable/high-level-graphs.html
docs.dask.org
https://github.com/tomwhite/cubed/issues?q=is%3Aissue+is%3Aopen+label%3Aoptimization
github.com
https://blog.coiled.io/blog/dask-graviton.html
blog.coiled.io
https://www.coiled.io/blog/save-money-with-spot
coiled.io
https://github.com/xarray-contrib/cubed-xarray/blob/main/README.md
github.com
https://docs.dask.org/en/stable/custom-collections.html
docs.dask.org
https://docs.dask.org/en/stable/custom-graphs.html
docs.dask.org
https://www.section.io/blog/scaling-horizontally-vs-vertically/
section.io
https://beam.apache.org/documentation/basics/
beam.apache.org
https://github.com/tomwhite/cubed/issues/161
github.com
https://github.com/tomwhite/cubed/issues/224
github.com
https://medium.com/machine-words/the-three-numbers-b41009ffa236
medium.com
https://howqueryengineswork.com/01-what-is-a-query-engine.html
howqueryengineswork.com
https://howqueryengineswork.com/15-benchmarks.html
howqueryengineswork.com
https://github.com/Python-for-HPC/ramba
github.com
https://github.com/Bears-R-Us/arkouda
github.com
https://github.com/aesara-devs/aesara
github.com
https://discourse.pangeo.io/t/new-working-group-for-distributed-array-computing/2734
discourse.pangeo.io
https://ocean-transport.github.io/cds_lab.html
ocean-transport.github.io
Elsewhere on xarray.dev (3)