Record · corpus.blog/posts/01a0de2b-e6aa-7126-9291-cc1fb78b12b1

The Data Engineering Toolkit

Blogs - Data Engineering Blog & Second Brain · published 25 September 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at ssp.sh Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 101
Words captured: 520

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

The Data Engineering Toolkit: Essential Tools for Your Machine Read at the source ↗

ssp.sh

https://en.wikipedia.org/wiki/Windows_Subsystem_for_Linux

en.wikipedia.org

https://curl.se/

curl.se

rsync 3.5.1 Read at the source ↗

rsync.samba.org

https://github.com/sharkdp/bat

github.com

https://github.com/BurntSushi/ripgrep

github.com

https://github.com/junegunn/fzf

github.com

https://www.gnu.org/software/grep/

gnu.org

https://brew.sh/

brew.sh

https://www.gnu.org/software/make/

gnu.org

https://www.ssp.sh/brain/cron/

ssp.sh

https://cursor.sh/

cursor.sh

https://code.visualstudio.com/

code.visualstudio.com

https://getnao.io/

getnao.io

https://www.ssp.sh/brain/ide/

ssp.sh

https://www.ssp.sh/brain/ai-based-ide/

ssp.sh

https://www.ssp.sh/brain/github-codespaces/

ssp.sh

https://replit.com/

replit.com

https://www.ssp.sh/brain/notebooks/

ssp.sh

https://github.com/git/git

github.com

https://github.com/jesseduffield/lazygit/

github.com

https://www.ssp.sh/brain/dotfiles/

ssp.sh

https://www.ssp.sh/brain/sql/

ssp.sh

https://www.ssp.sh/brain/postgres-wal-implementation/

ssp.sh

DuckDB Read at the source ↗

ssp.sh

https://github.com/duckdb/pg_duckdb

github.com

https://www.ssp.sh/brain/pandas/

ssp.sh

Apache Arrow: The Foundation for In-Memory Storage Read at the source ↗

ssp.sh

https://github.com/pola-rs/polars

github.com

https://spark.apache.org/sql/

spark.apache.org

https://www.ssp.sh/brain/sql-query-engine/

ssp.sh

https://github.com/psf/requests

github.com

https://www.crummy.com/software/BeautifulSoup/

crummy.com

https://github.com/tiangolo/typer

github.com

https://github.com/astral-sh/uv

github.com

pip Read at the source ↗

github.com

https://github.com/google/python-fire

github.com

https://github.com/astral-sh/ruff

github.com

https://github.com/pytest-dev/pytest

github.com

https://github.com/pydantic/pydantic

github.com

https://dedp.online/part-2/4-ce/bash-stored-procedure-etl-python-script.html

dedp.online

https://www.ssp.sh/brain/data-modeling/

ssp.sh

Data Engineering Lifecycle Read at the source ↗

ssp.sh

https://dedp.online/part-1/1-introduction/challenges-in-data-engineering.html

dedp.online

https://en.wikipedia.org/wiki/Database_design

en.wikipedia.org

https://www.ssp.sh/brain/data-engineering-architecture/

ssp.sh

https://www.ssp.sh/brain/etl/

ssp.sh

https://en.wikipedia.org/wiki/Data_validation

en.wikipedia.org

https://www.ssp.sh/brain/data-catalog/

ssp.sh

https://www.ssp.sh/brain/functional-data-engineering/

ssp.sh

dbt (and dbt-core) Read at the source ↗

ssp.sh

https://www.ssp.sh/brain/apache-airflow/

ssp.sh

https://www.ssp.sh/brain/dagster/

ssp.sh

https://www.ssp.sh/brain/data-orchestrators/

ssp.sh

https://www.ssp.sh/brain/data-integration/

ssp.sh

BI Tools Read at the source ↗

ssp.sh

Pivot Table Read at the source ↗

ssp.sh

https://www.ssp.sh/brain/declarative/

ssp.sh

https://www.ssp.sh/brain/kubernetes/

ssp.sh

https://kubernetes.io/docs/reference/kubectl/

kubernetes.io

https://www.ssp.sh/brain/docker/

ssp.sh

https://github.com/hashicorp/terraform

github.com

https://github.com/helm/helm

github.com

https://github.com/kubernetes-sigs/kustomize

github.com

https://www.ssp.sh/brain/devops/

ssp.sh

https://www.ssp.sh/brain/yaml/

ssp.sh

https://www.ssp.sh/brain/infrastructure-as-code/

ssp.sh

https://github.com/features/actions

github.com

https://github.com/getsops/sops

github.com

https://gnupg.org/

gnupg.org

https://www.ssp.sh/brain/minio/

ssp.sh

https://www.ssp.sh/brain/aws-s3/

ssp.sh

https://www.ssp.sh/brain/apache-parquet/

ssp.sh

https://www.ssp.sh/brain/tmux/

ssp.sh

The Vim Language (and Motions) Read at the source ↗

ssp.sh

https://github.com/jesseduffield/lazydocker

github.com

https://github.com/derailed/k9s

github.com

https://www.ssp.sh/brain/data-lake-table-format/

ssp.sh

https://www.ssp.sh/brain/open-table-format-catalogs/

ssp.sh

Retrieval-Augmented Generation (RAG) Read at the source ↗

ssp.sh

https://modelcontextprotocol.io/

modelcontextprotocol.io

https://github.com/features/copilot

github.com

BI-as-Code and the New Era of GenBI Read at the source ↗

ssp.sh

https://en.wikipedia.org/wiki/Large_language_model

en.wikipedia.org

Vector Technologies for AI: Extending Your Existing Data Stack Read at the source ↗

ssp.sh

https://www.ssp.sh/brain/embeddings/

ssp.sh

https://github.com/great-expectations/great_expectations

github.com

https://github.com/unionai-oss/pandera

github.com

https://github.com/OpenLineage/OpenLineage

github.com

https://www.ssp.sh/brain/data-contracts/

ssp.sh

https://www.ssp.sh/brain/schema-evolution/

ssp.sh

https://www.ssp.sh/brain/schema-registry/

ssp.sh

https://www.ssp.sh/brain/schema-drift/

ssp.sh

https://docs.getdbt.com/docs/build/tests

docs.getdbt.com

https://prometheus.io/

prometheus.io

Data Engineering Concepts Read at the source ↗

ssp.sh

https://www.ssp.sh/brain/data-engineering/

ssp.sh

The Data Engineering Toolkit: Infrastructure, DevOps, and Beyond Read at the source ↗

ssp.sh

https://www.ssp.sh/brain/the-state-of-devops-in-data-engineering/

ssp.sh

https://www.ssp.sh/brain/essential-data-engineering-toolkit/

ssp.sh

https://www.ssp.sh/brain/the-data-warehouse-toolkit-ralph-kimball/

ssp.sh