Record · corpus.blog/posts/01a087da-2603-7029-b37e-ace71cd4066d

Databases

sachinsu.github.io · published 7 February 2020

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at sachinsu.github.io Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 157
Words captured: 1,071

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://medium.com/academy-team/which-data-architecture-should-i-choose-for-my-workplace-a-data-engineers-approach-f913b71d8ee6

medium.com

https://github.com/prisma/dataguide

github.com

https://aiven.co/developers/sql-query-optimization-guide

aiven.co

https://www.crunchydata.com/blog/demystifying-database-performance-for-developers

crunchydata.com

https://www.heimdalldata.com/

heimdalldata.com

https://dbdb.io

dbdb.io

https://use-the-index-luke.com/blog/2015-02/modern-sql

use-the-index-luke.com

https://www.allthingsdistributed.com/2019/03/Amazon-Aurora-design-cloud-native-relational-database.html

allthingsdistributed.com

https://www.citusdata.com/blog/2018/06/28/scaling-from-one-to-one-hundred-thousand-tenants/

citusdata.com

https://blog.acolyer.org/2019/03/25/amazon-aurora-design-considerations-for-high-throughput-cloud-native-relational-databases/

blog.acolyer.org

https://martinfowler.com/articles/nosqlKeyPoints.html

martinfowler.com

https://docs.microsoft.com/en-us/azure/architecture/guide/technology-choices/data-store-comparison

docs.microsoft.com

https://blog.algolia.com/building-real-time-analytics-apis/

blog.algolia.com

https://www.youtube.com/watch?v=Qvrhh0sHCrc

youtube.com

https://cloud.google.com/blog/products/gcp/why-you-should-pick-strong-consistency-whenever-possible

cloud.google.com

https://debezium.io/blog/2020/02/10/event-sourcing-vs-cdc/

debezium.io

https://debezium.io/documentation/reference/stable/development/engine.html

debezium.io

https://medium.com/@kestra-io/debezium-change-data-capture-without-kafka-connect-18f43cf095d2

medium.com

https://streamsets.com/blog/replicating-oracle-to-mysql-and-json/

streamsets.com

https://spanner.fyi/transactions/

spanner.fyi

https://medium.com/@rakyll/things-i-wished-more-developers-knew-about-databases-2d0178464f78

medium.com

https://selectstarsql.com/

selectstarsql.com

https://quip.com/2gwZArKuWk7W

quip.com

https://veekaybee.github.io/2017/03/20/hadoop-or-laptop/

veekaybee.github.io

https://towardsdatascience.com/learning-sql-201-optimizing-queries-regardless-of-platform-918a3af9c8b1

towardsdatascience.com

https://erwin.com/blog/how-to-do-data-modeling-the-right-way/

erwin.com

https://www.brianstorti.com/replication/

brianstorti.com

https://github.com/brettwooldridge/HikariCP/wiki/About-Pool-Sizing

github.com

Some SQL Tricks of an Application DBA Read at the source ↗

hakibenita.com

https://www.metabase.com/learn/building-analytics/sql-templates/sql-best-practices

metabase.com

Napkin Problem 14: Using checksums to verify syncing 100M database records Read at the source ↗

sirupsen.com

https://antonz.org/random-table/

antonz.org

How Materialize and other databases optimize SQL subqueries Read at the source ↗

scattered-thoughts.net

https://www.wix.engineering/post/wix-inbox-journey-3-approaches-for-zero-downtime-database-migration

wix.engineering

https://tigerbeetle.com/

tigerbeetle.com

Some opinionated thoughts on SQL databases Read at the source ↗

blog.nelhage.com

https://dbmstools.com/

dbmstools.com

https://github.com/cube2222/octosql

github.com

https://github.com/timescale/tsbs

github.com

https://pressly.github.io/goose/

pressly.github.io

https://www.hammerdb.com/

hammerdb.com

https://github.com/akopytov/sysbench

github.com

https://www.soda.io/core

soda.io

https://github.com/readysettech/readyset

github.com

https://www.vladsiv.com/big-data-file-formats/?ref=davidgomes.com

vladsiv.com

https://github.com/cxli233/FriendsDontLetFriends

github.com

My favourite API is a zipfile on the European Central Bank's website Read at the source ↗

csvbase.com

https://cube.dev/

cube.dev

https://evidence.dev/

evidence.dev

https://www.infoworld.com/article/3236869/what-is-apache-spark-the-big-data-platform-that-crushed-hadoop.html

infoworld.com

https://towardsdatascience.com/a-neanderthals-guide-to-apache-spark-in-python-9ef1f156d427

towardsdatascience.com

https://www.datamesh-architecture.com/

datamesh-architecture.com

https://www.datanami.com/2021/10/25/data-mesh-vs-data-fabric-understanding-the-differences/

datanami.com

https://future.a16z.com/emerging-architectures-modern-data-infrastructure/

future.a16z.com

https://dropbox.tech/application/why-we-chose-apache-superset-as-our-data-exploration-platform

dropbox.tech

https://medium.com/airbnb-engineering/supercharging-apache-superset-b1a2393278bd

medium.com

https://github.com/snowplow/snowplow

github.com

https://redash.io/help/open-source/setup

redash.io

https://www.mckinsey.com/business-functions/mckinsey-analytics/our-insights/why-data-culture-matters

mckinsey.com

https://www.mckinsey.com/industries/financial-services/our-insights/designing-a-data-transformation-that-delivers-value-right-from-the-start

mckinsey.com

https://github.com/common-workflow-language/common-workflow-language/wiki/Existing-Workflow-systems

github.com

https://dash.plotly.com/

dash.plotly.com

https://segment.com/academy/

segment.com

https://www.sisense.com/whitepapers/

sisense.com

https://mode.com/sql-tutorial/sql-business-analytics-training/

mode.com

https://medium.com/@rchang/a-beginners-guide-to-data-engineering-part-i-4227c5c457d7

medium.com

https://looker.com/blog/different-types-graphs-charts-uses

looker.com

https://rudderstack.com/

rudderstack.com

https://datavizcatalogue.com/search/time.html

datavizcatalogue.com

https://clickhouse.tech/

clickhouse.tech

https://notion.castordoc.com/

notion.castordoc.com

https://rudderstack.com/blog/1mgs-data-stack-explained-how-they-harness-and-activate-unlimited-real-time-data/

rudderstack.com

https://7a9z42689xx35658r1hutm8n-wpengine.netdna-ssl.com/wp-content/uploads/2020/10/Data-Report-Martin-Inline-Graphics-R7.pdf

7a9z42689xx35658r1hutm8n-wpengine.netdna-ssl.com

http://mattturck.com/wp-content/uploads/2020/09/2020-Data-and-AI-Landscape-Matt-Turck-at-FirstMark-v1.pdf

mattturck.com

https://github.com/fishtown-analytics/dbt

github.com

https://github.com/thenaturalist/awesome-business-intelligence

github.com

https://towardsdatascience.com/data-stacks-for-fun-nonprofit-part-iii-dcfd46da9f9f

towardsdatascience.com

https://posthog.com

posthog.com

https://technically.dev/posts/what-your-data-team-is-using

technically.dev

https://octo.github.com/projects/flat-data

octo.github.com

https://github.com/nocodb/nocodb

github.com

Real-Time Analytics with Apache Kafka and Pinot Read at the source ↗

confluent.io

https://www.percona.com/blog/2019/11/22/uuids-are-popular-but-bad-for-performance-lets-discuss/

percona.com

https://github.com/mit-pdos/noria

github.com

https://github.com/vmware/differential-datalog

github.com

https://planetscale.com/blog/why-we-chose-nanoids-for-planetscales-api

planetscale.com

https://github.com/dragonflydb/dragonfly

github.com

https://duckdb.org/

duckdb.org

https://sql-workbench.com/

sql-workbench.com

https://duckdb.org/2024/01/26/multi-database-support-in-duckdb.html

duckdb.org

https://motherduck.com/blog/postgres-duckdb-options

motherduck.com

https://www.sas.com/en_us/insights/data-management/what-is-etl.html

sas.com

https://github.com/airbytehq/airbyte

github.com

https://medium.com/big-data-engineering/redshift-cicd-how-we-did-it-and-why-you-should-do-it-to-e46ecf734eab

medium.com

https://github.com/jghoman/awesome-apache-airflow

github.com

https://github.com/dagster-io/dagster

github.com

https://github.com/prefecthq/prefect

github.com

https://github.com/linkedin/databus

github.com

https://github.com/liquidata-inc/dolt

github.com

https://griddb.org

griddb.org

Compressing data with Parquet Read at the source ↗

dev.l1x.be

https://github.com/lancedb/lance

github.com

https://github.com/mara/mara-pipelines

github.com

https://github.com/enso-org/enso

github.com

https://www.eventstore.com/

eventstore.com

https://mlops.community/an-engineers-guide-to-data-contracts-pt-1/

mlops.community

https://segment.com/blog/introducing-centrifuge/

segment.com

https://momjian.us/main/writings/pgsql/hw_selection.pdf

momjian.us

https://blog.flipkart.tech/scaling-tidb-to-1-million-qps-d556aa6a16ef

blog.flipkart.tech

https://stackoverflow.blog/2022/03/14/how-sharding-a-database-can-make-it-faster/

stackoverflow.blog

https://www.quora.com/q/quoraengineering/MySQL-sharding-at-Quora?share=1

quora.com

https://github.com/ericelliott/cuid

github.com

https://open-metadata.org/

open-metadata.org

https://eugeneyan.com/writing/data-discovery-platforms/

eugeneyan.com

https://engineering.shopify.com/blogs/engineering/solving-data-discovery-challenges-shopify

engineering.shopify.com

https://github.com/great-expectations/great_expectations

github.com

https://www.rainforestqa.com/blog/2014-06-27-zero-downtime-database-migrations

rainforestqa.com

https://stripe.com/blog/online-migrations

stripe.com

https://www.quora.com/How-big-companies-migrate-from-one-database-to-another-without-losing-data-i-e-database-independent/answer/Siddharth-Anand

quora.com

https://github.com/datafold/data-diff

github.com

https://gradientflow.com/the-growing-importance-of-metadata-management-systems/

gradientflow.com

https://use.expensify.com/blog/scaling-sqlite-to-4m-qps-on-a-single-server

use.expensify.com

https://simonwillison.net/2021/Feb/21/cross-database-queries/

simonwillison.net

https://sqlite.org/fiddle/

sqlite.org

Why you should probably be using SQLite (article) Read at the source ↗

epicweb.dev

SQLite performance tuning Read at the source ↗

phiresky.github.io

https://pocketbase.io/

pocketbase.io

https://blog.expensify.com/2018/01/08/scaling-sqlite-to-4m-qps-on-a-single-server/

blog.expensify.com

https://litestream.io

litestream.io

https://github.com/rqlite/rqlite

github.com

https://antonz.org/sqlite-is-not-a-toy-database/

antonz.org

Hosting SQLite databases on Github Pages Read at the source ↗

phiresky.github.io

https://simonwillison.net/2021/Jun/19/sqlite-utils-memory/

simonwillison.net

https://simonwillison.net/2021/Jul/28/baked-data/

simonwillison.net

https://litestream.io/alternatives/cron/

litestream.io

https://capitalone.github.io/DataProfiler/docs/0.4.5/html/index.html

capitalone.github.io

https://databunker.org/

databunker.org

https://swtch.com/~rsc/regexp/regexp4.html

swtch.com

https://github.com/google/codesearch

github.com

https://github.com/manticoresoftware/manticoresearch/

github.com

https://zincsearch.com/

zincsearch.com

OpenSearch FAQ: What is OpenSearch? Read at the source ↗

logz.io

https://github.com/yacy/yacy_search_server

github.com

https://amulyasharma.medium.com/opensearch-up-and-running-in-10-mins-49e05689087e

amulyasharma.medium.com

http://www.dba-oracle.com/concepts/database_administration.htm

dba-oracle.com

https://docs.microsoft.com/en-us/sharepoint/administration/storage-and-sql-server-capacity-planning-and-configuration

docs.microsoft.com

https://glossary.airbyte.com/term/data-engineering-concepts/

glossary.airbyte.com

https://sarahsnewsletter.substack.com/p/choosing-a-data-catalog

sarahsnewsletter.substack.com

https://github.com/opendatadiscovery/awesome-data-catalogs

github.com

https://medium.com/@budilov/create-a-serverless-data-lake-on-aws-and-migrate-your-on-prem-data-to-it-80dad09e23cb

medium.com

https://github.com/adilkhash/Data-Engineering-HowTo

github.com

https://airbyte.com/blog/data-lake-lakehouse-guide-powered-by-table-formats-delta-lake-iceberg-hudi

airbyte.com

https://blogs.oracle.com/bigdata/data-lake-solution-patterns-use-cases

blogs.oracle.com

https://databricks.com/blog/2020/01/30/what-is-a-data-lakehouse.html

databricks.com

https://dagster.io/blog/duckdb-data-lake

dagster.io

https://www.hytradboi.com/2022/viewing-collaborative-editing-through-a-databases-lens

hytradboi.com

https://playbook.hackney.gov.uk/Data-Platform-Playbook/architecture-decisions

playbook.hackney.gov.uk