corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a08c56-b3b1-72bc-acba-eae931e9c19a

Casual data engineering, or: A poor man's Data Lake in the cloud - Part I

tobilg · published 24 April 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at tobilg.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
48
Words captured
8,676

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://www.snowflake.com
snowflake.com
https://dremio.com
dremio.com
https://www.databricks.com
databricks.com
https://motherduck.com/blog/big-data-is-dead/
motherduck.com
https://aws.amazon.com/big-data/datalakes-and-analytics/what-is-a-data-lake/
aws.amazon.com
https://cloud.google.com/learn/what-is-a-data-lake
cloud.google.com
https://azure.microsoft.com/en-us/solutions/data-lake/
azure.microsoft.com
https://www.databricks.com/discover/data-lakes/introduction
databricks.com
https://www.ibm.com/topics/data-lake
ibm.com
https://en.wikipedia.org/wiki/Data_lake
en.wikipedia.org
https://aws.amazon.com/blogs/big-data/aws-serverless-data-analytics-pipeline-reference-architecture/
aws.amazon.com
https://usefathom.com/
usefathom.com
https://www.simpleanalytics.com
simpleanalytics.com
https://www.plausible.io
plausible.io
https://aws.amazon.com/cloudfront/
aws.amazon.com
https://aws.amazon.com/cloudfront/features/?whats-new-cloudfront.sort-by=item.additionalFields.postDateTime&whats-new-cloudfront.sort-order=desc
aws.amazon.com
https://aws.amazon.com/cloudfront/pricing/
aws.amazon.com
https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/real-time-logs.html
docs.aws.amazon.com
https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/private-content-restricting-access-to-s3.html
docs.aws.amazon.com
https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-cloudfront-realtimelogconfig.html
docs.aws.amazon.com
https://github.com/ownstats/ownstats/blob/main/backend/resources/cf-distribution.yml
github.com
https://aws.amazon.com/kinesis/data-streams/
aws.amazon.com
https://docs.aws.amazon.com/firehose/latest/dev/what-is-this-service.html
docs.aws.amazon.com
https://aws.amazon.com/kinesis/data-streams/pricing/?nc=sn&loc=3
aws.amazon.com
https://aws.amazon.com/kinesis/data-firehose/pricing/?nc=sn&loc=3
aws.amazon.com
https://docs.aws.amazon.com/firehose/latest/dev/data-transformation.html
docs.aws.amazon.com
https://docs.aws.amazon.com/firehose/latest/dev/dynamic-partitioning.html
docs.aws.amazon.com
https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-kinesisfirehose-deliverystream-bufferinghints.html
docs.aws.amazon.com
https://github.com/ownstats/ownstats/blob/main/backend/resources/kinesis.yml
github.com
https://github.com/ownstats/ownstats/blob/main/backend/serverless.yml
github.com
https://duckdb.org/docs/data/partitioning/partitioned_writes.html
duckdb.org
https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-kinesisfirehose-deliverystream-schemaconfiguration.html
docs.aws.amazon.com
https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-kinesisfirehose-deliverystream-processorparameter.html
docs.aws.amazon.com
https://www.npmjs.com/package/ua-parser-js
npmjs.com
https://www.npmjs.com/package/isbot
npmjs.com
https://www.npmjs.com/package/aws-edge-locations
npmjs.com
https://docs.aws.amazon.com/firehose/latest/dev/s3-prefixes.html
docs.aws.amazon.com
https://github.com/tobilg/serverless-parquet-repartitioner
github.com
https://tobilg.com/using-duckdb-to-repartition-parquet-data-in-s3
tobilg.com
https://github.com/tobilg/duckdb-nodejs-layer
github.com
https://github.com/ownstats/ownstats/blob/main/backend/functions/utils/queryRenderer.ts
github.com
https://docs.aws.amazon.com/glue/latest/dg/tables-described.html
docs.aws.amazon.com
https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-create-rule-schedule.html
docs.aws.amazon.com
https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/AccessLogs.html
docs.aws.amazon.com
https://www.arin.net/resources/guide/asn/
arin.net
https://github.com/tobilg/serverless-duckdb
github.com
https://www.duckdb.org
duckdb.org
https://github.com/ownstats/ownstats/tree/main/analytics-backend
github.com