Posts about Data Lakes
How to build and access cost-efficient data lakes and lakehouses with object storage, Parquet, Apache Iceberg, DuckLake and DuckDB.
4 posts
Filter by tag
Filter by tag:
Welcome to the age of $10/month Lakehouses
Compare Iceberg, Delta Lake and DuckLake, then deploy a serverless DuckLake lakehouse for about $10 a month on Cloudflare Containers, R2 and Neon Postgres.
May 30, 2025
19 min read
data-lakelakehouseduckdb
Using DuckDB databases as lightweight Data Lake access layer
Share Parquet data in S3 or R2 via a small DuckDB database file of views: a lightweight, low-cost data lake access layer that is queryable with plain SQL.
May 17, 2025
7 min read
data-analyticsdata-lakeduckdb
Casual data engineering, or: A poor man's Data Lake in the cloud - Part I
Build a cost-effective, near-realtime serverless data lake on AWS with CloudFront, Kinesis Firehose, Lambda, S3, Glue and DuckDB.
April 24, 2023
19 min read
awssqlserverless
Using DuckDB to repartition parquet data in S3
Repartition Parquet files in S3 data lakes with DuckDB in AWS Lambda: a serverless alternative to Athena, which is limited to 100 partitions per query.
February 26, 2023
5 min read
data-analyticss3data-lake