Blog Posts

Insights and articles about DuckDB, data engineering, serverless and open source.

Retrieving Lambda@Edge CloudWatch Logs

Lambda@Edge writes CloudWatch logs to the region closest to the viewer. Learn how to find them and aggregate logs from all regions with Kinesis.

January 26, 2024
3 min read
awsserverlesslambda

List of free AWS Knowledge Badges

The complete list of free AWS Knowledge badges you can earn on AWS Skill Builder, with direct links to each badge readiness learning path.

September 1, 2023
1 min read
awsfreelearning

Serverless Maps for fun and profit

Host fast, low-cost web maps on AWS without a tile server: generate PMTiles from OpenStreetMap data and serve them from S3 and CloudFront with Lambda.

August 7, 2023
9 min read
cdnmapsserverless

Gathering and analyzing public cloud provider IP address data with DuckDB & Observable

Unify, clean and analyze the published IP address ranges of AWS, Azure, Google Cloud, Cloudflare, Oracle, DigitalOcean and Fastly with DuckDB and Observable.

April 26, 2023
5 min read
freeobservabledata-engineering

Casual data engineering, or: A poor man's Data Lake in the cloud - Part I

Build a cost-effective, near-realtime serverless data lake on AWS with CloudFront, Kinesis Firehose, Lambda, S3, Glue and DuckDB.

April 24, 2023
19 min read
awssqlserverless

Using DuckDB to repartition parquet data in S3

Repartition Parquet files in S3 data lakes with DuckDB in AWS Lambda: a serverless alternative to Athena, which is limited to 100 partitions per query.

February 26, 2023
5 min read
data-analyticss3data-lake

Using DuckDB in AWS Lambda

Run DuckDB serverless in AWS Lambda with a custom Lambda layer: how it is built, how to configure and deploy it, and example queries against S3 data.

February 12, 2023
6 min read
lambdaawsserverless

Building a global reverse proxy with on-demand SSL support

Build a global reverse proxy for custom domains with on-demand TLS certificates on AWS, using Caddy, EC2, Global Accelerator and DynamoDB.

January 10, 2023
10 min read
cloudformationawsreverse-proxy