Blog Posts
Insights and articles about DuckDB, data engineering, serverless and open source.
Filter by tag
Filter by tag:

Retrieving Lambda@Edge CloudWatch Logs
Lambda@Edge writes CloudWatch logs to the region closest to the viewer. Learn how to find them and aggregate logs from all regions with Kinesis.

List of free AWS Knowledge Badges
The complete list of free AWS Knowledge badges you can earn on AWS Skill Builder, with direct links to each badge readiness learning path.

Serverless Maps for fun and profit
Host fast, low-cost web maps on AWS without a tile server: generate PMTiles from OpenStreetMap data and serve them from S3 and CloudFront with Lambda.

Gathering and analyzing public cloud provider IP address data with DuckDB & Observable
Unify, clean and analyze the published IP address ranges of AWS, Azure, Google Cloud, Cloudflare, Oracle, DigitalOcean and Fastly with DuckDB and Observable.

Casual data engineering, or: A poor man's Data Lake in the cloud - Part I
Build a cost-effective, near-realtime serverless data lake on AWS with CloudFront, Kinesis Firehose, Lambda, S3, Glue and DuckDB.

Using DuckDB to repartition parquet data in S3
Repartition Parquet files in S3 data lakes with DuckDB in AWS Lambda: a serverless alternative to Athena, which is limited to 100 partitions per query.

Using DuckDB in AWS Lambda
Run DuckDB serverless in AWS Lambda with a custom Lambda layer: how it is built, how to configure and deploy it, and example queries against S3 data.

Building a global reverse proxy with on-demand SSL support
Build a global reverse proxy for custom domains with on-demand TLS certificates on AWS, using Caddy, EC2, Global Accelerator and DynamoDB.