Posts about Data Analytics

Posts about analyzing data with SQL, DuckDB and browser-based tools, including practical examples with real-world public datasets.

6 posts

Using DuckDB databases as lightweight Data Lake access layer

Share Parquet data in S3 or R2 via a small DuckDB database file of views: a lightweight, low-cost data lake access layer that is queryable with plain SQL.

May 17, 2025
7 min read
data-analyticsdata-lakeduckdb

Querying IP addresses and CIDR ranges with DuckDB

Look up whether an IP address belongs to a CIDR range in DuckDB with three reusable SQL macros that compute network and broadcast addresses.

September 20, 2024
2 min read
data-analyticscidrip-address

Using DuckDB-WASM for in-browser Data Engineering

Analyze, transform and visualize local and remote data in the browser with DuckDB-WASM and SQL Workbench, including a full example data engineering pipeline.

January 27, 2024
15 min read
sqlwasmdata-engineering

Gathering and analyzing public cloud provider IP address data with DuckDB & Observable

Unify, clean and analyze the published IP address ranges of AWS, Azure, Google Cloud, Cloudflare, Oracle, DigitalOcean and Fastly with DuckDB and Observable.

April 26, 2023
5 min read
freeobservabledata-engineering

Using DuckDB to repartition parquet data in S3

Repartition Parquet files in S3 data lakes with DuckDB in AWS Lambda: a serverless alternative to Athena, which is limited to 100 partitions per query.

February 26, 2023
5 min read
data-analyticss3data-lake

Using DuckDB in AWS Lambda

Run DuckDB serverless in AWS Lambda with a custom Lambda layer: how it is built, how to configure and deploy it, and example queries against S3 data.

February 12, 2023
6 min read
lambdaawsserverless