Posts about s3
6 posts
Filter by tag
Filter by tag:

Hosting your own signed DuckDB extensions on S3-compatible storage
DuckDB 2.0 can trust your own signing key. Sign an extension with OpenSSL, host it in an S3-compatible bucket and install it without -unsigned.

Merges for DuckDB branches and snapshots
differential 1.1 brings three-way merges to DuckDB: merge branches and snapshots, fast-forward, resolve typed conflicts with a table, merge schemas, use S3.

Versioned DuckDB databases, locally or replicated through S3, for people and agents
differential extension for DuckDB 2.0: snapshots, branches and time travel locally, plus leader/follower replicas, failover and shared writers via S3.

Differential storage for DuckDB
Add snapshots, time travel and writable branches to native DuckDB databases from SQL with duckdb-differential, and publish versions to S3.

Query S3 Tables with DuckDB
Step-by-step guide to set up an Amazon S3 Table bucket and query its Apache Iceberg tables with DuckDB, including IAM permissions, secrets and catalog attach.

Using DuckDB to repartition parquet data in S3
Repartition Parquet files in S3 data lakes with DuckDB in AWS Lambda: a serverless alternative to Athena, which is limited to 100 partitions per query.