tobilg.com

Posts tagged with parquet

1 post found

Filter by tag
All Posts sql rust wasm data-engineering transpiler async duckdb cloudflare-worker iceberg typescript arrow ai aws agent mcp glue sagemaker data-lake lakehouse analytics gtfs cloudflare serverless apache-iceberg s3 s3-tables data-analysis cidr ip-address llm data-analytics lambdaedge free learning skills badge cdn maps observable dataengineering dataanalytics datalake amazon-s3 parquet lambda cloudformation reverse-proxy caddy serverless-framework
Using DuckDB to repartition parquet data in S3

Using DuckDB to repartition parquet data in S3

A common task in S3-based Data Lakes is to repartition data, to optimize query patterns and speed. This article describes a serverless solution using DuckDB

February 26, 2023
5 min read
analytics amazon-s3 data-lake