Posts tagged with duckdb
14 posts found
Filter by tag
Filter by tag:
Custom DuckDB Wasm builds for Cloudflare Workers
What if you could run full SQL queries, including JOINs, aggregations, and even remote Parquet file reads, directly inside a Cloudflare Worker? No database server, no connection...
Using Iceberg Catalogs in the Browser with DuckDB-Wasm
With recent updates of DuckDB itself, DuckDB Wasm and the Iceberg extension it is now possible to query Iceberg catalog directly from the browser, with no backends. involved. Ex...
TypeScript scripts as DuckDB Table Functions
What if you could query any REST API, GraphQL endpoint, or web page directly from DuckDB using SQL? No ETL pipelines, no intermediate files, no complex setup just write a TypeSc...
Using Amazon SageMaker Lakehouse with DuckDB
Preconditions To use the Amazon SageMaker Lakehouse with DuckDB, you first have to create a S3 Table bucket, a namespace and an actual S3 Table. All those steps are described in...
Welcome to the age of $10/month Lakehouses
Recap: Data Warehouses, Data Lakes, Lakehouses? As a short recap, what do these mean, and how are they differentiated? Modern Data Warehouses , like Amazon Redshift , Google Big...
Using DuckDB databases as lightweight Data Lake access layer
Data Lakes come in a broad variety and lots of different flavors. AWS, Azure, Google Cloud, Snowflake, DataBricks, etc. they all have their specialties, strong and weak sides. C...
Handling GTFS data with DuckDB
The General Transit Feed Specification GTFS is a standardized, open data format for public transportation schedules and geographic information. In practice, a GTFS feed is simpl...
Querying IP addresses and CIDR ranges with DuckDB
I had a use case that eventually required performing IP address lookups in a given list of CIDR ranges, as I maintain an open source project that gathers IP address range data f...
Chat with a Duck
A while ago I published sql workbench.com and the accompanying blog post called "Using DuckDB WASM for in browser Data Engineering". The SQL Workbench enables its users to analy...
Using DuckDB-WASM for in-browser Data Engineering
Introduction DuckDB, the in process DBMS specialized in OLAP workloads, had a very rapid growth during the last year, both in functionality, but also popularity amongst its user...
Gathering and analyzing public cloud provider IP address data with DuckDB & Observerable
This articles explains how the gathering and analyzing of public cloud provider IP address data is possible with DuckDB and Observerable
Casual data engineering, or: A poor man's Data Lake in the cloud - Part I
Using AWS Serverless services and DuckDB as near-realtime Data Lake backend infrastructure
Using DuckDB to repartition parquet data in S3
A common task in S3-based Data Lakes is to repartition data, to optimize query patterns and speed. This article describes a serverless solution using DuckDB
Using DuckDB in AWS Lambda
How to run DuckDB in a serverless way on AWS Lambda, with a custom layer.