DuckDB, Apache Arrow, SQL, and data engineering.
Written by the people building it.Latest post
Call VGI functions and query databases through Grainlift and ADBC, without deploying a public HTTP endpoint or managing TLS certificates.
By Rusty Conover
9 min read
Continue reading: SQL in your browser, code and data on your machine—with IrohOlder posts, newest first. Browse by topic using the Topics menu above.
A data service can tell DuckDB how long an answer is safe to reuse, so repeated queries can skip another API call. Our benchmarks show when that saves time—and when caching costs more than it saves.
A table function turns an API call into rows in your database. A LATERAL join lets every row on the left call it — and VGI makes those calls in batches.
I pointed DuckDB at Hacker News and at Jev, TypeSafe's decision model, and asked it to score 500 stories against one sentence about what I like. It took 17 seconds and cost less than a penny.
Direct VARIANT interchange with Arrow is merged into DuckDB's 2.0 development branch. See what works, what still needs a release, and the remaining limits across C++, Python, Go, Rust, and Java.
Query Farm's adbc_scanner uses DuckDB 2.0 whole-query pushdown to run supported queries entirely in PostgreSQL. In our benchmark, it was 10–11× faster.
The IP is safe under the DuckDB Foundation, but the Foundation doesn't cut releases — DuckLabs does. What the AWS acquisition changes for people who build on DuckDB, and what Query Farm is doing about it.
Every DuckDB engine release needs its community extensions rebuilt before they install. With data from 1,400+ PRs and a full-catalogue rebuild, we make the case for treating the catalogue as a distribution — and show Haybarn rebuilds it ~2.4× faster.
A DuckDB extension that compiles for WebAssembly has only proven that it compiles. Whether it loads, and whether it actually runs, are separate questions. I built a Node harness to ask them across 124 community extensions. Here's what it found and the fixes that came out of it.
Quack — the new client/server protocol extension for DuckDB — was announced today. It's been built since November 2025, almost exactly as long as I've been building VGI. Here's what's interesting, what's surprising, and where the two projects converge and diverge.
We’ll email you when we publish. Releases, experiments, and things that broke.
Subscribe to the dispatch