DuckDB Community Extensions Directory

DuckDB extensions add extra functionality to DuckDB. As the number of community extensions continues to grow, organizing them into categories can make it easier to explore and discover their capabilities. Suggestions or feedback for improvement are always welcome.

Advanced Data Structures

Specialized data structures for efficient computation

Graph

Graph algorithms and specialized spatial curves

• duckpgq - SQL/PGQ support and graph algorithms
• lindel - Z-Order, Hilbert and Morton curves

Probabilistic

Space-efficient probabilistic data structures for approximate computations

• bitfilters - Probabilistic set membership filters

Cloud Storage

Specialized file system extensions for cloud storage providers

Cloud Providers

Direct integration with cloud storage services

• cwiqduck - CWIQ FS filesystem extension
• gcs - Google Cloud Storage integration

Data Formats & File Reading

Extensions for reading and writing various file formats and data structures

Archives

Access and read files within compressed archive formats

• tarfs - Read files within tar archives
• zipfs - Read files within zip archives

Scientific & Specialized

Read specialized data formats used in scientific computing and specific domains

• arrow - Apache Arrow IPC format support (alias for nanoarrow)
• hdf5 - Read HDF5 scientific data files
• nanoarrow - Apache Arrow IPC format support
• read_stat - Read SAS, Stata, and SPSS datasets
• vortex - Read and write Vortex files

Spreadsheets & Office

Read and process spreadsheet files including Excel, OpenDocument, and PowerBI formats

• pbix - Parse PowerBI data models
• rusty_sheet - Excel/OpenDocument spreadsheet reader
• sheetreader - Fast XLSX file parser

Web & Markup

Process and extract data from web-based formats like HTML, XML, YAML, and Markdown

• markdown - Read and analyze Markdown files
• webbed - Comprehensive XML and HTML processing
• yaml - Read YAML files with native type support

Data Science & AI

Machine learning, AI integration, and advanced analytics capabilities

LLM Integration

Integrate large language models and AI capabilities into SQL workflows

• flock - LLM and RAG extension for SQL
• open_prompt - Interact with LLMs from SQL

Vector Search & Embeddings

Vector similarity search and text embeddings for semantic analysis

• faiss - Vector search with FAISS indices
• quackformers - BERT-based embeddings for RAG

Database Connectivity

Connect DuckDB to external databases and data warehouses

Cloud Data Warehouses

Direct integration with cloud-based analytical databases like BigQuery, Snowflake, and ClickHouse

• bigquery - Google BigQuery integration
• chsql_native - Native ClickHouse client and file reader
• snowflake - Snowflake integration via ADBC

Key-Value & NoSQL

Connect to NoSQL databases and key-value stores

• redis - Redis-compatible client for DuckDB

ODBC & General

Generic database connectivity through ODBC and specialized protocols

• airport - Arrow Flight server integration
• msolap - Microsoft SSAS and OLAP integration
• nanodbc - Connect to ODBC-compatible databases
• ofquack - Oracle Fusion integration via SOAP

Development Tools

Utilities for development, debugging, and system integration

File System

Navigate and interact with the file system using SQL

• file_dialog - Native file picker dialog
• hostfs - Navigate filesystem using SQL
• shellfs - Use shell commands for input/output

Integration Protocols

Integrate with external systems using standardized protocols

• duckdb_mcp - Model Context Protocol integration

Profiling & Monitoring

Profile performance and monitor system behavior

• cronjob - HTTP cronjob functionality
• pyroscope - Continuous profiling integration

Version Control

Git integration and version-aware data analysis

• duck_tails - Git-aware data analysis capabilities

Extension Templates

Example extensions demonstrating how to build DuckDB extensions

Examples

Hello world examples in various programming languages

• capi_quack - C/C++ C API template example
• quack - Hello world extension template
• rusty_quack - Rust extension template example

Financial & Blockchain

Financial data analysis and blockchain integration

Blockchain

Query blockchain data from Ethereum and other networks

• blockduck - Live SQL queries on blockchain
• scrooge - Ethereum blockchain and Yahoo Finance data

Financial Data

Access stock market data and financial indicators

Geospatial

Extensions for working with geographic and spatial data

Geospatial Formats

Read and process geospatial file formats like GeoTIFF and GeoJSON

• geotiff - Read GeoTIFF rasters via GDAL
• st_read_multi - Read multiple geospatial files

Spatial Analysis

Perform spatial indexing, geocoding, and geographic computations

• eeagrid - EEA Reference Grid System support
• geography - Global spatial processing on sphere
• h3 - Hierarchical hexagonal geospatial indexing

Network & Web

Extensions for network analysis, web scraping, and HTTP operations

HTTP & Web Services

HTTP clients, servers, and web service integrations

• curl_httpfs - Enhanced httpfs with HTTP/2 and connection pooling
• http_client - HTTP client for web requests
• httpserver - Transform DuckDB into HTTP API server

Network Analysis

Analyze network traffic, packets, and perform DNS operations

• dns - DNS lookups and reverse lookups
• pcap_reader - Read PCAP network capture files
• wireduck - PCAP dissection using Wireshark

Web Scraping & Content

Extract and process data from web pages and online services

• gsheets - Read and write Google Sheets
• netquack - Parse domains, URIs, IPs, and paths

Performance & Optimization

Improve query performance through caching and optimization

Caching

Cache remote data and improve repeated query performance

• cache_httpfs - Read cache for httpfs with metadata caching
• quackstore - Smart block-based caching for remote files

Observability

Monitor and analyze I/O operations and performance metrics

• observefs - IO observability for filesystems

Query Languages

Alternative query languages and SQL dialects

Alternative Syntax

Use alternative query languages like PRQL and piped SQL

• prql - Pipelined Relational Query Language support
• psql - Piped SQL dialect for composable queries

Query Utilities

Tools for parsing, analyzing, and transforming SQL queries

• parser_tools - Parse and analyze SQL queries
• pivot_table - Spreadsheet-style pivot tables
• substrait - Execute Substrait query plans

SQL Compatibility

Emulate SQL dialects from other database systems

• chsql - ClickHouse SQL macros and functions

Scripting

Execute scripts in various programming languages within SQL

Embedded Languages

Run JavaScript, Lua, and other scripting languages in queries

• evalexpr_rhai - Evaluate Rhai scripting language
• lua - Evaluate Lua scripts in queries
• quickjs - Execute JavaScript code in SQL

Security & Authentication

Cryptographic functions, authentication, and secure data handling

Authentication & Secrets

Handle authentication tokens and secure secrets storage

• boilstream - Secure remote secrets storage
• jwt - Decode and work with JWT tokens in SQL

Cryptography

Hash functions, encryption, and cryptographic operations

• crypto - Cryptographic hash functions and HMAC

Statistics & Mathematics

Statistical functions, probability distributions, and mathematical optimization

Optimization

Mathematical optimization and linear programming capabilities

• highs - Linear optimization solver

Statistical Analysis

Advanced statistical distributions, approximations, and probabilistic data structures

• datasketches - Approximate distinct counts and quantiles
• stochastic - Statistical distribution functions

Streaming & Events

Real-time data streaming and event processing

Event Buses

Connect to event buses and pub/sub systems

• radio - Interact with WebSocket and Redis pub/sub

Message Queues

Integration with message brokers and streaming platforms

• mooncake - Read Iceberg tables in real time
• tributary - Apache Kafka integration

Text Processing

String manipulation, fuzzy matching, and text analysis functions

Fuzzy Matching & Phonetics

Fuzzy string matching, phonetic algorithms, and similarity scoring

• fuzzycomplete - Fuzzy matching based autocompletion
• rapidfuzz - High-performance fuzzy string matching
• splink_udfs - Phonetic and text matching for record linkage

Hashing

Fast non-cryptographic hash functions for strings and data structures

• hashfuncs - Non-cryptographic hash functions
• marisa - MARISA trie for fast string lookups

Standardization

Standardize data for consistency and improved analysis

• title_mapper - Standarizes job titles to Bureau of Labor Statistics (BLS) titles.

Unique Identifiers

Generate and work with various types of unique identifiers

ID Generation

Time-sortable and specialized unique identifier types

• tsid - Time-Sortable ID generator
• ulid - ULID data type with timestamp component

Utilities

Miscellaneous utilities and helper functions

File Utilities

Classify and analyze files based on content

• magic - Classify files using libmagic

Fun & Educational

Entertaining and educational datasets

• psyduck - Pokemon data in DuckDB

Macro Loading

Load and share SQL macros

• webmacro - Load DuckDB macros from the web

Testing

Tools for testing and chaos engineering

• chaos - Testing utility for exceptions and signals

Visualization

Create charts, plots, and visual representations of data

Charts & Plots

Generate interactive and text-based visualizations from SQL queries

• miniplot - Interactive chart visualization in browser
• textplot - Text-based data visualization