Skip to content

CRC-32C & FNV-1a functions in the Hashfuncs DuckDB extension

Sample data for the examples

Each browser example starts with these sample tables; sample files are shared across examples on this page. Run this setup first when trying the examples in your own DuckDB session.

-- Fixtures for the hashfuncs cookbook / technical-details examples.
--
-- The hashfuncs extension itself is pure CPU (no catalog, no network),
-- so these fixtures only exist to satisfy the *table references* the
-- documentation makes ("FROM events", "FROM users", ...). The numbers
-- chosen are tiny and deterministic so re-running the suite is stable.
--
-- Idempotent: every CREATE uses OR REPLACE.

-- The bitfilters cookbook section pairs hashfuncs with the bitfilters
-- extension. Load it best-effort so xor8_filter / xor8_filter_contains
-- resolve at parse time. If the community binary isn't available on the
-- current platform we still want the rest of the fixtures to apply.
INSTALL bitfilters FROM query_farm;
LOAD bitfilters FROM query_farm;

-- cookbook.mdx — "Hash partitioning" and "Independent hashes via seeds"
CREATE OR REPLACE TABLE users AS
SELECT i AS user_id
FROM range(0, 8) t(i);

-- cookbook.mdx — "Cross-system routing (Cassandra / Spark)"
CREATE OR REPLACE TABLE rows_to_route AS
SELECT 'k' || i::VARCHAR AS key
FROM range(0, 4) t(i);

-- cookbook.mdx — "String cache keys"
CREATE OR REPLACE TABLE query_log AS
SELECT i AS user_id,
       'select ' || i::VARCHAR AS query_text
FROM range(0, 4) t(i);

-- cookbook.mdx — "Bloom / XOR / Cuckoo filter input"
CREATE OR REPLACE TABLE allowed_users AS
SELECT 'user' || i::VARCHAR || '@example.com' AS email
FROM range(0, 4) t(i);

-- cookbook.mdx — second bitfilters block reads from `filter_table f`
-- (a one-row table holding a pre-built xor8 filter).
CREATE OR REPLACE TABLE filter_table AS
SELECT xor8_filter(xxh3_64(email)) AS filter
FROM allowed_users;

-- cookbook.mdx — "Independent hashes via seeds" uses `FROM keys`
CREATE OR REPLACE TABLE keys AS
SELECT 'k' || i::VARCHAR AS key
FROM range(0, 4) t(i);

-- cookbook.mdx + technical-details.mdx — "events" with event_id, payload
-- Used by sharding / dedup / "magic moment" examples.
CREATE OR REPLACE TABLE events AS
SELECT i AS event_id,
       'evt-' || i::VARCHAR AS payload,
       'user' || i::VARCHAR || '@example.com' AS email
FROM range(0, 8) t(i);

-- technical-details.mdx — "double-hash with two seeds" reads `FROM data`
CREATE OR REPLACE TABLE data AS
SELECT 'k' || i::VARCHAR AS key
FROM range(0, 4) t(i);

Function category

CRC-32C & FNV-1a

3 functions

crc32c

Scalar function CRC-32C & FNV-1a
Signature
2 overloaded forms · click to inspect
Arguments (Positional)
Argument value Type ANY Mode Positional Description
Description
1 Standard check value
SELECT crc32c('123456789'), printf('%08X', crc32c('123456789'));

Output

crc32c('123456789') printf('%08X', crc32c('123456789'))
3808858755 E3069283
2 Extend a checksum across pieces
SELECT crc32c('6789', crc32c('12345')) = crc32c('123456789');

Output

(crc32c('6789', crc32c('12345')) = crc32c('123456789'))
true

fnv1a_32

Scalar function CRC-32C & FNV-1a
Signature
fnv1a_32(value: ANY) → UINTEGER
Arguments (Positional)
Argument value Type ANY Mode Positional Description
Description
1 Hash a string
SELECT fnv1a_32('hello world');

Output

fnv1a_32('hello world')
3582672807

fnv1a_64

Scalar function CRC-32C & FNV-1a
Signature
fnv1a_64(value: ANY) → UBIGINT
Arguments (Positional)
Argument value Type ANY Mode Positional Description
Description
1 Hash a string
SELECT fnv1a_64('hello world');

Output

fnv1a_64('hello world')
8618312879776256743