Compare commits

...
18 Commits
Author SHA1 Message Date
David Gasquez 72bb29417e Update Quack on Demand link to renamed repo 2026-11-16 11:11:56 +01:00
Pitch devandDavid Gasquez 3b5e6785b6 Add orkidea (#428)
* Add orkidea to Other Extensions

* Move orkidea to Community Extensions

---------

Co-authored-by: David Gasquez <[email protected]>
2026-11-16 11:10:08 +01:00
William HawandDavid Gasquez 503e6a9c48 Add ducktape REST API to client-server setups (#426)
* Add ducktape REST API to client-server setups

* Move ducktape to the end of Client-Server Setups

---------

Co-authored-by: David Gasquez <[email protected]>
2026-11-16 11:09:36 +01:00
Mourad DACHRAOUI b3ba322476 Add Quack on Demand to Client-Server Setups (#425) 2026-11-16 11:09:02 +01:00
Yusuke Hayashi da26267aeb Add sqrail to Data APIs, Integration & AI Access (#430) 2026-11-16 11:08:56 +01:00
Sam Nikaein f64309e4d6 Update README.md (#427)
add Ternlux to ETL, Pipelines & Orchestration
2026-11-16 11:08:51 +01:00
RaphaelandDavid Gasquez a29374b8cd Add QoreDB (#424)
* Add QoreDB

* Move QoreDB to the end of SQL Clients

---------

Co-authored-by: David Gasquez <[email protected]>
2026-11-13 13:05:39 +01:00
Gabor Szarnyas eb97cd27ae Add aantje to SQL Clients and IDE that Support DuckDB (#422) 2026-11-13 13:05:06 +01:00
dooraprandClaude Opus 5.5 92dd5aaa8a Add DbSchema to SQL clients and IDEs (#421)
Co-authored-by: Claude Opus 5.5 <[email protected]>
2026-11-11 11:19:15 +01:00
Mohammad Hamarsheh 894ae2438f Add crossql to Query Engines, Federation & Warehouses (#420) 2026-11-11 11:19:10 +01:00
Jakub RomanandDavid Gasquez 97d04b46a2 Add Folio to File Viewers & Pivot Tables (#418)
* add folio

* Shorten Folio description

---------

Co-authored-by: David Gasquez <[email protected]>
2026-11-10 09:00:58 +01:00
ChinhandDavid Gasquez 6ead8dc5a9 Add OrcaQ to SQL Clients and IDE (#417)
Co-authored-by: David Gasquez <[email protected]>
2026-11-10 09:00:28 +01:00
Saloni Gupta 8a71a67e84 Add Filament MotherDuck sink to Integrations (#419) 2026-11-10 08:59:41 +01:00
Max 987cec9c80 Add NiceDB to SQL clients (#416) 2026-11-10 08:59:35 +01:00
Daniel Guzmán Burgos 4dc0ff04f0 Update DBTrail description and paid-tier link (#415) 2026-11-05 09:01:24 +01:00
Daniel McDonald 6dd22952f9 Add the miint community extension, and project Qiita-MIINT (#413)
* Add the miint community extension, and project Qiita-MIINT

* Addressing @davidgasguez's comments
2026-11-05 09:01:18 +01:00
Alper SanandAlper San 128abb1e0d Add synthetic CSV DuckDB tutorial link (#414)
Co-authored-by: Alper San <[email protected]>
2026-11-04 19:50:41 +01:00
anshuman-pandeyandAnshuman Pandey b90e50ba3c Add US Bank Data research resource (#412)
Co-authored-by: Anshuman Pandey <[email protected]>
2026-11-04 19:50:36 +01:00
+18 -1
View File
@@ -170,7 +170,7 @@ DuckDB 2.0.0 was released on 2026-10-21: see the [announcement blog post](https:
#### Open Core (Free & Open Source + Optional Paid/Hosted Tier)
- [SQLMesh](https://github.com/TobikoData/sqlmesh) - A next-generation data transformation and modeling framework with support for DuckDB connections for state, transformations & running unit tests locally. ([Tobiko Cloud](https://tobikodata.com))
- [DBTrail](https://github.com/dbtrail/dbtrail) - Keeps MySQL tables as Parquet snapshots updated from the binlog, with a generated `views.sql` so DuckDB queries them as tables. Also keeps every version of every row. ([pricing](https://dbtrail.com/pricing))
- [DBTrail](https://github.com/dbtrail/dbtrail) - Analytical replica for MySQL: follows the binlog like a replica and keeps the tables as Parquet snapshots in a folder or S3 bucket, with a generated `views.sql` so DuckDB queries them as tables. Also answers the same SQL on a MySQL-protocol port backed by DuckDB, and keeps every version of every row. ([dbtrail.com](https://dbtrail.com))
#### Free & Open Source
@@ -180,6 +180,7 @@ DuckDB 2.0.0 was released on 2026-10-21: see the [announcement blog post](https:
- [ETLX](https://github.com/realdatadriven/etlx) - DuckDB-powered ETL tool written in Go, inspired by evidence.dev's syntax. It uses a structured Markdown config where heading levels define nested blocks, yaml code blocks specify metadata, and sql code blocks handle data interactions. Enables clean, code-light orchestration with minimal setup.
- [yato](https://github.com/Bl3f/yato) - The smallest DuckDB SQL orchestrator on Earth.
- [Renart](https://getrenart.com/) - Local-first open source data platform for SQL and Python pipelines, notebooks and dashboards, with DuckDB support and declarative workflow definitions in Git.
- [Ternlux](https://github.com/Ternlux/ternlux) - Open-source desktop app for ETL and data analysis. Joins databases, files and APIs in one step, running the join locally in DuckDB or pushing it down to the source database. An AI assistant drafts the plan and SQL for review before anything runs, using your own API key or a local model.
#### Free (Proprietary / Source-Available)
@@ -205,6 +206,7 @@ DuckDB 2.0.0 was released on 2026-10-21: see the [announcement blog post](https:
- [DataSpoc Lens](https://github.com/dataspoclab/dataspoc-lens) - Virtual warehouse over cloud Parquet. SQL shell, Jupyter/Marimo notebooks, AI natural language queries, and local cache — all powered by DuckDB.
- [Hugr](https://hugr-lab.github.io/) - An data mesh platform and high-performance GraphQL backend powered by DuckDB.
- [UniverSQL](https://github.com/buremba/universql) - An implementation of Snowflake API, enables running queries on Snowflake tables locally with DuckDB without a running warehouse.
- [crossql](https://github.com/hamarshehmhmd/crossql) - CLI that attaches Postgres, MySQL, SQLite and DuckDB databases plus CSV/Parquet/JSON files to DuckDB read-only, so one SQL query can join across them, and snapshots named queries into a SQLite/DuckDB file or Parquet folder for BI tools. (AGPL-3.0)
#### Free (Proprietary / Source-Available)
@@ -224,6 +226,7 @@ DuckDB 2.0.0 was released on 2026-10-21: see the [announcement blog post](https:
- [PocketDuck](https://github.com/mailbus/PocketDuck) - Single-binary backend pairing PocketBase (auth, files, realtime) with an embedded DuckDB runtime: read-only analytics API, cross-source joins over Parquet/CSV/SQLite/PostgreSQL/MySQL, and exports to Parquet, PostgreSQL and Excel.
- [duckdb-vectors](https://github.com/bernard357/duckdb-vectors) - MCP or embeddable semantic-search building block for agentic systems — hybrid vector + exact-token search over a local DuckDB file, no external vector database.
- [schemagate](https://github.com/ashishsinha1602/schemagate) - Python library and MCP server for text-to-SQL agents that gives the model only the tables a question needs and the caller may read. Reflects a DuckDB file through duckdb-engine.
- [sqrail](https://github.com/yhay81/sqrail) - Single-binary C++20 CLI around embedded DuckDB that runs one read-only SQL query over explicitly bound CSV, TSV, JSON, JSONL, and Parquet files with resource limits, streaming JSONL or atomic file output, and a 195-word contract for coding agents. MIT.
### Product, Web & Application Analytics
@@ -279,6 +282,7 @@ DuckDB 2.0.0 was released on 2026-10-21: see the [announcement blog post](https:
- [duckdb.yazi](https://github.com/wylie102/duckdb.yazi) - Preview csv/tsv, json, and Parquet files in the yazi file manager using duckdb. View the raw data, or a "summarized" view with data-types, min, max, avg etc. for all columns.
- [Huey](https://github.com/rpbouman/huey) - Blazing-fast & intuitive pivot tables on Parquet, CSV, JSON files and DuckDB tables in the browser based on DuckDB-Wasm. open-source (MIT). Zero install!
- [Parquet Explorer](https://marketplace.visualstudio.com/items?itemName=AdamViola.parquet-explorer) - Visual Studio Code extension for exploring Parquet files with SQL, powered by DuckDB.
- [Folio](https://github.com/jakubro/folio) - Serves a folder of markdown and data files as browser pages, using DuckDB to open CSV, JSON Lines, Parquet and DuckDB files as sortable tables and to run SQL written in the documents. GPL-3.0.
### Notebooks & Embedded Engines
@@ -418,6 +422,11 @@ DuckDB 2.0.0 was released on 2026-10-21: see the [announcement blog post](https:
- [Pilotbase](https://github.com/icedsg/pilotbase) - Database client that opens DuckDB files alongside PostgreSQL, MySQL, SQLite, MongoDB and vector databases, with a SQL editor, schema tree and SQL export. MIT licensed, runs in Docker or as a desktop app.
- [DuckLocal](https://github.com/JetSquirrel/DuckLocal) - Open-source desktop workspace built on DuckDB for querying local CSV, Parquet, JSON, Excel, and DuckDB files, with a SQL editor, visualizations, and interactive dashboards.
- [dbxlite for VS Code](https://marketplace.visualstudio.com/items?itemName=dbxlite.dbxlite) - Freemium VS Code extension with DuckDB 2.0 bundled. Queries CSV, Parquet, JSON, Excel and DuckDB files and S3, and joins them with PostgreSQL and MySQL sources. Also connects to SQLite and Databricks.
- [NiceDB](https://github.com/maxib0n/NiceDB) - Open-source desktop database client with DuckDB support, including query plans and Parquet import and export.
- [OrcaQ](https://github.com/cin12211/orca-q) - Free, open-source (MIT) desktop database editor that opens DuckDB files alongside PostgreSQL, MySQL, SQLite and more, with streamed query results, schema diff between two DuckDB files and a read-only MCP server.
- [DbSchema](https://dbschema.com/databases/duckdb/) - Commercial visual database designer with a free Community Edition. Opens DuckDB files to draw ER diagrams of tables and views, run SQL queries and generate HTML schema documentation.
- [aantje](https://aantje.dev/) - Free, open-source (MIT) VS Code extension for exploring DuckLake catalogs backed by DuckDB, SQLite or PostgreSQL: browse schemas, tables and snapshots, run SQL with IntelliSense, and monitor table health, storage and growth.
- [QoreDB](https://github.com/QoreDB/QoreDB) - Open-core desktop SQL client built with Rust and Tauri that opens DuckDB files and MotherDuck databases and queries local CSV and Parquet files. Its paid tier uses DuckDB to join data across connections to other databases.
## Projects Powered by DuckDB
@@ -442,6 +451,7 @@ DuckDB 2.0.0 was released on 2026-10-21: see the [announcement blog post](https:
- [AskCSV](https://github.com/Sahilll15/askcsv) - Ask questions about a CSV in plain English. The file is loaded into DuckDB-WASM in the browser, a model writes a read-only DuckDB query from the schema alone, and failed queries are repaired automatically.
- [GitHub Repo Analytics](https://github.com/exmergo/github-repo-analytics) - GitHub Actions template that collects a repository's traffic, stars, downloads, and issue/PR activity into a DuckDB file, modeled with dbt and MetricFlow, keeping traffic history beyond GitHub's 14-day limit.
- [Dublin bikes + weather pipeline](https://malavnaik.com/projects/dublin-bikes-pipeline/) - Example pipeline that loads Dublinbikes station snapshots and Met Éireann weather into DuckDB, models them with dbt into a tested star schema, and publishes the marts as Parquet with an in-browser DuckDB-WASM query console.
- [Qiita-MIINT](https://the-miint.github.io/qiita/) - Qiita is a scalable, multi-omic platform for managing, processing, and analyzing microbiome data, built entirely around DuckDB and the MIINT extension.
## Integrations
@@ -479,6 +489,7 @@ DuckDB 2.0.0 was released on 2026-10-21: see the [announcement blog post](https:
- [ingestr](https://github.com/bruin-data/ingestr) - CLI tool to copy data between databases and SaaS sources, with DuckDB supported as both a source and a destination.
- [omniload](https://github.com/panodata/omniload) - Polyglot data loader for ETL, warehousing and more, based on dlt. Supports 140+ source/destination adapters. Derived from ingestr v0 (MIT).
- [Scherlok](https://github.com/rbmuller/scherlok) - Data quality monitoring CLI that profiles tables and detects anomalies (volume, freshness, schema drift, NULL rates, distributions) without configuration; DuckDB is one of its connectors and backs its built-in demo.
- [Filament MotherDuck sink](https://github.com/galaxy-io/filament/blob/main/docs/pages/connectors/sinks/motherduck.mdx) - Load data from databases and SaaS APIs to MotherDuck with Filament, using full, incremental or CDC replication. Writes through DuckDB's native MotherDuck extension and appender.
## Client-Server Setups
@@ -499,6 +510,8 @@ DuckDB 2.0.0 was released on 2026-10-21: see the [announcement blog post](https:
- [Hardcharger](https://github.com/gizmodata/hardcharger) - An open-source DuckDB server using [Chargewire](https://github.com/gizmodata/chargewire) (HTTP and Apache Arrow), with authentication, concurrent sessions, a desktop app for macOS and Windows, and ADBC, JDBC, ODBC, and JavaScript clients.
- [SlackerDB](https://github.com/robotslacker/slackerdb) - Java-based service that exposes DuckDB over the PostgreSQL wire protocol.
- [GizmoData Cloud](https://gizmodata.com/cloud) - Managed Hardcharger (DuckDB) and GizmoSQL servers on AWS, Google Cloud or Azure. Create DuckLake catalogs or connect an existing Apache Iceberg REST catalog (such as Apache Polaris or Lakekeeper), and mount them on any number of clusters.
- [Quack on Demand](https://github.com/starlake-ai/qod) - Multi-tenant gateway serving DuckDB and DuckLake over Arrow Flight SQL and DuckDB's native Quack protocol, with pluggable authentication (DB/JWT/OIDC), table-, row- and column-level security, and read/write-aware routing across pools of DuckDB nodes.
- [ducktape](https://github.com/artie-labs/ducktape) - Lightweight REST API for DuckDB with HTTP/2 streaming support.
## Extensions
@@ -565,12 +578,14 @@ Community-contributed DuckDB extensions, which can be installed via `INSTALL ⟨
- [`jsonata`](https://query.farm/products/extensions/jsonata/) - Evaluates JSONata expressions against JSON values in SQL.
- [`lindel`](https://query.farm/products/extensions/lindel/) - Linearization/Delinearization, Z-Order, Hilbert and Morton Curves.
- [`marisa`](https://query.farm/products/extensions/marisa/) - Builds and queries compact MARISA tries for string lookup and prefix search.
- [`miint`](https://the-miint.github.io/duckdb-miint/) - Open, SQL-native tools for microbiome data, from raw sequence and alignment to phylogeny, diversity, and mass spectrometry, built for the scale of modern multi-omic studies.
- [`minijinja`](https://query.farm/products/extensions/minijinja/) - Renders Jinja-compatible templates from SQL using MiniJinja.
- [`ml`](https://github.com/alitrack/duckdb-ml) - Lightweight, columnar-native ML for DuckDB — train + inference, 34 algorithms, zero Python deps.
- [`netquack`](https://github.com/hatamiarash7/duckdb-netquack) - Parsing, extracting, and analyzing domains, URIs, and paths with ease.
- [`observefs`](https://github.com/dentiny/duckdb-filesystem-observability) - I/O observability for DuckDB filesystems with latency statistics and external file cache access insights.
- [`onager`](https://github.com/CogitatorTech/onager) - A DuckDB extension for graph data analytics.
- [`orc`](https://github.com/alitrack/duckdb_orc) - Reads Apache ORC files in pure Rust — all primitives, struct, list, map types and every compression codec (Zlib, Snappy, LZO, LZ4, ZSTD).
- [`orkidea`](https://github.com/Tnsor-Labs/duckdb-orkidea) - Extension to attach Oracle Database and query, join, and write its tables from DuckDB, running filters, joins, and aggregates in Oracle. Built on a Rust ADBC driver that reads Arrow directly, so it needs no Oracle Instant Client.
- [`pfc`](https://github.com/ImpossibleForge/pfc-duckdb) - Read block-indexed PFC-compressed JSONL logs with timestamp filtering — 25% smaller than gzip with minimal S3 egress.
- [`prql`](https://github.com/ywelsch/duckdb-prql) - Run PRQL commands directly within DuckDB.
- [`pst`](https://github.com/intellekthq/duckdb-pst) - Read Microsoft PST files in-place with rich schemas for emails, contacts, appointments, tasks, and more.
@@ -622,6 +637,7 @@ Community-contributed DuckDB extensions, which can be installed via `INSTALL ⟨
- [DBQuacks](https://dbquacks.com/tutorial/1) - An interactive SQL tutorial powered by DuckDB.
- [GeoSQL](https://geosql.dev) - Interactive spatial SQL problems powered by DuckDB-WASM, running entirely in the browser.
- [U.S. bank cohort analysis with DuckDB](https://github.com/anshuman-pandey/us-bank-data/blob/v0.2.0/notebooks/05_polars_duckdb_bank_data.ipynb) - A reproducible notebook using DuckDB to query bank financial Parquet, join institution identities, and check aggregates and null counts against Polars.
## Media
@@ -678,6 +694,7 @@ Community-contributed DuckDB extensions, which can be installed via `INSTALL ⟨
- [Building duckdb-pst](https://intellekt.fyi/2026/02/03/the-data-warehouse-in-your-email-archive-teaching-duckdb-to-speak-outlook/) - How to go from 0 to a production-ready DuckDB extension for Outlook PSTs, including table functions, MAPI schema serialization, projection/statistics pushdown, concurrent planning, and late materialization.
- [How to Query Reservoir's Hyperliquid Data](https://hydromancer.xyz/blog/exploring-reservoir) - Using DuckDB's httpfs extension and `read_parquet` to query Hyperliquid fills, candles and order book snapshots stored as Parquet in a requester-pays S3 bucket, pulling only the columns and time ranges a query needs.
- [DuckDB Explained: When a Database on Your Laptop Beats SQLite, Polars and BigQuery](https://www.alekseialeinikov.com/en/blog/topics/data/duckdb-explained-vs-sqlite-polars-bigquery) - Reproducible benchmark of DuckDB against SQLite, pandas and Polars on 11.2 million NYC taxi trips, where it replaces a warehouse and where it does not, with notes on DuckDB 2.0.
- [Five DuckDB recipes for market data CSV exports](https://sifting.io/blog/duckdb-market-data-csv-five-sql-recipes) - DuckDB 1.x SQL examples using a synthetic CSV to check coverage and timestamp gaps, build UTC daily bars, and calculate close returns and rolling means.
### Books