From 669c74fbb27f2b7625d0327a86285d685f251fa4 Mon Sep 17 00:00:00 2001 From: Edmund Miller Date: Wed, 28 Feb 2024 11:59:30 -0600 Subject: [PATCH 1/5] Add nf-sqldb --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 2c2d163..59d5ee1 100644 --- a/README.md +++ b/README.md @@ -118,6 +118,7 @@ - [Kestra DuckDB plugin](https://kestra.io/plugins/plugin-jdbc-duckdb) — Run queries with DuckDB to schedule data transformations and process automations, and run event-driven anomaly detection pipelines. - [Arrow Flight SQL Server](https://github.com/voltrondata/flight-sql-server-example) - An example implementation of the [Arrow Flight SQL protocol](https://arrow.apache.org/docs/format/FlightSql.html) what runs in a client-server setup with DuckDB or SQLite as backends. - [SQLFlow](https://github.com/turbolytics/sql-flow): Enables SQL-based stream-processing, powered by DuckDB. +- [nf-sqldb](https://github.com/nextflow-io/nf-sqldb): This plugin provides support for interacting with SQL databases in Nextflow scripts. ## Extensions From c5b4e3ee2c01afbf74a6f7634e92cf287190568a Mon Sep 17 00:00:00 2001 From: Edmund Miller Date: Wed, 28 Feb 2024 12:02:30 -0600 Subject: [PATCH 2/5] Add Nextflow and database uses talk --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 59d5ee1..0bed45a 100644 --- a/README.md +++ b/README.md @@ -159,6 +159,7 @@ - [DuckDB An Embeddable Analytical Database @ FOSDEM](https://www.youtube.com/watch?v=nPDomZQ8jI4&ab_channel=FOSDEM) - Hannes Mühleisen. - [DuckDB tutorials playlist by Learn Data with Mark](https://www.youtube.com/watch?v=fZj6kTwXN1U&list=PLw2SS5iImhEThtiGNPiNenOr2tVvLj6H7) - Mark Needham. - [DuckDB tutorials playlist by MotherDuck](https://www.youtube.com/playlist?list=PLIYcNkSjh-0wlrFUE2VvQilLU2aBPns0K) - Mehdi Ouazza (MotherDuck). +- [Nextflow and database uses: powering data engineering, exploring DuckDB, and beyond](https://youtu.be/GknH1u3NtGI?si=PKnF__cQJ_citMUi) - Edmund Miller. ### Podcasts From 6f3af8d017198ac586d347bd486f12e654cd81a2 Mon Sep 17 00:00:00 2001 From: Edmund Miller Date: Wed, 28 Feb 2024 12:04:07 -0600 Subject: [PATCH 3/5] Add duckdb-nf --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 0bed45a..6e01c8d 100644 --- a/README.md +++ b/README.md @@ -38,6 +38,7 @@ - [Serverless DuckDB as API](https://github.com/tobilg/serverless-duckdb) - Use DuckDB as API with Amazon API Gateway and AWS Lambda. - [Serverless Parquet Repartitioner](https://github.com/tobilg/serverless-parquet-repartitioner) - Use DuckDB to repartition data in S3-based Data Lakes. - [Observable notebooks](https://observablehq.com/search?query=duckdb&sort=created&direction=desc&useES=true) - Notebooks using DuckDB on the Observable data visualization platform. +- [duckdb-nf](https://github.com/edmundmiller/duckdb-nf) - Example uses of DuckDB with Nextflow ## Client APIs From 5af47eba6eacf1067c9085b6b7b334c9d67e093a Mon Sep 17 00:00:00 2001 From: Gabor Szarnyas Date: Sat, 2 Mar 2024 21:18:31 +0100 Subject: [PATCH 4/5] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 6e01c8d..5ec9b64 100644 --- a/README.md +++ b/README.md @@ -38,7 +38,7 @@ - [Serverless DuckDB as API](https://github.com/tobilg/serverless-duckdb) - Use DuckDB as API with Amazon API Gateway and AWS Lambda. - [Serverless Parquet Repartitioner](https://github.com/tobilg/serverless-parquet-repartitioner) - Use DuckDB to repartition data in S3-based Data Lakes. - [Observable notebooks](https://observablehq.com/search?query=duckdb&sort=created&direction=desc&useES=true) - Notebooks using DuckDB on the Observable data visualization platform. -- [duckdb-nf](https://github.com/edmundmiller/duckdb-nf) - Example uses of DuckDB with Nextflow +- [duckdb-nf](https://github.com/edmundmiller/duckdb-nf) - Example uses of DuckDB with Nextflow. ## Client APIs From 094a2030ad1ce2840221f9f26150331c0a25e903 Mon Sep 17 00:00:00 2001 From: Gabor Szarnyas Date: Sat, 2 Mar 2024 21:54:52 +0100 Subject: [PATCH 5/5] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 5ec9b64..b0f7b2d 100644 --- a/README.md +++ b/README.md @@ -119,7 +119,7 @@ - [Kestra DuckDB plugin](https://kestra.io/plugins/plugin-jdbc-duckdb) — Run queries with DuckDB to schedule data transformations and process automations, and run event-driven anomaly detection pipelines. - [Arrow Flight SQL Server](https://github.com/voltrondata/flight-sql-server-example) - An example implementation of the [Arrow Flight SQL protocol](https://arrow.apache.org/docs/format/FlightSql.html) what runs in a client-server setup with DuckDB or SQLite as backends. - [SQLFlow](https://github.com/turbolytics/sql-flow): Enables SQL-based stream-processing, powered by DuckDB. -- [nf-sqldb](https://github.com/nextflow-io/nf-sqldb): This plugin provides support for interacting with SQL databases in Nextflow scripts. +- [nf-sqldb](https://github.com/nextflow-io/nf-sqldb) - This plugin provides support for interacting with SQL databases in Nextflow scripts. ## Extensions