From 0e90e42f5bfd3e6cf8e9a3569fc11f86f6694cf5 Mon Sep 17 00:00:00 2001 From: Alex Merose Date: Mon, 24 Nov 2025 20:28:45 -0800 Subject: [PATCH 1/4] Adding a Roadmap section. --- README.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/README.md b/README.md index b3639f54..927bc60a 100644 --- a/README.md +++ b/README.md @@ -143,6 +143,15 @@ _2025 update_: Something like this is being built across a few projects! The one As of writing, this project is [amid integrating](https://github.com/alxmrs/xarray-sql/pull/69) a rust-based DataFusion backend provided by arrow-zarr. +## Roadmap + +- [ ] [@RohanDisa](https://github.com/RohanDisa) DataFusion Interoperability via the Python Dataframe Protocol [#86](https://github.com/alxmrs/xarray-sql/issues/86). +- [ ] Translate a single Zarr to a collection of table via DataFusion's catalog interface [#85](https://github.com/alxmrs/xarray-sql/issues/85). +- [ ] Distributed beyond a single node through the DataFusion integration with Ray Datasets [#68](https://github.com/alxmrs/xarray-sql/issues/68). +- [ ] Demo: calculate Sea Surface Temperature from 1940 - Present in SQL [#36](https://github.com/alxmrs/xarray-sql/issues/36). +- [ ] Provide an option to integrate DataFusion directly to Zarr via Rust [#4](https://github.com/alxmrs/xarray-sql/issues/4). +- [ ] (To be formally announced eventually): The 100 Trillion Row Challenge [#34](https://github.com/alxmrs/xarray-sql/issues/34). + ## Sponsors & Contributors I want to give a special thanks to the following folks and institutions: From 146f6fc746f0f4c82ceff6562032d6da336eac6f Mon Sep 17 00:00:00 2001 From: Alex Merose Date: Mon, 24 Nov 2025 20:32:28 -0800 Subject: [PATCH 2/4] Nit in the contributing guide. --- CONTRIBUTING.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md index 98f180c0..4578a238 100644 --- a/CONTRIBUTING.md +++ b/CONTRIBUTING.md @@ -28,7 +28,7 @@ appreciate your help. A few things to keep in mind: - Every contribution, big or small, matters and deserves credit. Here are a few requests for your development process: -- We require all code to be formatted with `pyink`. +- We require all code to be formatted with `pyink` (i.e., please run `uvx pyink .`). - Please include unit tests, if possible, and performance tests when you touch the core functionality (see `perf_tests/`). - It's polite to do a self review before asking for one from a maintainer. Don't stress if you forget; we all do sometimes. - Please add (or update) documentation when adding new code. We use Google Style docstrings. From 7b0b33be02da8229a116b73b9a0c6b8ee36486ba Mon Sep 17 00:00:00 2001 From: Alex Merose Date: Mon, 24 Nov 2025 20:34:48 -0800 Subject: [PATCH 3/4] link to example. --- CONTRIBUTING.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md index 4578a238..5443bda9 100644 --- a/CONTRIBUTING.md +++ b/CONTRIBUTING.md @@ -31,5 +31,5 @@ Here are a few requests for your development process: - We require all code to be formatted with `pyink` (i.e., please run `uvx pyink .`). - Please include unit tests, if possible, and performance tests when you touch the core functionality (see `perf_tests/`). - It's polite to do a self review before asking for one from a maintainer. Don't stress if you forget; we all do sometimes. -- Please add (or update) documentation when adding new code. We use Google Style docstrings. +- Please add (or update) documentation when adding new code. We use [Google Style docstrings](https://sphinxcontrib-napoleon.readthedocs.io/en/latest/example_google.html). - We are thrilled to get documentation-only PRs -- especially spelling and typo fixes (I am a bad speller). If writing tutorials excites you, it would be to everyone's benefit. From 8bf307b41f8ec89f40d84e10341f9716f1894960 Mon Sep 17 00:00:00 2001 From: Alex Merose Date: Mon, 24 Nov 2025 20:37:33 -0800 Subject: [PATCH 4/4] nit --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 927bc60a..7482503c 100644 --- a/README.md +++ b/README.md @@ -146,7 +146,7 @@ rust-based DataFusion backend provided by arrow-zarr. ## Roadmap - [ ] [@RohanDisa](https://github.com/RohanDisa) DataFusion Interoperability via the Python Dataframe Protocol [#86](https://github.com/alxmrs/xarray-sql/issues/86). -- [ ] Translate a single Zarr to a collection of table via DataFusion's catalog interface [#85](https://github.com/alxmrs/xarray-sql/issues/85). +- [ ] Translate a single Zarr to a collection of tables via DataFusion's catalog interface [#85](https://github.com/alxmrs/xarray-sql/issues/85). - [ ] Distributed beyond a single node through the DataFusion integration with Ray Datasets [#68](https://github.com/alxmrs/xarray-sql/issues/68). - [ ] Demo: calculate Sea Surface Temperature from 1940 - Present in SQL [#36](https://github.com/alxmrs/xarray-sql/issues/36). - [ ] Provide an option to integrate DataFusion directly to Zarr via Rust [#4](https://github.com/alxmrs/xarray-sql/issues/4).