Question: Can the Extension Template Be Used for Filesystem Integrations?

[chitralverma]

Hi,
I’m interested in creating a custom filesystem extension using this template and was wondering if this is currently supported.

If so, could you provide guidance or point me to any documentation or examples that demonstrate how to do this so it can be used with functions like read_parquet etc.

If this approach isn’t supported through the template, is there an existing issue, proposal, or tracking link related to this type of functionality that I could follow for reference?

Any pointers on the recommended approach or architectural considerations would be greatly appreciated.

Thanks in advance!

[Maxxen]

Not yet, but its on our todo list for sure. I dont have an exact timeline but we are planning to invest a lot into the c-api for v1.6 and the long term goal is to eventually move most of the core extensions to the c-api and so we do need support for custom filesystems before that can happen.

[chitralverma]

This @Maxxen for the clarification. 2 questions here -

• For someone starting out with an extension, would you suggest waiting for the 1.6.x stuff or shall i proceed with the c++ template.
• im not a c/ c++ expert here, but if you can help me with some reference PRs for these capabilities, I can try taking a shot at this? someone also asked about the same thing here Filesystem extensions extension-template-rs#18