feature request: Supported backend through Ibis

[gregorywaynepower]

I saw y’all’s post and are y’all planning on being integrated as a backend for Ibis?

[linhr]

This is a great idea!

Since Sail aims to be fully compatible with PySpark, you can actually use the PySpark backend for Ibis but point the Spark Session to a remote Spark Connect server powered by Sail. We had some prototype in our unit test setup in #91. We will do more testing and provide user guide in our future releases.

It's also possible to connect Ibis with the lower-level internal Sail SQL API, without using the Spark Connect protocol in between. This could be a longer term project.