Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: support Substrait ExtendedExpression #776

Open
danepitkin opened this issue Oct 3, 2023 · 1 comment
Open

feat: support Substrait ExtendedExpression #776

danepitkin opened this issue Oct 3, 2023 · 1 comment

Comments

@danepitkin
Copy link

It would be neat if we could create Substrait expressions from Ibis expressions. One use case would be to project/filter pyarrow datasets. See https://gist.github.com/ianmcook/f70fc185d29ae97bdf85ffe0378c68e0 for an example that could benefit from this feature.

@gforsyth
Copy link
Member

gforsyth commented Oct 5, 2023

Definitely seems doable -- I think we have all of the appropriate rules in the compiler.
Probably we would want to be able to specify whether we were compiling to a plan or ExtendedExpression when instantiating SubstraitCompiler.

Also, a collection of example ExtendedExpressions and the corresponding ibis code that we think would generate them would go a long ways towards getting this off the ground.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: backlog
Development

No branches or pull requests

2 participants