Skip to content

minor(aqe): backport few datafusion physical rules identified as not idempotent #1806

Merged
milenkovicm merged 4 commits into
apache:mainfrom
milenkovicm:fix_backport_optimizers
Jun 3, 2026
Merged

minor(aqe): backport few datafusion physical rules identified as not idempotent #1806
milenkovicm merged 4 commits into
apache:mainfrom
milenkovicm:fix_backport_optimizers

Conversation

@milenkovicm

@milenkovicm milenkovicm commented Jun 2, 2026

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Closes #.

Rationale for this change

rules intensified by @wirybeaver as non idempotent and fixed in datafusion. as it will not get into datafusion 54 i've backported them to ballista codebase for now.

What changes are included in this PR?

  • two rules copied over
  • a rule copied over
  • creation of default datafusion optimizer set is done locally in ballista at the moment

Are there any user-facing changes?

no, only affecting AQE which is disabled by default

@milenkovicm milenkovicm requested a review from martin-g June 2, 2026 16:20
@milenkovicm

Copy link
Copy Markdown
Contributor Author

fyi @wirybeaver
will merged change on green ci

@milenkovicm milenkovicm changed the title feat(aqe): backport few datafusion physical rules identified as idempotent minor(aqe): backport few datafusion physical rules identified as not idempotent Jun 2, 2026
@milenkovicm

Copy link
Copy Markdown
Contributor Author

for some reason it produces wrong result, keeping it on hold for now

@milenkovicm milenkovicm force-pushed the fix_backport_optimizers branch from 6ca78fd to 04abf36 Compare June 2, 2026 19:52
@milenkovicm milenkovicm merged commit 35edc49 into apache:main Jun 3, 2026
18 of 19 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant