Commit ee609b6
Skip RowFilter and page pruning for fully matched row groups
When row group statistics prove that ALL rows satisfy the filter
predicate, skip both RowFilter evaluation (late materialization)
and page index pruning for those row groups. This avoids wasted
work decoding filter columns and evaluating predicates that produce
no useful filtering.
Depends on apache/arrow-rs#9694 for the `with_fully_matched_row_groups()`
builder API.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>1 parent 65f337d commit ee609b6
7 files changed
Lines changed: 456 additions & 163 deletions
File tree
- datafusion/datasource-parquet
- benches
- src
0 commit comments