Vortex's ScanBuilder::with_filter() couples zone-map pruning with
row-level evaluation. At the storage layer the row-level filter is
redundant because the compute layer filters again, so we pay for it
twice when selectivity is low.
Investigate whether Vortex exposes (or can expose) a prune-only API
that performs zone-map / statistics-based chunk pruning without
materializing row-level filter results. If not available, consider
filing upstream.
Captured from review of PR #511:
#511 (comment)
Vortex's ScanBuilder::with_filter() couples zone-map pruning with
row-level evaluation. At the storage layer the row-level filter is
redundant because the compute layer filters again, so we pay for it
twice when selectivity is low.
Investigate whether Vortex exposes (or can expose) a prune-only API
that performs zone-map / statistics-based chunk pruning without
materializing row-level filter results. If not available, consider
filing upstream.
Captured from review of PR #511:
#511 (comment)