Commit 0f98674
**Which issue does this PR close?**
Closes #2468
**Rationale for this change**
Auron currently rejects `BinaryType` sort keys when converting Spark
`RangePartitioning` to a native shuffle exchange.
Binary values are already supported by Auron's Arrow type conversion and
native row encoding, so this restriction causes queries that order or
range-partition by a binary column to fall back unnecessarily.
**What changes are included in this PR?**
Allows a top-level `BinaryType` sort key in native range partitioning.
Updates the existing binary range-partitioning test to assert that
`NativeShuffleExchangeExec` is used.
The general supported-type check is unchanged, so binary support is not
enabled for unrelated operators or data source scans.
**Are there any user-facing changes?**
Queries that range-partition by a binary column can now use Auron's
native shuffle path.
There are no user-facing API or configuration changes.
**How was this patch tested?**
UT.
**Was this patch authored or co-authored using generative AI tooling?**
- [x] Yes
- [ ] No
Codex was used only to Review and understand the codebase
Signed-off-by: weimingdiit <weimingdiit@gmail.com>
Co-authored-by: Shilun Fan <slfan1989@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
1 parent 2412b01 commit 0f98674
2 files changed
Lines changed: 6 additions & 2 deletions
File tree
- spark-extension-shims-spark/src/test/scala/org/apache/auron
- spark-extension/src/main/scala/org/apache/spark/sql/auron
Lines changed: 5 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
20 | 20 | | |
21 | 21 | | |
22 | 22 | | |
| 23 | + | |
23 | 24 | | |
24 | 25 | | |
25 | 26 | | |
| |||
112 | 113 | | |
113 | 114 | | |
114 | 115 | | |
115 | | - | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
116 | 120 | | |
117 | 121 | | |
118 | 122 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
447 | 447 | | |
448 | 448 | | |
449 | 449 | | |
450 | | - | |
| 450 | + | |
451 | 451 | | |
452 | 452 | | |
453 | 453 | | |
| |||
0 commit comments