Commit e75b4a0
[AMORO-4186] Add support for Parquet row-group merging in IcebergRewriteExecutor (#4188)
* Add support for Parquet row-group merging in IcebergRewriteExecutor
* Enhance Parquet row-group merge support for Iceberg V2 tables and add version checks
* Add cleanup for orphaned merged output files in Parquet row-group merge
* Refactor ParquetFileMergeRunner to simplify ParquetWriter initialization
* Implement Parquet schema context preparation for row-group merging in IcebergRewriteExecutor
* Add minimum average row-group size threshold for Parquet row-group merge
* fixup
* fixup style
Removed unnecessary line breaks in the class documentation.
* fixup style
---------
Co-authored-by: 张文领 <zhangwl9@chinatelecom.cn>1 parent 4679309 commit e75b4a0
7 files changed
Lines changed: 1004 additions & 26 deletions
File tree
- amoro-format-iceberg/src
- main/java/org/apache
- amoro
- optimizing
- table
- iceberg/parquet
- test/java/org/apache/amoro/optimizing
- docs/user-guides
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
145 | 145 | | |
146 | 146 | | |
147 | 147 | | |
148 | | - | |
| 148 | + | |
149 | 149 | | |
150 | 150 | | |
151 | 151 | | |
| |||
0 commit comments