Skip to content

[#12063] fix(hudi): complete V3 type compatibility#12079

Draft
nevzheng wants to merge 5 commits into
apache:mainfrom
nevzheng:codex/v3-phase2-hudi
Draft

[#12063] fix(hudi): complete V3 type compatibility#12079
nevzheng wants to merge 5 commits into
apache:mainfrom
nevzheng:codex/v3-phase2-hudi

Conversation

@nevzheng

Copy link
Copy Markdown
Collaborator

What changes were proposed in this pull request?

Define and document Hudi compatibility for the five Gravitino V3-native type families.

Nanosecond timestamps, Variant, Unknown/Null, Geometry, and Geography are rejected before invoking the Hudi backend.

Why are the changes needed?

The current Hudi catalog path cannot preserve the complete semantics of these families. Early validation provides deterministic behavior and prevents a rejected schema from reaching backend operations.

Fix: #12063

Related: #12056

Does this PR introduce any user-facing change?

Yes. Unsupported V3-native schemas now fail explicitly before backend invocation.

How was this patch tested?

  • Added focused converter and operation rejection coverage.
  • Verified an in-memory backend is not called.
  • Verified no table exists after rejection.
  • Updated docs/lakehouse-hudi-catalog.md.

@github-actions

Copy link
Copy Markdown

Code Coverage Report

Overall Project 67.88% -0.01% 🟢
Files changed 55.74% 🔴

Module Coverage
aliyun 1.72% 🔴
api 47.82% 🟢
authorization-common 85.96% 🟢
aws 42.04% 🟢
azure 2.47% 🔴
catalog-common 9.92% 🔴
catalog-fileset 80.23% 🟢
catalog-glue 66.91% 🟢
catalog-hive 79.42% 🟢
catalog-jdbc-clickhouse 81.74% 🟢
catalog-jdbc-common 44.22% 🟢
catalog-jdbc-doris 81.6% 🟢
catalog-jdbc-hologres 54.03% 🟢
catalog-jdbc-mysql 79.23% 🟢
catalog-jdbc-oceanbase 80.91% 🟢
catalog-jdbc-postgresql 82.29% 🟢
catalog-jdbc-starrocks 78.51% 🟢
catalog-kafka 77.01% 🟢
catalog-lakehouse-generic 59.18% 🟢
catalog-lakehouse-hudi 76.84% -6.1% 🟢
catalog-lakehouse-iceberg 86.48% 🟢
catalog-lakehouse-paimon 84.25% 🟢
catalog-model 77.72% 🟢
cli 44.5% 🟢
client-java 78.29% 🟢
common 51.95% 🟢
core 82.53% 🟢
filesystem-hadoop3 77.3% 🟢
flink 0.0% 🔴
flink-common 47.09% 🟢
flink-runtime 0.0% 🔴
gcp 14.12% 🔴
hadoop-auth 68.0% 🟢
hadoop-common 12.7% 🔴
hive-metastore-common 53.29% 🟢
iceberg-common 63.63% 🟢
iceberg-rest-server 74.9% 🟢
idp-basic 86.02% 🟢
integration-test-common 0.0% 🔴
jobs 66.17% 🟢
lance-common 20.67% 🔴
lance-rest-server 64.84% 🟢
lineage 53.02% 🟢
optimizer 83.24% 🟢
optimizer-api 21.95% 🔴
server 85.97% 🟢
server-common 75.78% 🟢
spark 28.57% 🔴
spark-common 46.01% 🟢
tencent 69.84% 🟢
trino-connector 40.29% 🟢
Files
Module File Coverage
catalog-lakehouse-hudi HudiCatalogOperations.java 55.74% 🔴

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Subtask] Complete V3 type compatibility for the Hudi catalog

1 participant