Skip to content

[pull] dev from apache:dev - #159

Merged
pull[bot] merged 1 commit into
hugegraph:devfrom
apache:dev
Aug 5, 2026
Merged

[pull] dev from apache:dev#159
pull[bot] merged 1 commit into
hugegraph:devfrom
apache:dev

Conversation

@pull

@pull pull Bot commented Aug 5, 2026

Copy link
Copy Markdown

See Commits and Changes for more details.


Created by pull[bot] (v2.0.0-alpha.4)

Can you help keep this open source service alive? 💖 Please sponsor : )

Greptile Summary

The PR introduces a standard logical metadata contract for Knowledge Sync document and chunk identity and enables explicit projection through the existing Metadata transform.

  • Adds canonical Knowledge Sync metadata keys, physical names, data types, and nullability declarations.
  • Registers the new keys with metadata-field validation.
  • Refactors metadata projection to distinguish computed common metadata from schema-declared row options.
  • Adds API and transform tests plus English and Chinese documentation.

Confidence Score: 5/5

The PR appears safe to merge with no actionable changed-code defects identified.

The new metadata keys are accepted only by the Metadata transform, schema-declared fields are validated before projection, row options are preserved through the transform path, and the refactor retains existing computed common-metadata behavior.

Important Files Changed

Filename Overview
seatunnel-api/src/main/java/org/apache/seatunnel/api/table/type/KnowledgeSyncMetadataField.java Defines the Knowledge Sync metadata keys, canonical physical names, types, nullability, and metadata-column conversion.
seatunnel-api/src/main/java/org/apache/seatunnel/api/table/type/MetadataUtil.java Registers Knowledge Sync logical keys as supported explicit metadata projections without affecting unrelated production callers.
seatunnel-transforms-v2/src/main/java/org/apache/seatunnel/transform/metadata/MetadataTransform.java Refactors common metadata handling and projects schema-declared Knowledge Sync values from row options with missing-schema validation.
seatunnel-api/src/test/java/org/apache/seatunnel/api/table/type/KnowledgeSyncMetadataFieldTest.java Verifies metadata registration, names, types, physical names, and lifecycle nullability.
seatunnel-transforms-v2/src/test/java/org/apache/seatunnel/transform/metadata/MetadataTransformTest.java Covers successful Knowledge Sync projection and rejection when the input metadata schema lacks the requested key.
docs/en/transforms/metadata.md Documents the producer contract, canonical projections, nullability, compatibility, and SourceUri credential-sanitization requirement.
docs/zh/transforms/metadata.md Adds the corresponding Chinese documentation for the Knowledge Sync metadata contract and projection flow.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart LR
    A[Upstream producer] -->|declares logical keys| B[CatalogTable metadata schema]
    A -->|writes values| C[SeaTunnelRow options]
    B --> D[Metadata transform validation]
    C --> E[Metadata transform projection]
    D --> E
    E --> F[Canonical physical columns]
Loading

Reviews (1): Last reviewed commit: "[Feature][API] Define Knowledge Sync met..." | Re-trigger Greptile

Co-authored-by: zengyi <zengyi@chinatelecom.cn>
@pull pull Bot locked and limited conversation to collaborators Aug 5, 2026
@pull pull Bot added the ⤵️ pull label Aug 5, 2026
@pull
pull Bot merged commit befd31c into hugegraph:dev Aug 5, 2026
2 checks passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant