Skip to content

[pull] dev from apache:dev - #160

Merged
pull[bot] merged 1 commit into
hugegraph:devfrom
apache:dev
Aug 5, 2026
Merged

[pull] dev from apache:dev#160
pull[bot] merged 1 commit into
hugegraph:devfrom
apache:dev

Conversation

@pull

@pull pull Bot commented Aug 5, 2026

Copy link
Copy Markdown

See Commits and Changes for more details.


Created by pull[bot] (v2.0.0-alpha.4)

Can you help keep this open source service alive? 💖 Please sponsor : )

Greptile Summary

The PR substantially expands the HugeGraph connector with a bounded source, multi-mapping sink support, schema/data save modes, richer mapping and retry behavior, and corresponding documentation and tests.

  • Adds paged, sharded, checkpoint-aware vertex and edge source reads, including all-label mode and schema discovery.
  • Refactors sink buffering, mapping, update/delete handling, fallback diagnostics, and topology-aware flushing.
  • Adds automatic schema management and label-scoped data cleanup.
  • Extends unit and end-to-end coverage for source, sink, mapping, schema, and multi-table behavior.

Confidence Score: 5/5

The PR appears safe to merge based on the reviewed source, sink, lifecycle, schema, and cleanup paths.

The changed implementation consistently checkpoints source progress, orders buffered graph writes, surfaces flush failures, scopes destructive cleanup by mapped labels, and includes focused tests for the principal new behaviors; no actionable changed-code failure remained.

Important Files Changed

Filename Overview
seatunnel-connectors-v2/connector-hugegraph/src/main/java/org/apache/seatunnel/connectors/seatunnel/hugegraph/source/HugeGraphSourceReader.java Implements bounded page and shard reads with label filtering, checkpointed cursor state, duplicate suppression, and terminal-page handling.
seatunnel-connectors-v2/connector-hugegraph/src/main/java/org/apache/seatunnel/connectors/seatunnel/hugegraph/source/HugeGraphSourceSplitEnumerator.java Creates and assigns page, shard, and all-label splits while preserving restored enumerator state.
seatunnel-connectors-v2/connector-hugegraph/src/main/java/org/apache/seatunnel/connectors/seatunnel/hugegraph/sink/HugeGraphSinkWriter.java Adds multi-mapping routing and coordinated insert, update, and delete plans with checkpoint and close flushing.
seatunnel-connectors-v2/connector-hugegraph/src/main/java/org/apache/seatunnel/connectors/seatunnel/hugegraph/buffer/BatchBuffer.java Separates vertex and edge buffering, enforces configured topology ordering, and adds bounded single-record fallback and diagnostics.
seatunnel-connectors-v2/connector-hugegraph/src/main/java/org/apache/seatunnel/connectors/seatunnel/hugegraph/sink/HugeGraphSaveModeHandler.java Implements schema preparation and label-scoped DROP_DATA cleanup with checks for cascading deletion of unmapped edges.
seatunnel-connectors-v2/connector-hugegraph/src/main/java/org/apache/seatunnel/connectors/seatunnel/hugegraph/client/HugeGraphClient.java Broadens REST operations for source pagination, shards, schema discovery, retries, batch writes, and label-scoped deletion.
seatunnel-connectors-v2/connector-hugegraph/src/main/java/org/apache/seatunnel/connectors/seatunnel/hugegraph/utils/SchemaManager.java Adds automatic creation and reconciliation of HugeGraph property keys and vertex and edge labels.
seatunnel-connectors-v2/connector-hugegraph/src/main/java/org/apache/seatunnel/connectors/seatunnel/hugegraph/utils/SchemaValidator.java Extends validation for source schemas, mappings, cardinality, nullability, identifiers, and existing server definitions.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart LR
  HG[(HugeGraph REST API)]
  SC[Source configuration]
  EN[Split enumerator]
  SR[Source readers]
  ST[SeaTunnel tables]
  SW[Multi-mapping sink writer]
  VB[Vertex buffer]
  EB[Edge buffer]
  SM[Schema and save-mode handler]

  SC --> EN
  EN -->|Page, shard, or label splits| SR
  HG -->|Vertices and edges| SR
  SR --> ST
  ST --> SW
  SM -->|Prepare schema and optional label cleanup| HG
  SW --> VB
  SW --> EB
  VB -->|Flush first| HG
  EB -->|Flush after vertices when required| HG
Loading

Reviews (1): Last reviewed commit: "[Feature][Connector-V2] Add HugeGraph so..." | Re-trigger Greptile

…ink with multi-mapping support (#11413)

Co-authored-by: ljx <17703949750@163.com>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Co-authored-by: kl1l <Kayson.J.Liu@newegg.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
@pull pull Bot locked and limited conversation to collaborators Aug 5, 2026
@pull pull Bot added the ⤵️ pull label Aug 5, 2026
@pull
pull Bot merged commit 543f2a5 into hugegraph:dev Aug 5, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant