Skip to content

SIMSBIOHUB-1060i: Integrate staged reconciliation into tarball ingestion#522

Draft
mauberti-bc wants to merge 1 commit into
SIMSBIOHUB-1060hfrom
SIMSBIOHUB-1060i
Draft

SIMSBIOHUB-1060i: Integrate staged reconciliation into tarball ingestion#522
mauberti-bc wants to merge 1 commit into
SIMSBIOHUB-1060hfrom
SIMSBIOHUB-1060i

Conversation

@mauberti-bc

@mauberti-bc mauberti-bc commented Jul 15, 2026

Copy link
Copy Markdown
Collaborator

Links to Jira Tickets

Description of Changes

  • Wires the upload ingestion pipeline into the new staged reconciliation jobs after raw feature ingestion completes.
  • Adds the end-to-end flow for reconciling staged upload features, promoting changed features, and indexing feature properties.
  • Updates queue publishers and workers so reconciliation, promotion, indexing, closure recompute, and security screening run in the intended order.
  • Keeps approval separate from ingestion, with approval only allowed after the upload reaches indexed.
  • Updates status transitions so downstream jobs do not run before their prerequisite ingestion steps are complete.

Testing Notes

  • Download the tarball attached to the Jira ticket and upload it to a test submission.
  • Confirm the upload progresses through the new ingestion pipeline: uploadedingestingingestedreconcilingreconciledpromotingpromotedindexingindexed.
  • Confirm reconciliation completes without conflicts and reports the expected new, unchanged, superseded, and conflict counts.
  • Verify staged features are not active or visible in the submission before the upload is approved.
  • Approve the indexed upload and verify its new and superseding features become active.
  • Confirm unchanged features are not duplicated and superseded features are ended correctly.
  • Verify feature closure is recomputed after approval and parent-child feature relationships remain correct.
  • Confirm the security-processing job runs independently and does not block ingestion, indexing, or approval.
  • Re-submit or retry a completed job and confirm processing is idempotent, with no duplicate features or status transitions.
  • Revoke the approval and confirm features owned by that upload are ended and the appropriate prior features are restored.

@mauberti-bc mauberti-bc changed the title SIMSBIOHUB-1060i: wire staged feature reconciliation workflow SIMSBIOHUB-1060i: Integrate staged reconciliation into tarball ingestion Jul 15, 2026
@mauberti-bc
mauberti-bc force-pushed the SIMSBIOHUB-1060h branch 3 times, most recently from 5cbc4fa to db591b0 Compare July 15, 2026 05:55
@sonarqubecloud

Copy link
Copy Markdown

@mauberti-bc mauberti-bc added the Ready For Review PR is ready for review label Jul 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Ready For Review PR is ready for review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant