Skip to content

Link v3 cases to HPSS archives - #322

Merged
tomvothecoder merged 10 commits into
E3SM-Project:mainfrom
tomvothecoder:devops/300-v3-hpss-links
Sep 1, 2026
Merged

Link v3 cases to HPSS archives#322
tomvothecoder merged 10 commits into
E3SM-Project:mainfrom
tomvothecoder:devops/300-v3-hpss-links

Conversation

@tomvothecoder

Copy link
Copy Markdown
Collaborator

Description

Add a safe, operator-driven workflow for attaching documented long-term HPSS locations to existing Chrysalis E3SM v3 cases.

  • Add a dry-run-first HPSS linker that parses the v3 documentation table by column header and reconciles case-level Long-Term Archive links.
  • Guard writes when documented cases are missing, source mappings conflict, or existing links are ambiguous/conflicting.
  • Add Make targets for v3 HPSS reconciliation and targeted Chrysalis v3 archive ingestion.
  • Relabel execution archive resources as Short-Term Archive without changing the stored artifact kind.
  • Document the v3 ingestion/linking workflows and include the issue implementation plan.

Closes #300

Testing

  • make backend-test
  • make frontend-lint
  • make pre-commit-run
  • Focused HPSS linker tests

Deployment Notes

No migration or new dependency is required. Run make v3-hpss-link-dry-run from a configured backend environment and review reconciliation counts before make v3-hpss-link-apply. The targeted Chrysalis ingestion targets require LCRC_V3_ENV_FILE with the existing API credentials.

@tomvothecoder
tomvothecoder marked this pull request as ready for review September 1, 2026 21:33
@tomvothecoder
tomvothecoder merged commit c15b593 into E3SM-Project:main Sep 1, 2026
1 check passed
@tomvothecoder

tomvothecoder commented Sep 1, 2026

Copy link
Copy Markdown
Collaborator Author

Verified manually on backend, then applied linkage.

For client-side verification, choose a case name from e3sm v3 data docs, search for it here, then find the attached "Long-Term Archive" link.

Example case: https://simboard-dev.e3sm.org/cases/chrysalis/ac.wlin/v3.LR.amip_0101

@tomvothecoder
tomvothecoder deleted the devops/300-v3-hpss-links branch September 1, 2026 23:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[DevOps]: Connect HPSS links to v3 archive

1 participant