Skip to content

Expose scenario report verification as a packaged command #381

Description

@cbeaulieu-gt

Summary

Provide a stable packaged console command for validating daemon session reports against the scenario expectations delivered by #243.

Context

The matcher currently runs through python -m baton_harness.scenario.verify, while release orchestration is shell-based. The assertion engine is application functionality; runner placement and credentials remain release/deployment concerns.

Acceptance criteria

  • Add a documented packaged console command for scenario/report verification.
  • Preserve the scenario names, report schema validation, exit codes, and diagnostics established by Design: daemon session report + init-sandbox scenario harness (replaces bespoke verifier scripts) #243.
  • The command runs from a wheel installation without a Harness checkout.
  • Shell scenario runners delegate report assertions to the packaged command.
  • Tests cover valid reports, mismatches, malformed reports, unsupported schema versions, and stable exit behavior.
  • Update scenario and release-validation documentation.

Dependencies

Out of scope

Seeding repositories, supplying live credentials, selecting runners, or executing the real daemon scenarios.

🤖 Generated by Codex on behalf of @cbeaulieu-gt

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions