Skip to content

[Story: ] As a Margo adopter, I would like to have a tool to allow me to select the suitable persona and run a set of conformance test-cases to get a signed report of conformance #278

Description

@nilanjan-samajdar

Description

As a MARGO User, I would like to run a set of automated Conformance Tests, for my specific commercial component mapping to a MARGO persona, at the end of which a test report is generated and automatically signed.

The tool will implement the following workflow -

  1. The user can download and run the tool from the Github repo
  2. The tool will ask the user - "Select the persona that best describes your Margo compatible component"
  3. Depending on the answer, the tool will ask the user to provide the configuration of heir component - IP, port, certificates e.t.c.
  4. The tool will also ask the user to provide the version of their component, manufacturer / ownership, version of the Margo spec followed e.t.c.
  5. The tool may download the relevant test-suite versions from Github
  6. The tool will ask the user to select the test-suites to run
  7. The tool will setup the fixtures (mocks) and clients as required by the persona and test-suite
  8. The tool will run each test-case, recording the success / failure of assertions and validations along with telemetry
    8.1 The tool will treat each test-case as a separate scenario, context between test-cases will not be preserved.
    8.2 Context between steps of a test-cases will be preserved, if the test-cases specifically requests it
    8.3 The test-cases are expected to have been built using the Margo test-case writing tool
  9. The end result will be available a a sharable report
    9.1 The report will have a pass/fail summary
    9.2 The report will have a pass/fail status of each test-case as well as cause of each failed assert
    9.3 The report will be signed as a PDF file with a Margo Digital Signature and with the following elements recorded -
  • The date/time
  • The version of the supplier component
  • The version of Margo specification
  • The version of Test-Suite run

Raised by (email-id)

nilanjan.samajdar@capgemini.com

Type of Story

Implementation

Related product requirements

<!-To be added->

Definition of Done

The required technical documentation should be updated
In case of any prototyping activity, the evaluation, design and outcomes need to be documented
API updates need to be updated in swagger (or other) files
Test automation should be done to demonstrate the use-case
Code and documentation should be pulled into the release branch and the pull-request approved by the TWG

Estimated Story-points

50

Impacted artifacts

  • API Documentation (Swagger)
  • User Docmentation
  • Reference Implementation Code
  • Test Automation

Metadata

Metadata

Labels

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions