I'm not sure if it's in-scope for this repository (@kunalkushwaha's octool is the only one that claims config validation in opencontainers/specs, since opencontainers/runtime-spec#195), but #3 looks like it landed some code that is intended to validate configs. If it is in scope for this repo, I think we want the config validation to be completely internal, and not spawn a runtime subprocess as part of the test. So validation has two separate steps:
- Is this config compatible with the spec?
- Is this runtime compatible with the spec?
If both of those are true and solidly implemented, there's no need for an additional “is this config compatible with this runtime” check, and it's unclear who would be to blame if that check failed after the previous two succeeded.
I'm not sure if it's in-scope for this repository (@kunalkushwaha's octool is the only one that claims config validation in opencontainers/specs, since opencontainers/runtime-spec#195), but #3 looks like it landed some code that is intended to validate configs. If it is in scope for this repo, I think we want the config validation to be completely internal, and not spawn a runtime subprocess as part of the test. So validation has two separate steps:
If both of those are true and solidly implemented, there's no need for an additional “is this config compatible with this runtime” check, and it's unclear who would be to blame if that check failed after the previous two succeeded.