-
Notifications
You must be signed in to change notification settings - Fork 0
Add a LocalModelEngine conformance harness #4
Copy link
Copy link
Open
Labels
area:contractsPublic contracts and generated SDK typesPublic contracts and generated SDK typesevaluationReproducible model or hardware evaluationReproducible model or hardware evaluationhelp wantedExtra attention is neededExtra attention is neededsafetySecurity, privacy, or medical safety boundarySecurity, privacy, or medical safety boundary
Description
Activity
Metadata
Metadata
Assignees
Labels
area:contractsPublic contracts and generated SDK typesPublic contracts and generated SDK typesevaluationReproducible model or hardware evaluationReproducible model or hardware evaluationhelp wantedExtra attention is neededExtra attention is neededsafetySecurity, privacy, or medical safety boundarySecurity, privacy, or medical safety boundary
Create a runtime-neutral conformance harness for LocalModelEngine adapters.
The harness should measure skill selection, tool selection, argument validity, clarification behavior, cancellation, and unsafe-call rate without executing tools automatically.
Acceptance criteria: