Skip to content

P0-11: Create benchmark scenario coverage matrix #16

Description

@McMabee

Summary

Create a coverage matrix showing which benchmark clips represent which conditions and difficulty types.

Objective

Detect gaps, bias, or overrepresentation in the benchmark before Phase 1 begins.

Scope

  • Coverage matrix design
  • Clip-to-condition mapping
  • Gap analysis

Deliverable

  • benchmark/benchmark_coverage_matrix.csv

Acceptance Criteria

  • Matrix rows represent benchmark clips
  • Matrix columns include:
    • stance
    • movement type
    • occlusion
    • blur
    • lighting
    • contrast
    • partial body visibility
    • difficulty
  • Matrix is fully filled out
  • Missing scenario types are identified
  • Benchmark bias or incompleteness can be seen at a glance

Notes

Complete P0-09 before finalizing this matrix.

Metadata

Metadata

Assignees

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions