Feature Description
PAF already uses local Ultralytics-based perception in the VisionNode and already has perception evaluation documents, but it lacks a lightweight, reusable offline toolkit for inspecting detections, masks, tracks, and derived metrics on recorded frames or generated datasets.
roboflow/supervision looks like a good fit for this exact gap:
- model-agnostic CV utilities
- detection and segmentation overlays
- dataset helpers and format conversions
- basic tracking / zone / counting style primitives for analysis
The goal is not to add a new runtime dependency into the ROS2 driving stack immediately.
The goal is to evaluate whether supervision should become an experiments-only or testing-only dependency for offline perception debugging and benchmarking around the current PAF outputs.
Definition of Done
Testability
Run the prototype on a small representative sample from the current perception stack and verify that it produces useful overlays or metrics that are not already easy to obtain in the existing workflow.
Dependencies
Related to #918, which is already tracking stronger dataset generation and replay foundations. This issue should stay focused on offline perception evaluation tooling rather than dataset capture itself.
Feature Description
PAF already uses local Ultralytics-based perception in the VisionNode and already has perception evaluation documents, but it lacks a lightweight, reusable offline toolkit for inspecting detections, masks, tracks, and derived metrics on recorded frames or generated datasets.
roboflow/supervisionlooks like a good fit for this exact gap:The goal is not to add a new runtime dependency into the ROS2 driving stack immediately.
The goal is to evaluate whether
supervisionshould become an experiments-only or testing-only dependency for offline perception debugging and benchmarking around the current PAF outputs.Definition of Done
supervision-based analysis flow.doc/reasoning/or the relevant perception docs.Testability
Run the prototype on a small representative sample from the current perception stack and verify that it produces useful overlays or metrics that are not already easy to obtain in the existing workflow.
Dependencies
Related to #918, which is already tracking stronger dataset generation and replay foundations. This issue should stay focused on offline perception evaluation tooling rather than dataset capture itself.