Summary
Arbiter captures human review decisions (accept, override, exempt) but these corrections are not fed back to PhEye or Phileas to improve detection accuracy over time.
Proposal
Close the feedback loop:
- Export review decisions in training-data format (CoNLL, spaCy)
- Identify high-value corrections (false positives, overrides) for retraining
- Provide an API or export mechanism for PhEye's fine-tuning pipeline
- Track the impact of human feedback on model accuracy over retraining cycles
This is the single highest-leverage cross-project integration for improving the entire toolkit.
Acceptance Criteria
Summary
Arbiter captures human review decisions (accept, override, exempt) but these corrections are not fed back to PhEye or Phileas to improve detection accuracy over time.
Proposal
Close the feedback loop:
This is the single highest-leverage cross-project integration for improving the entire toolkit.
Acceptance Criteria