Summary
Arbiter has no inter-annotator agreement metrics or workflow for resolving disagreements between reviewers. In regulated environments, multiple reviewers may need to review the same document.
Proposal
Add multi-reviewer support:
- Assign the same document to multiple reviewers
- Calculate inter-annotator agreement (Cohen's kappa or similar)
- Adjudication workflow for resolving disagreements
- Track agreement metrics over time for quality assurance
Acceptance Criteria
Summary
Arbiter has no inter-annotator agreement metrics or workflow for resolving disagreements between reviewers. In regulated environments, multiple reviewers may need to review the same document.
Proposal
Add multi-reviewer support:
Acceptance Criteria