Priority Level
Medium
Task Summary
As a follow up on this thread, detection validity score mainly includes precision complaints rather than making sure any real PII slip through after entity detection. The latter question will be answered by judge_leakage, which is briefly explored in here.
This issue is related to #176 as we have enough evidence to replace the detection_validity score with leakage_judge.
Technical Details & Implementation Plan
No response
Dependencies
No response
Priority Level
Medium
Task Summary
As a follow up on this thread, detection validity score mainly includes precision complaints rather than making sure any real PII slip through after entity detection. The latter question will be answered by judge_leakage, which is briefly explored in here.
This issue is related to #176 as we have enough evidence to replace the
detection_validityscore withleakage_judge.Technical Details & Implementation Plan
No response
Dependencies
No response