Skip to content
#

false-success

Star

Here are 2 public repositories matching this topic...

agent-claimcheck

B0yko / agent-claimcheck

Star 0

Catch AI agents that say "done" when the task isn't. Checks agent-trace/v1 traces with claim-evidence rules, LLM judges and a trained classifier, returns verified / false_success / unverifiable with calibrated confidence, and ships a 300-trace labelled benchmark.

python benchmark calibration human-in-the-loop ai-agents trace-analysis evals llm-evaluation llm-as-a-judge openai-compatible agent-evaluation agent-reliability false-success
  • Updated Sep 30, 2026
  • Python

Add this topic to your repo

To associate your repository with the false-success topic, visit your repo's landing page and select "manage topics."

Learn more