From 970d9f1f915e229b5fc8745263a829ba586e35e8 Mon Sep 17 00:00:00 2001 From: AhmadHammad21 Date: Tue, 2 Jun 2026 23:25:41 +0300 Subject: [PATCH] update --- README.md | 15 ++++++++------- 1 file changed, 8 insertions(+), 7 deletions(-) diff --git a/README.md b/README.md index a92f8b7..02b6155 100644 --- a/README.md +++ b/README.md @@ -5,13 +5,14 @@ Anthropic, OpenRouter, Groq, Gemini, Mistral, **Ollama for air-gapped / regulate reuse your existing **Claude Code** subscription (auto-detected). Investigates incidents, finds root causes, and gives actionable mitigation plans โ€” without the cloud-vendor DevOps-agent price tag. -> ### ๐Ÿ“Š Benchmarked, not just demoed -> On a **reproducible 10-incident suite** (real AWS + Azure resources, scored against ground truth), running on a **commodity open model** (`gpt-oss-120b` โ€” no frontier model required): -> -> | Root causes found | Median time | Cost / investigation | vs. AWS DevOps Agent | vs. manual triage | -> |:---:|:---:|:---:|:---:|:---:| -> | **9 / 10 (90%)** | **~52 s** | **~$0.03** | **~10ร— cheaper**ยน
(~$0.03 vs ~$0.43) | **~1,000ร— cheaper**ยฒ | -> +### ๐Ÿ“Š Benchmarked, not just demoed + +On a **reproducible 10-incident suite** (real AWS + Azure resources, scored against ground truth), running on a **commodity open model** (`gpt-oss-120b` โ€” no frontier model required): + +| Root causes found | Median time | Cost / investigation | vs. AWS DevOps Agent | vs. manual triage | +|:---:|:---:|:---:|:---:|:---:| +| **9 / 10 (90%)** | **~52 s** | **~$0.03** | **~10ร— cheaper**ยน
(~$0.03 vs ~$0.43) | **~1,000ร— cheaper**ยฒ | + > *~$0.03 of compute replaces ~$50 of engineer toil โ€” and costs a fraction of a managed cloud DevOps agent โ€” while returning the answer in under a minute instead of half an hour.* Reproduce it with `make eval` โ†’ **[full benchmark & methodology](apps/documentation/benchmark.md)**. > > ยน vs. AWS DevOps Agent โ€” its per-second rate applied to the same wall-clock time (~$0.43/investigation); verify against AWS's published pricing. ยฒ Illustrative unit economics vs. ~20โ€“40 min of on-call triage. Cost shown is the provider-dashboard actual; see [caveats](apps/documentation/benchmark.md#caveats-read-these-before-quoting-numbers).