Skip to content

Week 5 Day 2: add provider aggregate metrics#24

Merged
utkarshp845 merged 1 commit into
mainfrom
codex/week-5-day-2-metrics
Jul 22, 2026
Merged

Week 5 Day 2: add provider aggregate metrics#24
utkarshp845 merged 1 commit into
mainfrom
codex/week-5-day-2-metrics

Conversation

@utkarshp845

Copy link
Copy Markdown
Owner

Summary

  • expose process-local Prometheus metrics from the AI SRE Assistant
  • aggregate provider outcomes, request latency, deterministic fallbacks, and reported input/output tokens
  • keep labels bounded and sensitive prompts, evidence, endpoints, identifiers, and error text out of metrics
  • mark Week 5 Day 2 complete in the roadmap, telemetry contract, and build log

Validation

  • python -m ruff check app cli tests
  • python -m pytest -q — 28 passed
  • python -m evals.run_evals — 7/7 cases and 35/35 rubric checks passed

@utkarshp845
utkarshp845 merged commit 6bca101 into main Jul 22, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant