Skip to content

test: Smoke-test ai-evals:products on every model (do not merge) - #378

Closed
jaydgoss wants to merge 1 commit into
mainfrom
jaygoss/ai-evals-smoke-all-models
Closed

jaydgoss wants to merge 1 commit into
mainfrom
jaygoss/ai-evals-smoke-all-models

Conversation

@jaydgoss

Copy link
Copy Markdown
Member

Empty commit to run the AI Evals workflow with ai-evals:products (no models part, so every target) after getsentry/sentry-for-ai-evals#63 and #376. Close once the run is checked.

@jaydgoss jaydgoss added the ai-evals:products Run the products evals on every model, base and head label Oct 20, 2026
@sentry-evals

sentry-evals Bot commented Oct 20, 2026 •

Copy link
Copy Markdown

Sentry Evals

sentry-for-ai-evals:products (Comparison)

Run Status Passed Failed Errored Cost Tokens Duration
Head Complete 4 0 0 $2.14 5.2M 490.02s
Base Complete 4 0 0 $1.70 4.8M 401.10s
Diff 0 0 0 🔴 +$0.45 (+26.3%) +423.4k (+8.8%) 🔴 +88.92s (+22.1%)

@jaydgoss jaydgoss closed this Oct 20, 2026
@jaydgoss
jaydgoss deleted the jaygoss/ai-evals-smoke-all-models branch October 20, 2026 21:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ai-evals:products Run the products evals on every model, base and head

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant