Skip to content

docs: add Dangerous Output metric - #985

Draft
AnkushMalaker wants to merge 5 commits into
mainfrom
ankush/dangerous-output-docs
Draft

docs: add Dangerous Output metric#985
AnkushMalaker wants to merge 5 commits into
mainfrom
ankush/dangerous-output-docs

Conversation

@AnkushMalaker

@AnkushMalaker AnkushMalaker commented Aug 20, 2026

Copy link
Copy Markdown

Describe your changes

Adds customer-facing documentation for the Dangerous Output preset metric.

The content follows the implementation in https://github.com/rungalileo/orbit/pull/1525 and the superseding product decision to use the same copy-and-edit workflow as Agent Flow: the preset contains no baseline policy, and users add only their own output-policy rules.

This PR documents:

  • the exact <user-defined-rules> placeholder and duplication workflow
  • applicability-first, concrete-evidence evaluation behavior
  • Boolean score semantics, LLM span scope, and multi-judge aggregation
  • support boundaries: text only, no Luna, and no Protect runtime enforcement
  • trusted-v2 benchmark results on 877 adjudicated examples
  • navigation, safety tables, the Python metric reference, and a UI redirect

Preview: https://v2galileo-ankush-dangerous-output-docs.mintlify.site/concepts/metrics/safety-and-compliance/dangerous-output

Validation completed:

  • branch is based on the latest origin/main commit at creation time (ad211e90)
  • all seven repository checks pass: Mintlify deployment and dev server, broken links, card links, markdown lint, Vale, and snippet structure
  • docs.json parses successfully
  • every internal link added by the new page resolves in the repository
  • git diff --check passes
  • the full deployed page was rendered and visually reviewed in Chrome
  • benchmark totals and derived metrics match the trusted-v2 result artifact
  • the linked Orbit implementation has passing Bazel, pre-commit, and schema tests

The visual preview also showed that the repository shared classification-report component does not render visible content in Mintlify. This page therefore uses responsive Markdown tables so precision, recall, F1, support, accuracy, and confusion counts remain visible.

Local npm installation is blocked by a 403 from the corporate Artifactory mirror for a locked dependency; the equivalent repository-native checks all passed in GitHub Actions.

Shortcut ticket

Docs-specific DevRel Shortcut story: pending. Keep this PR in draft until it is attached.

Related product and dataset lineage: https://app.shortcut.com/galileo/story/48757

Checklist before requesting a review

  • - Is this ready for review? If not, raise as a draft PR
  • - This deployed to a staging environment correctly
  • - I have reviewed my changes
  • - I have reviewed the deployed version of my changes
  • - I have tested any code that is added or updated (no executable code added)
  • - I have verified all images and videos are clear, with appropriate zoom (no media added)
  • - I have verified all images and videos match production (or dev for unreleased features) (no media added)
  • - I have tested that the content matches the functionality in production (or dev for unreleased features)
  • - All checks have passed
  • - This references a feature that is public. If not, add a note and we can schedule the merge for after the feature release

Release note: Dangerous Output is still represented by the draft Orbit implementation PR. Do not merge or publish this docs PR before the feature release.

@mintlify

mintlify Bot commented Aug 20, 2026

Copy link
Copy Markdown

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
v2galileo 🟢 Ready View Preview Aug 20, 2026, 5:34 PM

💡 Tip: Enable Workflows to automatically generate PRs for you.

@github-actions

github-actions Bot commented Aug 20, 2026

Copy link
Copy Markdown

Card links check

✅ No broken Card links found. Checked external links in 1.0s

@github-actions

github-actions Bot commented Aug 20, 2026

Copy link
Copy Markdown

✅ Markdown Lint Passed

All markdown files meet the linting standards! 🎉

@github-actions

Copy link
Copy Markdown

✅ Mintlify Dev Server Started Successfully!

The documentation can be served without errors.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant