Skip to content

chore(antithesis): Add provider_kind in sample config - #2218

Open
blt wants to merge 1 commit into
blt/chore_antithesis_is_malformed_based_load_generationfrom
blt/chore_antithesis_add_provider_kind_in_sample_config
Open

chore(antithesis): Add provider_kind in sample config#2218
blt wants to merge 1 commit into
blt/chore_antithesis_is_malformed_based_load_generationfrom
blt/chore_antithesis_add_provider_kind_in_sample_config

Conversation

@blt

@blt blt commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Summary

Pyld54 asserts a v3 tagset back-reference resolves to an earlier
tagset. Agent emits that back-reference only when a metric carries both
a shared prefix tagset and its own tags. Previously we only ever emitted
load that carried no shared prefix.

This commit adds provider_kind into the sampled datadog.yaml. Agent will
attach this as a global tag which acts as a shared prefix. 1/3 of
configs will not have provider_kind present.

Change Type

  • Bug fix
  • New feature
  • Non-functional (chore, refactoring, docs)
  • Performance

How did you test this PR?

References

Pyld54 asserts a v3 tagset back-reference resolves to an earlier
tagset. Agent emits that back-reference only when a metric carries both
a shared prefix tagset and its own tags. Previously we only ever emitted
load that carried no shared prefix.

This commit adds provider_kind into the sampled datadog.yaml. Agent will
attach this as a global tag which acts as a shared prefix. 1/3 of
configs will not have provider_kind present.

blt commented Jul 27, 2026

Copy link
Copy Markdown
Contributor Author

@dd-octo-sts dd-octo-sts Bot added the area/test All things testing: unit/integration, correctness, SMP regression, etc. label Jul 27, 2026
@datadog-prod-us1-4

Copy link
Copy Markdown

Pipelines

Unblock PR with BitsAI

⚠️ Warnings

🚦 1 Pipeline job failed

DataDog/saluki | check-fmt   View in Datadog   GitLab

Useful? React with 👍 / 👎

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 14ee8b4 | Docs | Datadog PR Page | Give us feedback!

@pr-commenter

pr-commenter Bot commented Jul 27, 2026

Copy link
Copy Markdown

Binary Size Analysis (Agent Data Plane)

Baseline: e34c659 · Comparison: 14ee8b4 · diff
Analysis Configuration: stripped binaries · Pass/Fail Threshold: +5%
Sizes: 41.09 MiB (baseline) vs 41.09 MiB (comparison)
Size Change: +0 B (+0.00%)

✅ Binary size difference within threshold

Changes by Module
Module File Size Symbols
anon.44a0faa3240fa409baa379409d152aec.1.llvm.1680465280292740054 +129 B 1
anon.44a0faa3240fa409baa379409d152aec.1.llvm.4920541009509882327 -129 B 1
anon.44a0faa3240fa409baa379409d152aec.4.llvm.1680465280292740054 +113 B 1
anon.44a0faa3240fa409baa379409d152aec.4.llvm.4920541009509882327 -113 B 1
anon.44a0faa3240fa409baa379409d152aec.3.llvm.1680465280292740054 +108 B 1
anon.44a0faa3240fa409baa379409d152aec.3.llvm.4920541009509882327 -108 B 1
anon.44a0faa3240fa409baa379409d152aec.0.llvm.1680465280292740054 +96 B 1
anon.44a0faa3240fa409baa379409d152aec.0.llvm.4920541009509882327 -96 B 1
anon.44a0faa3240fa409baa379409d152aec.2.llvm.1680465280292740054 +94 B 1
anon.44a0faa3240fa409baa379409d152aec.2.llvm.4920541009509882327 -94 B 1
Detailed Symbol Changes
    FILE SIZE        VM SIZE    
 --------------  -------------- 
  [NEW]    +129  [NEW]     +40    anon.44a0faa3240fa409baa379409d152aec.1.llvm.1680465280292740054
  [NEW]    +113  [NEW]     +24    anon.44a0faa3240fa409baa379409d152aec.4.llvm.1680465280292740054
  [NEW]    +108  [NEW]     +19    anon.44a0faa3240fa409baa379409d152aec.3.llvm.1680465280292740054
  [NEW]     +96  [NEW]      +7    anon.44a0faa3240fa409baa379409d152aec.0.llvm.1680465280292740054
  [NEW]     +94  [NEW]      +5    anon.44a0faa3240fa409baa379409d152aec.2.llvm.1680465280292740054
  [DEL]     -94  [DEL]      -5    anon.44a0faa3240fa409baa379409d152aec.2.llvm.4920541009509882327
  [DEL]     -96  [DEL]      -7    anon.44a0faa3240fa409baa379409d152aec.0.llvm.4920541009509882327
  [DEL]    -108  [DEL]     -19    anon.44a0faa3240fa409baa379409d152aec.3.llvm.4920541009509882327
  [DEL]    -113  [DEL]     -24    anon.44a0faa3240fa409baa379409d152aec.4.llvm.4920541009509882327
  [DEL]    -129  [DEL]     -40    anon.44a0faa3240fa409baa379409d152aec.1.llvm.4920541009509882327
  [ = ]       0  [ = ]       0    TOTAL

@blt
blt marked this pull request as ready for review July 27, 2026 23:24
@blt
blt requested review from a team as code owners July 27, 2026 23:24
@pr-commenter

pr-commenter Bot commented Jul 27, 2026

Copy link
Copy Markdown

Regression Detector (Agent Data Plane)

Run ID: 15c4b47b-1d9c-4fc8-84da-61d49e77f139
Baseline: e34c659f · Comparison: 14ee8b43 · diff

Optimization Goals: ✅ No significant changes detected

Fine details of change detection per experiment (3)

Experiments configured erratic: true are tagged (ignored) and skipped when determining which experiments regressed or improved. Experiments which are detected as erratic at runtime are tagged (erratic) to flag that the run's sample dispersion was high, but their regression / improvement signal still counts.

experiment goal Δ mean % links
quality_gates_rss_dsd_medium memory ⚪ +0.09 metrics profiles logs
quality_gates_rss_idle memory ⚪ -0.13 metrics profiles logs
quality_gates_rss_dsd_low memory ⚪ -0.34 metrics profiles logs
Bounds Checks: ✅ Passed (3)
experiment check replicates observed links
quality_gates_rss_dsd_low memory_usage 10/10 ✅ 45.2 MiB ≤ 50 MiB metrics profiles logs
quality_gates_rss_dsd_medium memory_usage 10/10 ✅ 67.3 MiB ≤ 75 MiB metrics profiles logs
quality_gates_rss_idle memory_usage 10/10 ✅ 31.2 MiB ≤ 40 MiB metrics profiles logs
Explanation

A change is flagged as a regression when |Δ mean %| > 5.00% in the regressing direction for its optimization goal AND SMP marks the experiment as a regression (is_regression: true). Improvements use the matching criteria for the improving direction. Experiments configured erratic: true (tagged (ignored)) are skipped outright; experiments detected as erratic at runtime (tagged (erratic)) still count, since that flag describes sample dispersion rather than directional certainty. The Δ mean % cell is colored accordingly: 🟢 = improvement, 🔴 = regression, ⚪ = neutral. Reduction in CPU or memory is an improvement; reduction in ingress throughput is a regression.

@datadog-prod-us1-4 datadog-prod-us1-4 Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Datadog Autotest: PASS

More details

The sampled provider_kind values are valid Agent configuration values, and the empty branch is omitted so existing timelines retain the default behavior. The change is isolated to Antithesis config generation; no behavioral regression or diff-only production hazard was identified.

Was this helpful? React 👍 or 👎

Open Bits AI session

🤖 Datadog Autotest · Commit 14ee8b4 · What is Autotest? · @DataDog review to ask questions · Any feedback? Reach out in #autotest

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 14ee8b4347

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment on lines +138 to +140
/// Cloud provider kind, sampled per timeline.
#[serde(skip_serializing_if = "String::is_empty")]
provider_kind: String,

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Document the provider-kind configuration behavior

Expand this field's Rustdoc beyond “sampled per timeline”: it does not explain that a nonempty value appends provider_kind:<value> to DogStatsD metrics, that empty/absent disables the tag, that the harness samples omission plus two fixed values, or who should change this test input. The repository requires configuration fields to document their behavioral impact, default, boundary behavior, and intended operator.

AGENTS.md reference: AGENTS.md:L149-L154

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/test All things testing: unit/integration, correctness, SMP regression, etc.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant