Skip to content

chore(antithesis): Update endpoint submission - #2147

Merged
blt merged 1 commit into
mainfrom
blt/chore_antithesis_update_endpoint_submission
Jul 17, 2026
Merged

chore(antithesis): Update endpoint submission#2147
blt merged 1 commit into
mainfrom
blt/chore_antithesis_update_endpoint_submission

Conversation

@blt

@blt blt commented Jul 16, 2026

Copy link
Copy Markdown
Contributor

Summary

This commit updates the way we submit Antithesis runs to conform to
current guidelines from Antithesis. Note that antithesis.source is
specific to the Datadog Agent project and should not be used for
other projects.

Change Type

  • Bug fix
  • New feature
  • Non-functional (chore, refactoring, docs)
  • Performance

How did you test this PR?

References

This commit updates the way we submit Antithesis runs to conform to
current guidelines from Antithesis. Note that antithesis.source is
specific to the Datadog Agent project and should not be used for
other projects.
@dd-octo-sts dd-octo-sts Bot added the area/test All things testing: unit/integration, correctness, SMP regression, etc. label Jul 16, 2026

blt commented Jul 16, 2026

Copy link
Copy Markdown
Contributor Author

@pr-commenter

pr-commenter Bot commented Jul 16, 2026

Copy link
Copy Markdown

Binary Size Analysis (Agent Data Plane)

Baseline: 9a2d58f · Comparison: 0f927d3 · diff
Analysis Configuration: stripped binaries · Pass/Fail Threshold: +5%
Sizes: 39.41 MiB (baseline) vs 39.41 MiB (comparison)
Size Change: -8 B (-0.00%)

✅ Binary size difference within threshold

Changes by Module
Module File Size Symbols
anon.44a0faa3240fa409baa379409d152aec.1.llvm.10875051420697084105 -130 B 1
anon.44a0faa3240fa409baa379409d152aec.1.llvm.8895064105245619572 +129 B 1
anon.44a0faa3240fa409baa379409d152aec.4.llvm.10875051420697084105 -114 B 1
anon.44a0faa3240fa409baa379409d152aec.4.llvm.8895064105245619572 +113 B 1
anon.44a0faa3240fa409baa379409d152aec.3.llvm.10875051420697084105 -109 B 1
anon.44a0faa3240fa409baa379409d152aec.3.llvm.8895064105245619572 +108 B 1
anon.44a0faa3240fa409baa379409d152aec.0.llvm.10875051420697084105 -97 B 1
anon.44a0faa3240fa409baa379409d152aec.0.llvm.8895064105245619572 +96 B 1
anon.44a0faa3240fa409baa379409d152aec.2.llvm.10875051420697084105 -95 B 1
anon.44a0faa3240fa409baa379409d152aec.2.llvm.8895064105245619572 +94 B 1
[Unmapped] -3 B 1
Detailed Symbol Changes
    FILE SIZE        VM SIZE    
 --------------  -------------- 
  [NEW]    +129  [NEW]     +40    anon.44a0faa3240fa409baa379409d152aec.1.llvm.8895064105245619572
  [NEW]    +113  [NEW]     +24    anon.44a0faa3240fa409baa379409d152aec.4.llvm.8895064105245619572
  [NEW]    +108  [NEW]     +19    anon.44a0faa3240fa409baa379409d152aec.3.llvm.8895064105245619572
  [NEW]     +96  [NEW]      +7    anon.44a0faa3240fa409baa379409d152aec.0.llvm.8895064105245619572
  [NEW]     +94  [NEW]      +5    anon.44a0faa3240fa409baa379409d152aec.2.llvm.8895064105245619572
 -15.0%      -3  [ = ]       0    [Unmapped]
  [DEL]     -95  [DEL]      -5    anon.44a0faa3240fa409baa379409d152aec.2.llvm.10875051420697084105
  [DEL]     -97  [DEL]      -7    anon.44a0faa3240fa409baa379409d152aec.0.llvm.10875051420697084105
  [DEL]    -109  [DEL]     -19    anon.44a0faa3240fa409baa379409d152aec.3.llvm.10875051420697084105
  [DEL]    -114  [DEL]     -24    anon.44a0faa3240fa409baa379409d152aec.4.llvm.10875051420697084105
  [DEL]    -130  [DEL]     -40    anon.44a0faa3240fa409baa379409d152aec.1.llvm.10875051420697084105
  -0.0%      -8  [ = ]       0    TOTAL

@datadog-datadog-prod-us1-2

datadog-datadog-prod-us1-2 Bot commented Jul 16, 2026

Copy link
Copy Markdown
Contributor

Tests

🔄 Datadog auto-retried 1 job - 1 passed on retry View in Datadog

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 0f927d3 | Docs | Datadog PR Page | Give us feedback!

@pr-commenter

pr-commenter Bot commented Jul 16, 2026

Copy link
Copy Markdown

Regression Detector (Agent Data Plane)

Run ID: bdc999ac-8c33-4ee8-bce0-9aa444c80774
Baseline: 9a2d58fe · Comparison: 0f927d31 · diff

Optimization Goals: ✅ No significant changes detected

Fine details of change detection per experiment (5)

Experiments configured erratic: true are tagged (ignored) and skipped when determining which experiments regressed or improved. Experiments which are detected as erratic at runtime are tagged (erratic) to flag that the run's sample dispersion was high, but their regression / improvement signal still counts.

experiment goal Δ mean % links
quality_gates_rss_idle memory ⚪ +0.05 metrics profiles logs
quality_gates_rss_dsd_ultraheavy memory ⚪ -0.08 metrics profiles logs
quality_gates_rss_dsd_medium memory ⚪ -0.11 metrics profiles logs
quality_gates_rss_dsd_low memory ⚪ -0.27 metrics profiles logs
quality_gates_rss_dsd_heavy memory ⚪ -0.70 metrics profiles logs
Bounds Checks: ❌ Failed (5)
experiment check replicates observed links
quality_gates_rss_dsd_heavy memory_usage 9/10 ❌ 140 MiB ≤ 140 MiB metrics profiles logs
quality_gates_rss_dsd_low memory_usage 10/10 ✅ 44.1 MiB ≤ 50 MiB metrics profiles logs
quality_gates_rss_dsd_medium memory_usage 10/10 ✅ 67.1 MiB ≤ 75 MiB metrics profiles logs
quality_gates_rss_dsd_ultraheavy memory_usage 10/10 ✅ 193 MiB ≤ 200 MiB metrics profiles logs
quality_gates_rss_idle memory_usage 10/10 ✅ 30.3 MiB ≤ 40 MiB metrics profiles logs
Explanation

A change is flagged as a regression when |Δ mean %| > 5.00% in the regressing direction for its optimization goal AND SMP marks the experiment as a regression (is_regression: true). Improvements use the matching criteria for the improving direction. Experiments configured erratic: true (tagged (ignored)) are skipped outright; experiments detected as erratic at runtime (tagged (erratic)) still count, since that flag describes sample dispersion rather than directional certainty. The Δ mean % cell is colored accordingly: 🟢 = improvement, 🔴 = regression, ⚪ = neutral. Reduction in CPU or memory is an improvement; reduction in ingress throughput is a regression.

@blt
blt marked this pull request as ready for review July 16, 2026 22:21
@blt
blt requested review from a team as code owners July 16, 2026 22:21

@datadog-datadog-prod-us1-2 datadog-datadog-prod-us1-2 Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Datadog Autotest: PASS

More details

DRY_RUN execution of both general and differential scenarios confirmed all changes are correct: the webhook switches to run_test, source is fixed to datadog_agent, and the two new fault toggles (FORCE_DISABLE_ALL_FAULTS, SIMULTANEOUS_FAULTS) are properly scoped — the former always included at its false default, the latter only appended when FAULT_NODES is non-empty. All env-var overrides work as documented.

Was this helpful? React 👍 or 👎

📊 Validated against 6 scenarios · Open Bits AI session

🤖 Datadog Autotest · Commit 0f927d3 · What is Autotest? · Any feedback? Reach out in #autotest

@blt
blt merged commit ab87b38 into main Jul 17, 2026
95 checks passed

blt commented Jul 17, 2026

Copy link
Copy Markdown
Contributor Author

Merge activity

  • Jul 17, 10:58 PM UTC: @blt merged this pull request with Graphite.

@blt
blt deleted the blt/chore_antithesis_update_endpoint_submission branch July 17, 2026 22:58
dd-octo-sts Bot pushed a commit that referenced this pull request Jul 17, 2026
## Summary
<!-- Please provide a brief summary about what this PR does.
This should help the reviewers give feedback faster and with higher quality. -->

This commit updates the way we submit Antithesis runs to conform to
current guidelines from Antithesis. Note that antithesis.source is
specific to the Datadog Agent project and should not be used for
other projects.

## Change Type
- [ ] Bug fix
- [ ] New feature
- [x] Non-functional (chore, refactoring, docs)
- [ ] Performance

## How did you test this PR?
<!-- Please how you tested these changes here -->

## References

<!-- Please list any issues closed by this PR. -->

<!--
- Closes: <issue link>
-->

<!-- Any other issues or PRs relevant to this PR? Feel free to list them here. --> ab87b38
@blt blt mentioned this pull request Jul 20, 2026
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/test All things testing: unit/integration, correctness, SMP regression, etc.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants