feat: rust service (web api)#607
Open
tziemek wants to merge 22 commits into
Open
Conversation
Contributor
There was a problem hiding this comment.
Pull request overview
Adds a new csaf-service Axum-based web API for CSAF validation, and refactors csaf-rs preset handling to use typed preset enums (instead of free-form strings) to support both the CLI and the new service.
Changes:
- Introduces
csaf-servicecrate with REST endpoints (presets, preset tests, validate JSON, validate file) plus Swagger UI/OpenAPI. - Refactors
csaf-rsvalidation preset APIs to use version-specificPresetenums and addsdetect_version_from_jsonhelper. - Updates workspace membership and adapts consumers (WASM bindings + csaf-validator CLI preset selection).
Reviewed changes
Copilot reviewed 19 out of 20 changed files in this pull request and generated 9 comments.
Show a summary per file
| File | Description |
|---|---|
| csaf-validator/src/main.rs | Updates CLI preset/test argument expansion logic to use typed presets. |
| csaf-service/src/models.rs | Adds shared API error response model/helper. |
| csaf-service/src/main.rs | Sets up Axum router, OpenAPI/Swagger UI, CORS, tracing, and port binding. |
| csaf-service/src/handlers/validate.rs | Implements validation endpoints (JSON body + file upload) and request parsing. |
| csaf-service/src/handlers/mod.rs | Exposes handler modules for the service. |
| csaf-service/src/handlers/health.rs | Adds health endpoint. |
| csaf-service/src/handlers/get_presets.rs | Adds endpoint to list presets per CSAF version. |
| csaf-service/src/handlers/get_preset_tests.rs | Adds endpoint intended to list tests for a preset (currently incomplete/incorrect). |
| csaf-service/README.md | Documents how to run the service and configure the port. |
| csaf-service/Dockerfile | Builds and packages the service as a musl-linked binary for Alpine. |
| csaf-service/Cargo.toml | New crate manifest and dependencies (axum/tokio/utoipa/etc.). |
| csaf-rs/src/wasm.rs | Updates WASM bindings to parse typed presets before validating. |
| csaf-rs/src/validation.rs | Changes Validatable/validate_by_preset APIs to use associated PresetType. |
| csaf-rs/src/csaf2_1/validation.rs | Introduces CSAF 2.1 Preset enum + mapping to test sets. |
| csaf-rs/src/csaf2_0/validation.rs | Introduces CSAF 2.0 Preset enum + mapping to test sets. |
| csaf-rs/src/csaf/raw.rs | Plumbs preset type + get_presets/tests_in_preset through RawDocument. |
| csaf-rs/src/csaf/loader.rs | Adds detect_version_from_json and reuses it from detect_version. |
| csaf-rs/src/csaf/enums/csaf_version.rs | Adds TryFrom<String> for CsafVersion parsing. |
| Cargo.toml | Adds csaf-service to workspace members. |
| Cargo.lock | Locks new service dependencies (axum/tower-http/utoipa/etc.). |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
peinjoh
reviewed
Apr 29, 2026
peinjoh
reviewed
Apr 29, 2026
Contributor
|
Done. |
peinjoh
reviewed
Apr 29, 2026
Contributor
There was a problem hiding this comment.
Pull request overview
Adds a new Rust csaf-service web API crate (Axum + OpenAPI) on top of csaf-rs, and refactors preset handling in csaf-rs/csaf-validator to use typed preset enums and preset discovery.
Changes:
- Introduces
csaf-serviceHTTP API with endpoints for health, presets, preset test listings, and CSAF validation (JSON + file upload), including integration tests and a Dockerfile. - Refactors
csaf-rsvalidation preset APIs to use a typedPresetenum per CSAF version and addsget_presets. - Updates
csaf-validatorCLI preset/test selection logic (including case-insensitive preset matching).
Reviewed changes
Copilot reviewed 26 out of 27 changed files in this pull request and generated 6 comments.
Show a summary per file
| File | Description |
|---|---|
| csaf-validator/src/main.rs | Updates CLI test/preset resolution logic (now case-insensitive presets). |
| csaf-service/src/main.rs | Adds service binary (Swagger UI, tracing, CORS, router wiring). |
| csaf-service/src/lib.rs | Exposes app() router for main + integration tests. |
| csaf-service/src/models.rs | Adds a shared ErrorResponse helper. |
| csaf-service/src/handlers/mod.rs | Wires handler modules. |
| csaf-service/src/handlers/health.rs | Adds /api/v1/health endpoint. |
| csaf-service/src/handlers/get_presets.rs | Adds presets listing endpoint. |
| csaf-service/src/handlers/get_preset_tests.rs | Adds “tests in preset” endpoint. |
| csaf-service/src/handlers/validate.rs | Adds validate + validate_file endpoints and OpenAPI schema types. |
| csaf-service/tests/utils/mod.rs | Adds integration test HTTP helpers using app().oneshot(...). |
| csaf-service/tests/health_api.rs | Adds health endpoint integration test. |
| csaf-service/tests/presets_api.rs | Adds presets endpoint integration tests. |
| csaf-service/tests/preset_tests_api.rs | Adds preset test listing integration tests. |
| csaf-service/tests/validate_api.rs | Adds JSON-body validation integration tests. |
| csaf-service/tests/validate_file_api.rs | Adds file-upload validation integration tests. |
| csaf-service/README.md | Documents running the new service. |
| csaf-service/Dockerfile | Adds container build/run for the service (musl build, alpine runtime). |
| csaf-service/Cargo.toml | Defines the new csaf-service crate and dependencies. |
| csaf-rs/src/validation.rs | Changes preset APIs to use associated PresetType + get_presets. |
| csaf-rs/src/csaf2_0/validation.rs | Introduces CSAF 2.0 Preset enum + parsing + preset test mapping. |
| csaf-rs/src/csaf2_1/validation.rs | Introduces CSAF 2.1 Preset enum + parsing + preset test mapping. |
| csaf-rs/src/csaf/raw.rs | Plumbs typed presets through raw document validatable impl. |
| csaf-rs/src/csaf/loader.rs | Extracts detect_version_from_json helper for in-memory detection. |
| csaf-rs/src/csaf/enums/csaf_version.rs | Adds Display + TryFrom<String> for CSAF version. |
| csaf-rs/src/wasm.rs | Updates WASM validation to parse typed presets before validating. |
| Cargo.toml | Adds csaf-service to workspace members. |
| Cargo.lock | Locks new dependencies for csaf-service and transitive deps. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
tziemek
force-pushed
the
feat/rust-service
branch
2 times, most recently
from
9650ecd to
4dc47ae
Compare
tziemek
force-pushed
the
feat/rust-service
branch
4 times, most recently
from
f20b0fb to
2501255
Compare
peinjoh
requested changes
May 20, 2026
tschmidtb51
requested changes
May 20, 2026
tschmidtb51
left a comment
tschmidtb51
left a comment
Contributor
There was a problem hiding this comment.
Please make sure it can be used as a drop-in replacement for the csaf-validator-service. If you think, that this is not worth it or want to change the API, please provide a suggestion for our next meeting that takes oasis-tcs/csaf#1231 into account.
tziemek
force-pushed
the
feat/rust-service
branch
2 times, most recently
from
7e0b8c2 to
0c77b24
Compare
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
CSAF Validation Benchmark
Details
| Benchmark suite | Current: a3552fa | Previous: b723aec | Ratio |
|---|---|---|---|
csaf_2_0_tests/6.1.1 |
125668 ns/iter (± 273) |
125702 ns/iter (± 2732) |
1.00 |
csaf_2_0_tests/6.1.2 |
51375 ns/iter (± 89) |
50378 ns/iter (± 28) |
1.02 |
csaf_2_0_tests/6.1.3 |
16165 ns/iter (± 430) |
12634 ns/iter (± 8) |
1.28 |
csaf_2_0_tests/6.1.4 |
32241 ns/iter (± 78) |
28420 ns/iter (± 143) |
1.13 |
csaf_2_0_tests/6.1.5 |
18633 ns/iter (± 146) |
13613 ns/iter (± 29) |
1.37 |
csaf_2_0_tests/6.1.6 |
45085 ns/iter (± 137) |
39255 ns/iter (± 83) |
1.15 |
csaf_2_0_tests/6.1.7 |
39414 ns/iter (± 140) |
32608 ns/iter (± 341) |
1.21 |
csaf_2_0_tests/6.1.8 |
95236 ns/iter (± 725) |
85671 ns/iter (± 633) |
1.11 |
csaf_2_0_tests/6.1.9 |
93017 ns/iter (± 309) |
89370 ns/iter (± 184) |
1.04 |
csaf_2_0_tests/6.1.10 |
147101 ns/iter (± 582) |
148760 ns/iter (± 944) |
0.99 |
csaf_2_0_tests/6.1.11 |
17411 ns/iter (± 20) |
14576 ns/iter (± 16) |
1.19 |
csaf_2_0_tests/6.1.12 |
33913 ns/iter (± 102) |
30495 ns/iter (± 120) |
1.11 |
csaf_2_0_tests/6.1.13 |
36927 ns/iter (± 74) |
32445 ns/iter (± 146) |
1.14 |
csaf_2_0_tests/6.1.15 |
18768 ns/iter (± 41) |
12688 ns/iter (± 23) |
1.48 |
csaf_2_0_tests/6.1.16 |
54597 ns/iter (± 136) |
48360 ns/iter (± 48) |
1.13 |
csaf_2_0_tests/6.1.17 |
22389 ns/iter (± 21) |
13949 ns/iter (± 14) |
1.61 |
csaf_2_0_tests/6.1.18 |
24217 ns/iter (± 17) |
15528 ns/iter (± 12) |
1.56 |
csaf_2_0_tests/6.1.19 |
25921 ns/iter (± 24) |
15363 ns/iter (± 18) |
1.69 |
csaf_2_0_tests/6.1.20 |
24939 ns/iter (± 1047) |
13590 ns/iter (± 481) |
1.84 |
csaf_2_0_tests/6.1.21 |
63173 ns/iter (± 36) |
50943 ns/iter (± 96) |
1.24 |
csaf_2_0_tests/6.1.22 |
63473 ns/iter (± 109) |
51278 ns/iter (± 104) |
1.24 |
csaf_2_0_tests/6.1.23 |
30158 ns/iter (± 134) |
16116 ns/iter (± 19) |
1.87 |
csaf_2_0_tests/6.1.24 |
30948 ns/iter (± 97) |
15849 ns/iter (± 38) |
1.95 |
csaf_2_0_tests/6.1.25 |
51161 ns/iter (± 68) |
34484 ns/iter (± 53) |
1.48 |
csaf_2_0_tests/6.1.26 |
38319 ns/iter (± 49) |
20701 ns/iter (± 30) |
1.85 |
csaf_2_0_tests/6.1.27.1 |
16409 ns/iter (± 74) |
13524 ns/iter (± 49) |
1.21 |
csaf_2_0_tests/6.1.27.2 |
18188 ns/iter (± 41) |
13702 ns/iter (± 12) |
1.33 |
csaf_2_0_tests/6.1.27.3 |
18613 ns/iter (± 44) |
13375 ns/iter (± 39) |
1.39 |
csaf_2_0_tests/6.1.27.4 |
20243 ns/iter (± 19) |
13558 ns/iter (± 74) |
1.49 |
csaf_2_0_tests/6.1.27.5 |
21625 ns/iter (± 35) |
14400 ns/iter (± 22) |
1.50 |
csaf_2_0_tests/6.1.27.6 |
21928 ns/iter (± 14) |
13862 ns/iter (± 23) |
1.58 |
csaf_2_0_tests/6.1.27.7 |
21932 ns/iter (± 45) |
12739 ns/iter (± 268) |
1.72 |
csaf_2_0_tests/6.1.27.8 |
23523 ns/iter (± 43) |
13056 ns/iter (± 9) |
1.80 |
csaf_2_0_tests/6.1.27.9 |
38115 ns/iter (± 40) |
25865 ns/iter (± 64) |
1.47 |
csaf_2_0_tests/6.1.27.10 |
18995 ns/iter (± 41) |
14413 ns/iter (± 18) |
1.32 |
csaf_2_0_tests/6.1.27.11 |
19046 ns/iter (± 43) |
13372 ns/iter (± 22) |
1.42 |
csaf_2_0_tests/6.1.28 |
43475 ns/iter (± 69) |
24653 ns/iter (± 81) |
1.76 |
csaf_2_0_tests/6.1.29 |
32693 ns/iter (± 22) |
12770 ns/iter (± 34) |
2.56 |
csaf_2_0_tests/6.1.30 |
69424 ns/iter (± 267) |
48865 ns/iter (± 62) |
1.42 |
csaf_2_0_tests/6.1.31 |
57499 ns/iter (± 38) |
33684 ns/iter (± 68) |
1.71 |
csaf_2_0_tests/6.1.32 |
36452 ns/iter (± 70) |
12820 ns/iter (± 51) |
2.84 |
csaf_2_0_tests/6.1.33 |
46038 ns/iter (± 1070) |
19962 ns/iter (± 25) |
2.31 |
csaf_2_0_tests/6.2.1 |
159981 ns/iter (± 4327) |
153379 ns/iter (± 333) |
1.04 |
csaf_2_0_tests/6.2.2 |
33606 ns/iter (± 64) |
21563 ns/iter (± 731) |
1.56 |
csaf_2_0_tests/6.2.3 |
33095 ns/iter (± 2590) |
20553 ns/iter (± 147) |
1.61 |
csaf_2_0_tests/6.2.4 |
33868 ns/iter (± 70) |
20431 ns/iter (± 30) |
1.66 |
csaf_2_0_tests/6.2.5 |
70086 ns/iter (± 348) |
59533 ns/iter (± 381) |
1.18 |
csaf_2_0_tests/6.2.6 |
70720 ns/iter (± 67) |
60196 ns/iter (± 113) |
1.17 |
csaf_2_0_tests/6.2.7 |
30921 ns/iter (± 87) |
17565 ns/iter (± 54) |
1.76 |
csaf_2_0_tests/6.2.8 |
48062 ns/iter (± 82) |
36852 ns/iter (± 69) |
1.30 |
csaf_2_0_tests/6.2.9 |
49251 ns/iter (± 332) |
36798 ns/iter (± 199) |
1.34 |
csaf_2_0_tests/6.2.10 |
52511 ns/iter (± 53) |
28811 ns/iter (± 172) |
1.82 |
csaf_2_0_tests/6.2.11 |
180151 ns/iter (± 172) |
157552 ns/iter (± 310) |
1.14 |
csaf_2_0_tests/6.2.12 |
59658 ns/iter (± 175) |
39208 ns/iter (± 39) |
1.52 |
csaf_2_0_tests/6.2.13 |
794256 ns/iter (± 893) |
804796 ns/iter (± 6336) |
0.99 |
csaf_2_0_tests/6.2.14 |
70309 ns/iter (± 154) |
46276 ns/iter (± 35) |
1.52 |
csaf_2_0_tests/6.2.15 |
61444 ns/iter (± 203) |
36413 ns/iter (± 67) |
1.69 |
csaf_2_0_tests/6.2.16 |
68769 ns/iter (± 301) |
46073 ns/iter (± 88) |
1.49 |
csaf_2_0_tests/6.2.17 |
42297 ns/iter (± 72) |
18052 ns/iter (± 20) |
2.34 |
csaf_2_0_tests/6.2.18 |
53898 ns/iter (± 162) |
29025 ns/iter (± 48) |
1.86 |
csaf_2_0_tests/6.2.19 |
46368 ns/iter (± 254) |
21798 ns/iter (± 268) |
2.13 |
csaf_2_0_tests/6.2.20 |
1791698 ns/iter (± 5865) |
1783015 ns/iter (± 6548) |
1.00 |
csaf_2_0_tests/6.3.1 |
55710 ns/iter (± 41) |
44438 ns/iter (± 43) |
1.25 |
csaf_2_0_tests/6.3.2 |
41111 ns/iter (± 829) |
28621 ns/iter (± 30) |
1.44 |
csaf_2_0_tests/6.3.3 |
40557 ns/iter (± 398) |
28599 ns/iter (± 65) |
1.42 |
csaf_2_0_tests/6.3.4 |
43062 ns/iter (± 227) |
31581 ns/iter (± 54) |
1.36 |
csaf_2_0_tests/6.3.5 |
54378 ns/iter (± 142) |
42728 ns/iter (± 39) |
1.27 |
csaf_2_0_tests/6.3.6 |
33625 ns/iter (± 95) |
21051 ns/iter (± 165) |
1.60 |
csaf_2_0_tests/6.3.7 |
33340 ns/iter (± 152) |
20869 ns/iter (± 199) |
1.60 |
csaf_2_0_tests/6.3.8 |
33403 ns/iter (± 193) |
21591 ns/iter (± 259) |
1.55 |
csaf_2_0_tests/6.3.9 |
48569 ns/iter (± 39) |
37106 ns/iter (± 54) |
1.31 |
csaf_2_0_tests/6.3.10 |
58342 ns/iter (± 161) |
32867 ns/iter (± 66) |
1.78 |
csaf_2_0_tests/6.3.11 |
59287 ns/iter (± 108) |
34254 ns/iter (± 28) |
1.73 |
csaf_2_1_tests/6.1.1 |
655318 ns/iter (± 860) |
655242 ns/iter (± 3336) |
1.00 |
csaf_2_1_tests/6.1.2 |
252094 ns/iter (± 645) |
252748 ns/iter (± 1178) |
1.00 |
csaf_2_1_tests/6.1.3 |
79661 ns/iter (± 212) |
68431 ns/iter (± 381) |
1.16 |
csaf_2_1_tests/6.1.4 |
139516 ns/iter (± 282) |
129662 ns/iter (± 174) |
1.08 |
csaf_2_1_tests/6.1.5 |
64503 ns/iter (± 330) |
48272 ns/iter (± 83) |
1.34 |
csaf_2_1_tests/6.1.6 |
140335 ns/iter (± 549) |
122198 ns/iter (± 166) |
1.15 |
csaf_2_1_tests/6.1.7 |
94455 ns/iter (± 210) |
76610 ns/iter (± 79) |
1.23 |
csaf_2_1_tests/6.1.8 |
111599 ns/iter (± 242) |
74853 ns/iter (± 731) |
1.49 |
csaf_2_1_tests/6.1.9 |
588946 ns/iter (± 812) |
584156 ns/iter (± 1518) |
1.01 |
csaf_2_1_tests/6.1.10 |
693328 ns/iter (± 1247) |
718934 ns/iter (± 3976) |
0.96 |
csaf_2_1_tests/6.1.11 |
89218 ns/iter (± 707) |
79101 ns/iter (± 174) |
1.13 |
csaf_2_1_tests/6.1.12 |
96009 ns/iter (± 197) |
84716 ns/iter (± 52) |
1.13 |
csaf_2_1_tests/6.1.13 |
203248 ns/iter (± 378) |
192288 ns/iter (± 548) |
1.06 |
csaf_2_1_tests/6.1.15 |
67142 ns/iter (± 172) |
43506 ns/iter (± 48) |
1.54 |
csaf_2_1_tests/6.1.16 |
177785 ns/iter (± 300) |
152643 ns/iter (± 294) |
1.16 |
csaf_2_1_tests/6.1.17 |
79382 ns/iter (± 76) |
47050 ns/iter (± 110) |
1.69 |
csaf_2_1_tests/6.1.18 |
87977 ns/iter (± 508) |
51799 ns/iter (± 143) |
1.70 |
csaf_2_1_tests/6.1.19 |
91175 ns/iter (± 388) |
51128 ns/iter (± 90) |
1.78 |
csaf_2_1_tests/6.1.20 |
88011 ns/iter (± 82) |
46325 ns/iter (± 96) |
1.90 |
csaf_2_1_tests/6.1.21 |
210905 ns/iter (± 296) |
162958 ns/iter (± 791) |
1.29 |
csaf_2_1_tests/6.1.22 |
197470 ns/iter (± 833) |
152392 ns/iter (± 245) |
1.30 |
csaf_2_1_tests/6.1.23 |
103995 ns/iter (± 95) |
52473 ns/iter (± 52) |
1.98 |
csaf_2_1_tests/6.1.24 |
105020 ns/iter (± 76) |
49683 ns/iter (± 41) |
2.11 |
csaf_2_1_tests/6.1.25 |
224603 ns/iter (± 492) |
168812 ns/iter (± 533) |
1.33 |
csaf_2_1_tests/6.1.26 |
138079 ns/iter (± 182) |
73106 ns/iter (± 155) |
1.89 |
csaf_2_1_tests/6.1.27.1 |
57837 ns/iter (± 328) |
48145 ns/iter (± 247) |
1.20 |
csaf_2_1_tests/6.1.27.2 |
63833 ns/iter (± 40) |
47494 ns/iter (± 102) |
1.34 |
csaf_2_1_tests/6.1.27.3 |
67955 ns/iter (± 31) |
48661 ns/iter (± 51) |
1.40 |
csaf_2_1_tests/6.1.27.4 |
72846 ns/iter (± 871) |
48800 ns/iter (± 30) |
1.49 |
csaf_2_1_tests/6.1.27.5 |
74863 ns/iter (± 163) |
49819 ns/iter (± 121) |
1.50 |
csaf_2_1_tests/6.1.27.6 |
78029 ns/iter (± 93) |
50524 ns/iter (± 184) |
1.54 |
csaf_2_1_tests/6.1.27.7 |
80117 ns/iter (± 1009) |
45662 ns/iter (± 156) |
1.75 |
csaf_2_1_tests/6.1.27.8 |
83187 ns/iter (± 810) |
46691 ns/iter (± 32) |
1.78 |
csaf_2_1_tests/6.1.27.9 |
108748 ns/iter (± 374) |
67684 ns/iter (± 103) |
1.61 |
csaf_2_1_tests/6.1.27.10 |
62821 ns/iter (± 68) |
48083 ns/iter (± 219) |
1.31 |
csaf_2_1_tests/6.1.27.11 |
67239 ns/iter (± 97) |
48330 ns/iter (± 82) |
1.39 |
csaf_2_1_tests/6.1.27.12 |
70960 ns/iter (± 208) |
48753 ns/iter (± 42) |
1.46 |
csaf_2_1_tests/6.1.27.13 |
99555 ns/iter (± 171) |
72463 ns/iter (± 653) |
1.37 |
csaf_2_1_tests/6.1.27.14 |
75293 ns/iter (± 89) |
48967 ns/iter (± 300) |
1.54 |
csaf_2_1_tests/6.1.27.15 |
80975 ns/iter (± 323) |
48649 ns/iter (± 55) |
1.66 |
csaf_2_1_tests/6.1.27.16 |
85416 ns/iter (± 269) |
48944 ns/iter (± 458) |
1.75 |
csaf_2_1_tests/6.1.27.17 |
88756 ns/iter (± 79) |
52002 ns/iter (± 52) |
1.71 |
csaf_2_1_tests/6.1.27.18 |
95876 ns/iter (± 208) |
54858 ns/iter (± 172) |
1.75 |
csaf_2_1_tests/6.1.27.19 |
100014 ns/iter (± 1450) |
54301 ns/iter (± 95) |
1.84 |
csaf_2_1_tests/6.1.28 |
138949 ns/iter (± 190) |
72058 ns/iter (± 76) |
1.93 |
csaf_2_1_tests/6.1.29 |
115115 ns/iter (± 237) |
45958 ns/iter (± 137) |
2.50 |
csaf_2_1_tests/6.1.30 |
223800 ns/iter (± 626) |
156128 ns/iter (± 298) |
1.43 |
csaf_2_1_tests/6.1.31 |
246354 ns/iter (± 1873) |
159454 ns/iter (± 401) |
1.54 |
csaf_2_1_tests/6.1.32 |
125305 ns/iter (± 132) |
46086 ns/iter (± 112) |
2.72 |
csaf_2_1_tests/6.1.33 |
167541 ns/iter (± 200) |
87766 ns/iter (± 226) |
1.91 |
csaf_2_1_tests/6.1.34 |
147696 ns/iter (± 371) |
57229 ns/iter (± 374) |
2.58 |
csaf_2_1_tests/6.1.35 |
171045 ns/iter (± 457) |
77695 ns/iter (± 379) |
2.20 |
csaf_2_1_tests/6.1.36 |
177638 ns/iter (± 438) |
84289 ns/iter (± 384) |
2.11 |
csaf_2_1_tests/6.1.37 |
181676 ns/iter (± 661) |
84492 ns/iter (± 160) |
2.15 |
csaf_2_1_tests/6.1.38 |
148615 ns/iter (± 508) |
46384 ns/iter (± 43) |
3.20 |
csaf_2_1_tests/6.1.39 |
152414 ns/iter (± 97) |
46856 ns/iter (± 181) |
3.25 |
csaf_2_1_tests/6.1.40 |
155849 ns/iter (± 172) |
47389 ns/iter (± 37) |
3.29 |
csaf_2_1_tests/6.1.41 |
152185 ns/iter (± 708) |
46890 ns/iter (± 149) |
3.25 |
csaf_2_1_tests/6.1.42 |
316402 ns/iter (± 918) |
197882 ns/iter (± 205) |
1.60 |
csaf_2_1_tests/6.1.43 |
290366 ns/iter (± 370) |
168308 ns/iter (± 214) |
1.73 |
csaf_2_1_tests/6.1.44 |
295383 ns/iter (± 474) |
168616 ns/iter (± 403) |
1.75 |
csaf_2_1_tests/6.1.45 |
306181 ns/iter (± 1151) |
164307 ns/iter (± 586) |
1.86 |
csaf_2_1_tests/6.1.46 |
424607 ns/iter (± 948) |
269182 ns/iter (± 250) |
1.58 |
csaf_2_1_tests/6.1.47 |
635209 ns/iter (± 1556) |
476012 ns/iter (± 799) |
1.33 |
csaf_2_1_tests/6.1.48 |
222815 ns/iter (± 291) |
87292 ns/iter (± 77) |
2.55 |
csaf_2_1_tests/6.1.49 |
231155 ns/iter (± 890) |
87572 ns/iter (± 102) |
2.64 |
csaf_2_1_tests/6.1.50 |
234236 ns/iter (± 399) |
87752 ns/iter (± 128) |
2.67 |
csaf_2_1_tests/6.1.51 |
324172 ns/iter (± 392) |
170806 ns/iter (± 376) |
1.90 |
csaf_2_1_tests/6.1.52 |
329642 ns/iter (± 1773) |
175526 ns/iter (± 145) |
1.88 |
csaf_2_1_tests/6.1.53 |
206711 ns/iter (± 155) |
54651 ns/iter (± 82) |
3.78 |
csaf_2_1_tests/6.1.54 |
221258 ns/iter (± 171) |
63319 ns/iter (± 88) |
3.49 |
csaf_2_1_tests/6.1.55 |
228769 ns/iter (± 133) |
64151 ns/iter (± 77) |
3.57 |
csaf_2_1_tests/6.1.56 |
259696 ns/iter (± 361) |
95440 ns/iter (± 198) |
2.72 |
csaf_2_1_tests/6.1.57 |
305869 ns/iter (± 8871) |
136174 ns/iter (± 1009) |
2.25 |
csaf_2_1_tests/6.1.58 |
256627 ns/iter (± 8623) |
87032 ns/iter (± 999) |
2.95 |
csaf_2_1_tests/6.1.59 |
261552 ns/iter (± 4273) |
90185 ns/iter (± 110) |
2.90 |
csaf_2_1_tests/6.1.60.1 |
131842 ns/iter (± 2923) |
74629 ns/iter (± 918) |
1.77 |
csaf_2_1_tests/6.1.60.2 |
135047 ns/iter (± 411) |
76609 ns/iter (± 654) |
1.76 |
csaf_2_1_tests/6.1.60.3 |
133961 ns/iter (± 2745) |
73026 ns/iter (± 156) |
1.83 |
csaf_2_1_tests/6.1.61 |
350660 ns/iter (± 925) |
168337 ns/iter (± 270) |
2.08 |
csaf_2_1_tests/6.2.1 |
777805 ns/iter (± 3136) |
723945 ns/iter (± 908) |
1.07 |
csaf_2_1_tests/6.2.2 |
141813 ns/iter (± 463) |
79222 ns/iter (± 254) |
1.79 |
csaf_2_1_tests/6.2.3 |
142281 ns/iter (± 526) |
76631 ns/iter (± 193) |
1.86 |
csaf_2_1_tests/6.2.4 |
134656 ns/iter (± 486) |
66374 ns/iter (± 83) |
2.03 |
csaf_2_1_tests/6.2.5 |
262410 ns/iter (± 686) |
195840 ns/iter (± 383) |
1.34 |
csaf_2_1_tests/6.2.6 |
272951 ns/iter (± 702) |
201513 ns/iter (± 465) |
1.35 |
csaf_2_1_tests/6.2.7 |
142480 ns/iter (± 461) |
63063 ns/iter (± 145) |
2.26 |
csaf_2_1_tests/6.2.8 |
259230 ns/iter (± 432) |
175894 ns/iter (± 839) |
1.47 |
csaf_2_1_tests/6.2.9 |
262588 ns/iter (± 1076) |
187554 ns/iter (± 713) |
1.40 |
csaf_2_1_tests/6.2.11 |
758321 ns/iter (± 867) |
571951 ns/iter (± 1120) |
1.33 |
csaf_2_1_tests/6.2.12 |
332628 ns/iter (± 1017) |
124412 ns/iter (± 168) |
2.67 |
csaf_2_1_tests/6.2.13 |
3757301 ns/iter (± 16957) |
3581048 ns/iter (± 23245) |
1.05 |
csaf_2_1_tests/6.2.14 |
346267 ns/iter (± 474) |
126403 ns/iter (± 635) |
2.74 |
csaf_2_1_tests/6.2.15 |
333299 ns/iter (± 267) |
108757 ns/iter (± 90) |
3.06 |
csaf_2_1_tests/6.2.16 |
449941 ns/iter (± 794) |
219378 ns/iter (± 824) |
2.05 |
csaf_2_1_tests/6.2.17 |
289097 ns/iter (± 410) |
69998 ns/iter (± 112) |
4.13 |
csaf_2_1_tests/6.2.18 |
363058 ns/iter (± 615) |
151768 ns/iter (± 488) |
2.39 |
csaf_2_1_tests/6.2.19 |
293901 ns/iter (± 416) |
83528 ns/iter (± 139) |
3.52 |
csaf_2_1_tests/6.2.20 |
8328652 ns/iter (± 186150) |
8142952 ns/iter (± 138139) |
1.02 |
csaf_2_1_tests/6.2.21 |
579748 ns/iter (± 6616) |
350545 ns/iter (± 576) |
1.65 |
csaf_2_1_tests/6.2.22 |
392970 ns/iter (± 394) |
163996 ns/iter (± 1063) |
2.40 |
csaf_2_1_tests/6.2.23 |
316945 ns/iter (± 819) |
83200 ns/iter (± 169) |
3.81 |
csaf_2_1_tests/6.2.24 |
315749 ns/iter (± 377) |
83462 ns/iter (± 57) |
3.78 |
csaf_2_1_tests/6.2.25 |
307279 ns/iter (± 8625) |
83944 ns/iter (± 595) |
3.66 |
csaf_2_1_tests/6.2.26 |
325659 ns/iter (± 1589) |
84170 ns/iter (± 582) |
3.87 |
csaf_2_1_tests/6.2.27 |
328797 ns/iter (± 1877) |
84162 ns/iter (± 121) |
3.91 |
csaf_2_1_tests/6.2.28 |
318300 ns/iter (± 5034) |
73430 ns/iter (± 263) |
4.33 |
csaf_2_1_tests/6.2.29 |
324858 ns/iter (± 2135) |
71173 ns/iter (± 299) |
4.56 |
csaf_2_1_tests/6.2.30 |
322343 ns/iter (± 3916) |
71643 ns/iter (± 313) |
4.50 |
csaf_2_1_tests/6.2.31 |
348089 ns/iter (± 2273) |
85412 ns/iter (± 124) |
4.08 |
csaf_2_1_tests/6.2.32 |
343803 ns/iter (± 631) |
85572 ns/iter (± 189) |
4.02 |
csaf_2_1_tests/6.2.33 |
497385 ns/iter (± 3177) |
231105 ns/iter (± 1035) |
2.15 |
csaf_2_1_tests/6.2.34 |
373345 ns/iter (± 553) |
85916 ns/iter (± 467) |
4.35 |
csaf_2_1_tests/6.2.35 |
358071 ns/iter (± 787) |
86168 ns/iter (± 131) |
4.16 |
csaf_2_1_tests/6.2.36 |
381338 ns/iter (± 489) |
86616 ns/iter (± 329) |
4.40 |
csaf_2_1_tests/6.2.37 |
365633 ns/iter (± 9514) |
86845 ns/iter (± 98) |
4.21 |
csaf_2_1_tests/6.2.38 |
402385 ns/iter (± 575) |
100298 ns/iter (± 184) |
4.01 |
csaf_2_1_tests/6.2.39.1 |
155566 ns/iter (± 336) |
75349 ns/iter (± 695) |
2.06 |
csaf_2_1_tests/6.2.39.2 |
158053 ns/iter (± 530) |
75728 ns/iter (± 150) |
2.09 |
csaf_2_1_tests/6.2.39.3 |
161284 ns/iter (± 675) |
75061 ns/iter (± 695) |
2.15 |
csaf_2_1_tests/6.2.39.4 |
163417 ns/iter (± 726) |
74700 ns/iter (± 177) |
2.19 |
csaf_2_1_tests/6.2.39.5 |
167630 ns/iter (± 593) |
75236 ns/iter (± 646) |
2.23 |
csaf_2_1_tests/6.2.40 |
369510 ns/iter (± 551) |
90499 ns/iter (± 208) |
4.08 |
csaf_2_1_tests/6.2.41 |
486651 ns/iter (± 745) |
196650 ns/iter (± 466) |
2.47 |
csaf_2_1_tests/6.2.42 |
357118 ns/iter (± 9345) |
87777 ns/iter (± 178) |
4.07 |
csaf_2_1_tests/6.2.43 |
385571 ns/iter (± 2078) |
88032 ns/iter (± 92) |
4.38 |
csaf_2_1_tests/6.2.44 |
368481 ns/iter (± 1872) |
88331 ns/iter (± 90) |
4.17 |
csaf_2_1_tests/6.2.45 |
390667 ns/iter (± 442) |
88712 ns/iter (± 200) |
4.40 |
csaf_2_1_tests/6.2.46 |
398069 ns/iter (± 807) |
88829 ns/iter (± 239) |
4.48 |
csaf_2_1_tests/6.2.47 |
402787 ns/iter (± 7108) |
89007 ns/iter (± 144) |
4.53 |
csaf_2_1_tests/6.2.48 |
490034 ns/iter (± 1355) |
171995 ns/iter (± 725) |
2.85 |
csaf_2_1_tests/6.2.49 |
419923 ns/iter (± 944) |
89580 ns/iter (± 478) |
4.69 |
csaf_2_1_tests/6.2.50.1 |
174788 ns/iter (± 298) |
75207 ns/iter (± 600) |
2.32 |
csaf_2_1_tests/6.2.50.2 |
177290 ns/iter (± 259) |
75100 ns/iter (± 809) |
2.36 |
csaf_2_1_tests/6.2.50.3 |
183356 ns/iter (± 600) |
73370 ns/iter (± 549) |
2.50 |
csaf_2_1_tests/6.2.51 |
414687 ns/iter (± 669) |
89832 ns/iter (± 541) |
4.62 |
csaf_2_1_tests/6.2.52 |
537574 ns/iter (± 3006) |
200178 ns/iter (± 251) |
2.69 |
csaf_2_1_tests/6.2.53 |
436527 ns/iter (± 1215) |
80875 ns/iter (± 268) |
5.40 |
csaf_2_1_tests/6.2.54.1 |
187031 ns/iter (± 351) |
74046 ns/iter (± 253) |
2.53 |
csaf_2_1_tests/6.2.54.2 |
188269 ns/iter (± 548) |
75034 ns/iter (± 166) |
2.51 |
csaf_2_1_tests/6.2.54.3 |
195314 ns/iter (± 449) |
75131 ns/iter (± 60) |
2.60 |
csaf_2_1_tests/6.2.54.4 |
199686 ns/iter (± 320) |
74863 ns/iter (± 102) |
2.67 |
csaf_2_1_tests/6.3.1 |
180381 ns/iter (± 418) |
75154 ns/iter (± 226) |
2.40 |
csaf_2_1_tests/6.3.2 |
210326 ns/iter (± 224) |
98477 ns/iter (± 473) |
2.14 |
csaf_2_1_tests/6.3.3 |
186246 ns/iter (± 540) |
75733 ns/iter (± 81) |
2.46 |
csaf_2_1_tests/6.3.4 |
184938 ns/iter (± 512) |
75726 ns/iter (± 58) |
2.44 |
csaf_2_1_tests/6.3.5 |
193347 ns/iter (± 338) |
74554 ns/iter (± 103) |
2.59 |
csaf_2_1_tests/6.3.6 |
197096 ns/iter (± 632) |
75428 ns/iter (± 733) |
2.61 |
csaf_2_1_tests/6.3.7 |
203107 ns/iter (± 782) |
77299 ns/iter (± 311) |
2.63 |
csaf_2_1_tests/6.3.8 |
204608 ns/iter (± 1352) |
76630 ns/iter (± 276) |
2.67 |
csaf_2_1_tests/6.3.9 |
325294 ns/iter (± 1842) |
192895 ns/iter (± 234) |
1.69 |
csaf_2_1_tests/6.3.10 |
425109 ns/iter (± 602) |
88081 ns/iter (± 82) |
4.83 |
csaf_2_1_tests/6.3.11 |
422606 ns/iter (± 486) |
88056 ns/iter (± 97) |
4.80 |
csaf_2_1_tests/6.3.12 |
593381 ns/iter (± 1175) |
236631 ns/iter (± 1773) |
2.51 |
csaf_2_1_tests/6.3.13 |
438926 ns/iter (± 11092) |
88677 ns/iter (± 88) |
4.95 |
csaf_2_1_tests/6.3.14 |
440822 ns/iter (± 628) |
92576 ns/iter (± 101) |
4.76 |
csaf_2_1_tests/6.3.15 |
448318 ns/iter (± 1741) |
89197 ns/iter (± 72) |
5.03 |
csaf_2_1_tests/6.3.16 |
443676 ns/iter (± 532) |
89504 ns/iter (± 298) |
4.96 |
csaf_2_1_tests/6.3.17 |
452828 ns/iter (± 511) |
89519 ns/iter (± 44) |
5.06 |
csaf_2_1_tests/6.3.18 |
471168 ns/iter (± 510) |
99454 ns/iter (± 219) |
4.74 |
csaf_2_1_tests/6.3.19.1 |
210219 ns/iter (± 343) |
74520 ns/iter (± 592) |
2.82 |
csaf_2_1_tests/6.3.19.2 |
211643 ns/iter (± 431) |
74660 ns/iter (± 336) |
2.83 |
csaf_2_1_tests/6.3.19.3 |
216066 ns/iter (± 261) |
75125 ns/iter (± 339) |
2.88 |
csaf_2_1_tests/6.3.19.4 |
218685 ns/iter (± 3667) |
75444 ns/iter (± 92) |
2.90 |
csaf_2_1_tests/6.3.19.5 |
222594 ns/iter (± 857) |
73059 ns/iter (± 445) |
3.05 |
csaf_2_1_tests/6.3.20 |
496436 ns/iter (± 1895) |
100245 ns/iter (± 141) |
4.95 |
csaf_2_1_tests/6.3.21.1 |
225982 ns/iter (± 348) |
75159 ns/iter (± 101) |
3.01 |
csaf_2_1_tests/6.3.21.2 |
227859 ns/iter (± 296) |
75438 ns/iter (± 213) |
3.02 |
csaf_2_1_tests/6.3.21.3 |
233024 ns/iter (± 364) |
76552 ns/iter (± 2004) |
3.04 |
csaf_2_1_tests/6.3.21.4 |
226083 ns/iter (± 675) |
74545 ns/iter (± 864) |
3.03 |
csaf_2_1_tests/6.3.21.5 |
239787 ns/iter (± 821) |
73216 ns/iter (± 1560) |
3.28 |
csaf_2_1_tests/6.3.21.6 |
242313 ns/iter (± 205) |
74526 ns/iter (± 45) |
3.25 |
csaf_2_1_tests/6.3.21.7 |
249564 ns/iter (± 1732) |
74181 ns/iter (± 72) |
3.36 |
csaf_2_1_tests/6.3.21.8 |
251040 ns/iter (± 490) |
74520 ns/iter (± 38) |
3.37 |
csaf_2_1_tests/6.3.21.9 |
252513 ns/iter (± 264) |
74541 ns/iter (± 212) |
3.39 |
csaf_2_1_tests/6.3.22 |
488606 ns/iter (± 1052) |
90416 ns/iter (± 135) |
5.40 |
full_validation/csaf_2_0_full_preset |
7111919 ns/iter (± 13220) |
7110941 ns/iter (± 82517) |
1.00 |
full_validation/csaf_2_1_full_preset |
47249388 ns/iter (± 164340) |
50067356 ns/iter (± 292705) |
0.94 |
parse_only/csaf_2_0 |
1197454 ns/iter (± 2004) |
1191124 ns/iter (± 1858) |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
tziemek
force-pushed
the
feat/rust-service
branch
from
0c77b24 to
d919786
Compare
peinjoh
reviewed
May 21, 2026
tziemek
force-pushed
the
feat/rust-service
branch
from
f8ed691 to
c71d31c
Compare
tziemek
force-pushed
the
feat/rust-service
branch
from
14dfdcb to
dd8a5dd
Compare
There was a problem hiding this comment.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'CSAF Validation Benchmark'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.50.
| Benchmark suite | Current: dd8a5dd | Previous: bbccec5 | Ratio |
|---|---|---|---|
csaf_2_0_tests/6.1.1 |
194728 ns/iter (± 325) |
127826 ns/iter (± 279) |
1.52 |
csaf_2_0_tests/6.1.2 |
111901 ns/iter (± 264) |
53197 ns/iter (± 63) |
2.10 |
csaf_2_0_tests/6.1.3 |
64287 ns/iter (± 212) |
12909 ns/iter (± 80) |
4.98 |
csaf_2_0_tests/6.1.4 |
82205 ns/iter (± 231) |
27298 ns/iter (± 86) |
3.01 |
csaf_2_0_tests/6.1.5 |
67662 ns/iter (± 81) |
14551 ns/iter (± 34) |
4.65 |
csaf_2_0_tests/6.1.6 |
93196 ns/iter (± 488) |
38385 ns/iter (± 49) |
2.43 |
csaf_2_0_tests/6.1.7 |
88014 ns/iter (± 109) |
34563 ns/iter (± 51) |
2.55 |
csaf_2_0_tests/6.1.8 |
150619 ns/iter (± 213) |
86232 ns/iter (± 115) |
1.75 |
csaf_2_0_tests/6.1.9 |
144003 ns/iter (± 670) |
84357 ns/iter (± 2748) |
1.71 |
csaf_2_0_tests/6.1.11 |
71500 ns/iter (± 522) |
14475 ns/iter (± 207) |
4.94 |
csaf_2_0_tests/6.1.12 |
85691 ns/iter (± 223) |
30034 ns/iter (± 188) |
2.85 |
csaf_2_0_tests/6.1.13 |
95417 ns/iter (± 313) |
33254 ns/iter (± 38) |
2.87 |
csaf_2_0_tests/6.1.15 |
70335 ns/iter (± 516) |
12539 ns/iter (± 264) |
5.61 |
csaf_2_0_tests/6.1.16 |
109627 ns/iter (± 211) |
46056 ns/iter (± 121) |
2.38 |
csaf_2_0_tests/6.1.17 |
72791 ns/iter (± 346) |
13774 ns/iter (± 14) |
5.28 |
csaf_2_0_tests/6.1.18 |
76848 ns/iter (± 819) |
15848 ns/iter (± 336) |
4.85 |
csaf_2_0_tests/6.1.19 |
76014 ns/iter (± 485) |
15681 ns/iter (± 24) |
4.85 |
csaf_2_0_tests/6.1.20 |
76015 ns/iter (± 151) |
13615 ns/iter (± 66) |
5.58 |
csaf_2_0_tests/6.1.21 |
114025 ns/iter (± 658) |
43934 ns/iter (± 365) |
2.60 |
csaf_2_0_tests/6.1.22 |
118222 ns/iter (± 278) |
50276 ns/iter (± 109) |
2.35 |
csaf_2_0_tests/6.1.23 |
81993 ns/iter (± 1154) |
16143 ns/iter (± 22) |
5.08 |
csaf_2_0_tests/6.1.24 |
83867 ns/iter (± 990) |
17409 ns/iter (± 205) |
4.82 |
csaf_2_0_tests/6.1.25 |
107339 ns/iter (± 7849) |
35731 ns/iter (± 184) |
3.00 |
csaf_2_0_tests/6.1.26 |
88502 ns/iter (± 346) |
20303 ns/iter (± 72) |
4.36 |
csaf_2_0_tests/6.1.27.1 |
66237 ns/iter (± 1356) |
13368 ns/iter (± 17) |
4.95 |
csaf_2_0_tests/6.1.27.2 |
66285 ns/iter (± 189) |
13306 ns/iter (± 256) |
4.98 |
csaf_2_0_tests/6.1.27.3 |
68043 ns/iter (± 1428) |
13221 ns/iter (± 33) |
5.15 |
csaf_2_0_tests/6.1.27.4 |
67468 ns/iter (± 232) |
13437 ns/iter (± 27) |
5.02 |
csaf_2_0_tests/6.1.27.5 |
69103 ns/iter (± 154) |
13972 ns/iter (± 22) |
4.95 |
csaf_2_0_tests/6.1.27.6 |
69535 ns/iter (± 393) |
12870 ns/iter (± 29) |
5.40 |
csaf_2_0_tests/6.1.27.7 |
69224 ns/iter (± 228) |
12758 ns/iter (± 29) |
5.43 |
csaf_2_0_tests/6.1.27.8 |
70529 ns/iter (± 326) |
12801 ns/iter (± 14) |
5.51 |
csaf_2_0_tests/6.1.27.9 |
85925 ns/iter (± 158) |
26952 ns/iter (± 1162) |
3.19 |
csaf_2_0_tests/6.1.27.10 |
66400 ns/iter (± 155) |
14081 ns/iter (± 94) |
4.72 |
csaf_2_0_tests/6.1.27.11 |
64806 ns/iter (± 1327) |
13161 ns/iter (± 25) |
4.92 |
csaf_2_0_tests/6.1.28 |
90720 ns/iter (± 641) |
23846 ns/iter (± 267) |
3.80 |
csaf_2_0_tests/6.1.29 |
81234 ns/iter (± 94) |
13060 ns/iter (± 265) |
6.22 |
csaf_2_0_tests/6.1.30 |
123089 ns/iter (± 176) |
46567 ns/iter (± 54) |
2.64 |
csaf_2_0_tests/6.1.31 |
111239 ns/iter (± 265) |
34176 ns/iter (± 64) |
3.25 |
csaf_2_0_tests/6.1.32 |
86108 ns/iter (± 70) |
13115 ns/iter (± 22) |
6.57 |
csaf_2_0_tests/6.1.33 |
95234 ns/iter (± 517) |
20451 ns/iter (± 85) |
4.66 |
csaf_2_0_tests/6.2.1 |
238701 ns/iter (± 492) |
153000 ns/iter (± 1824) |
1.56 |
csaf_2_0_tests/6.2.2 |
82481 ns/iter (± 2464) |
21803 ns/iter (± 75) |
3.78 |
csaf_2_0_tests/6.2.3 |
87004 ns/iter (± 143) |
20914 ns/iter (± 75) |
4.16 |
csaf_2_0_tests/6.2.4 |
82429 ns/iter (± 151) |
20490 ns/iter (± 36) |
4.02 |
csaf_2_0_tests/6.2.5 |
126057 ns/iter (± 430) |
58027 ns/iter (± 151) |
2.17 |
csaf_2_0_tests/6.2.6 |
126814 ns/iter (± 429) |
58466 ns/iter (± 125) |
2.17 |
csaf_2_0_tests/6.2.7 |
84742 ns/iter (± 283) |
17678 ns/iter (± 87) |
4.79 |
csaf_2_0_tests/6.2.8 |
113963 ns/iter (± 821) |
37769 ns/iter (± 187) |
3.02 |
csaf_2_0_tests/6.2.9 |
112966 ns/iter (± 977) |
37555 ns/iter (± 49) |
3.01 |
csaf_2_0_tests/6.2.10 |
103303 ns/iter (± 1096) |
28358 ns/iter (± 35) |
3.64 |
csaf_2_0_tests/6.2.11 |
249869 ns/iter (± 5540) |
152187 ns/iter (± 196) |
1.64 |
csaf_2_0_tests/6.2.12 |
113048 ns/iter (± 152) |
35583 ns/iter (± 274) |
3.18 |
csaf_2_0_tests/6.2.14 |
128691 ns/iter (± 156) |
46334 ns/iter (± 803) |
2.78 |
csaf_2_0_tests/6.2.15 |
116857 ns/iter (± 2126) |
37532 ns/iter (± 1202) |
3.11 |
csaf_2_0_tests/6.2.16 |
131192 ns/iter (± 398) |
46339 ns/iter (± 132) |
2.83 |
csaf_2_0_tests/6.2.17 |
102174 ns/iter (± 3156) |
18431 ns/iter (± 26) |
5.54 |
csaf_2_0_tests/6.2.18 |
115444 ns/iter (± 420) |
29444 ns/iter (± 103) |
3.92 |
csaf_2_0_tests/6.2.19 |
102187 ns/iter (± 319) |
21163 ns/iter (± 29) |
4.83 |
csaf_2_0_tests/6.3.1 |
108779 ns/iter (± 494) |
43404 ns/iter (± 113) |
2.51 |
csaf_2_0_tests/6.3.2 |
95135 ns/iter (± 677) |
28188 ns/iter (± 58) |
3.38 |
csaf_2_0_tests/6.3.3 |
97490 ns/iter (± 237) |
28264 ns/iter (± 34) |
3.45 |
csaf_2_0_tests/6.3.4 |
102192 ns/iter (± 876) |
30986 ns/iter (± 59) |
3.30 |
csaf_2_0_tests/6.3.5 |
118040 ns/iter (± 1569) |
43210 ns/iter (± 78) |
2.73 |
csaf_2_0_tests/6.3.6 |
88900 ns/iter (± 179) |
20546 ns/iter (± 24) |
4.33 |
csaf_2_0_tests/6.3.7 |
90269 ns/iter (± 525) |
20344 ns/iter (± 38) |
4.44 |
csaf_2_0_tests/6.3.8 |
90659 ns/iter (± 132) |
20643 ns/iter (± 46) |
4.39 |
csaf_2_0_tests/6.3.9 |
111354 ns/iter (± 375) |
36408 ns/iter (± 140) |
3.06 |
csaf_2_0_tests/6.3.10 |
116588 ns/iter (± 622) |
32706 ns/iter (± 70) |
3.56 |
csaf_2_0_tests/6.3.11 |
122085 ns/iter (± 146) |
34187 ns/iter (± 88) |
3.57 |
csaf_2_1_tests/6.1.1 |
936527 ns/iter (± 4362) |
584114 ns/iter (± 1592) |
1.60 |
csaf_2_1_tests/6.1.2 |
590940 ns/iter (± 1052) |
244935 ns/iter (± 574) |
2.41 |
csaf_2_1_tests/6.1.3 |
371438 ns/iter (± 2629) |
66894 ns/iter (± 250) |
5.55 |
csaf_2_1_tests/6.1.4 |
434349 ns/iter (± 1546) |
110357 ns/iter (± 216) |
3.94 |
csaf_2_1_tests/6.1.5 |
338329 ns/iter (± 899) |
47107 ns/iter (± 212) |
7.18 |
csaf_2_1_tests/6.1.6 |
422432 ns/iter (± 6541) |
111728 ns/iter (± 437) |
3.78 |
csaf_2_1_tests/6.1.7 |
383284 ns/iter (± 480) |
71679 ns/iter (± 402) |
5.35 |
csaf_2_1_tests/6.1.8 |
403394 ns/iter (± 302) |
71615 ns/iter (± 99) |
5.63 |
csaf_2_1_tests/6.1.9 |
905044 ns/iter (± 1371) |
562740 ns/iter (± 1165) |
1.61 |
csaf_2_1_tests/6.1.11 |
388712 ns/iter (± 1428) |
81689 ns/iter (± 104) |
4.76 |
csaf_2_1_tests/6.1.12 |
379524 ns/iter (± 18221) |
85409 ns/iter (± 2186) |
4.44 |
csaf_2_1_tests/6.1.13 |
520105 ns/iter (± 1101) |
188829 ns/iter (± 1269) |
2.75 |
csaf_2_1_tests/6.1.15 |
349558 ns/iter (± 328) |
41331 ns/iter (± 145) |
8.46 |
csaf_2_1_tests/6.1.16 |
493219 ns/iter (± 1407) |
159921 ns/iter (± 236) |
3.08 |
csaf_2_1_tests/6.1.17 |
371423 ns/iter (± 433) |
46260 ns/iter (± 91) |
8.03 |
csaf_2_1_tests/6.1.18 |
383108 ns/iter (± 657) |
54604 ns/iter (± 210) |
7.02 |
csaf_2_1_tests/6.1.19 |
381435 ns/iter (± 10364) |
52343 ns/iter (± 315) |
7.29 |
csaf_2_1_tests/6.1.20 |
367344 ns/iter (± 570) |
46179 ns/iter (± 123) |
7.95 |
csaf_2_1_tests/6.1.21 |
519798 ns/iter (± 1736) |
147318 ns/iter (± 249) |
3.53 |
csaf_2_1_tests/6.1.22 |
519414 ns/iter (± 1653) |
146785 ns/iter (± 380) |
3.54 |
csaf_2_1_tests/6.1.23 |
408723 ns/iter (± 394) |
52409 ns/iter (± 89) |
7.80 |
csaf_2_1_tests/6.1.24 |
401083 ns/iter (± 15998) |
57758 ns/iter (± 332) |
6.94 |
csaf_2_1_tests/6.1.25 |
545594 ns/iter (± 4977) |
160324 ns/iter (± 575) |
3.40 |
csaf_2_1_tests/6.1.26 |
430922 ns/iter (± 2757) |
72163 ns/iter (± 295) |
5.97 |
csaf_2_1_tests/6.1.27.1 |
352774 ns/iter (± 452) |
45616 ns/iter (± 94) |
7.73 |
csaf_2_1_tests/6.1.27.2 |
353797 ns/iter (± 266) |
45610 ns/iter (± 105) |
7.76 |
csaf_2_1_tests/6.1.27.3 |
364694 ns/iter (± 5152) |
46683 ns/iter (± 43) |
7.81 |
csaf_2_1_tests/6.1.27.4 |
376941 ns/iter (± 809) |
47215 ns/iter (± 163) |
7.98 |
csaf_2_1_tests/6.1.27.5 |
375927 ns/iter (± 1296) |
50716 ns/iter (± 158) |
7.41 |
csaf_2_1_tests/6.1.27.6 |
367791 ns/iter (± 341) |
43638 ns/iter (± 145) |
8.43 |
csaf_2_1_tests/6.1.27.7 |
376372 ns/iter (± 845) |
44336 ns/iter (± 84) |
8.49 |
csaf_2_1_tests/6.1.27.8 |
378916 ns/iter (± 309) |
43539 ns/iter (± 107) |
8.70 |
csaf_2_1_tests/6.1.27.9 |
403100 ns/iter (± 672) |
58094 ns/iter (± 699) |
6.94 |
csaf_2_1_tests/6.1.27.10 |
366534 ns/iter (± 604) |
44195 ns/iter (± 928) |
8.29 |
csaf_2_1_tests/6.1.27.11 |
368068 ns/iter (± 529) |
46873 ns/iter (± 51) |
7.85 |
csaf_2_1_tests/6.1.27.12 |
370502 ns/iter (± 838) |
43617 ns/iter (± 40) |
8.49 |
csaf_2_1_tests/6.1.27.13 |
389032 ns/iter (± 543) |
67189 ns/iter (± 74) |
5.79 |
csaf_2_1_tests/6.1.27.14 |
380233 ns/iter (± 818) |
47155 ns/iter (± 194) |
8.06 |
csaf_2_1_tests/6.1.27.15 |
378157 ns/iter (± 798) |
47506 ns/iter (± 210) |
7.96 |
csaf_2_1_tests/6.1.27.16 |
400262 ns/iter (± 1573) |
47099 ns/iter (± 127) |
8.50 |
csaf_2_1_tests/6.1.27.17 |
402525 ns/iter (± 761) |
50475 ns/iter (± 99) |
7.97 |
csaf_2_1_tests/6.1.27.18 |
388641 ns/iter (± 95559) |
53403 ns/iter (± 296) |
7.28 |
csaf_2_1_tests/6.1.27.19 |
393035 ns/iter (± 2086) |
52813 ns/iter (± 60) |
7.44 |
csaf_2_1_tests/6.1.28 |
426120 ns/iter (± 1509) |
69353 ns/iter (± 522) |
6.14 |
csaf_2_1_tests/6.1.29 |
415621 ns/iter (± 1363) |
46308 ns/iter (± 271) |
8.98 |
csaf_2_1_tests/6.1.30 |
552628 ns/iter (± 2958) |
160790 ns/iter (± 1794) |
3.44 |
csaf_2_1_tests/6.1.31 |
556921 ns/iter (± 2229) |
154290 ns/iter (± 246) |
3.61 |
csaf_2_1_tests/6.1.32 |
423763 ns/iter (± 460) |
46568 ns/iter (± 43) |
9.10 |
csaf_2_1_tests/6.1.33 |
472360 ns/iter (± 2465) |
86398 ns/iter (± 202) |
5.47 |
csaf_2_1_tests/6.1.34 |
441939 ns/iter (± 699) |
58059 ns/iter (± 306) |
7.61 |
csaf_2_1_tests/6.1.35 |
480413 ns/iter (± 7208) |
79078 ns/iter (± 78) |
6.08 |
csaf_2_1_tests/6.1.36 |
488595 ns/iter (± 1624) |
86937 ns/iter (± 266) |
5.62 |
csaf_2_1_tests/6.1.37 |
480303 ns/iter (± 808) |
88122 ns/iter (± 233) |
5.45 |
csaf_2_1_tests/6.1.38 |
427151 ns/iter (± 20374) |
46102 ns/iter (± 151) |
9.27 |
csaf_2_1_tests/6.1.39 |
444491 ns/iter (± 525) |
46529 ns/iter (± 319) |
9.55 |
csaf_2_1_tests/6.1.40 |
451204 ns/iter (± 392) |
46644 ns/iter (± 77) |
9.67 |
csaf_2_1_tests/6.1.41 |
451774 ns/iter (± 671) |
47241 ns/iter (± 50) |
9.56 |
csaf_2_1_tests/6.1.42 |
638031 ns/iter (± 2161) |
200619 ns/iter (± 512) |
3.18 |
csaf_2_1_tests/6.1.43 |
605713 ns/iter (± 3199) |
164088 ns/iter (± 263) |
3.69 |
csaf_2_1_tests/6.1.44 |
613649 ns/iter (± 1283) |
163859 ns/iter (± 1622) |
3.74 |
csaf_2_1_tests/6.1.45 |
601550 ns/iter (± 1462) |
160740 ns/iter (± 287) |
3.74 |
csaf_2_1_tests/6.1.46 |
722182 ns/iter (± 1870) |
280097 ns/iter (± 640) |
2.58 |
csaf_2_1_tests/6.1.47 |
948540 ns/iter (± 7336) |
514366 ns/iter (± 1080) |
1.84 |
csaf_2_1_tests/6.1.48 |
513060 ns/iter (± 1165) |
91541 ns/iter (± 2797) |
5.60 |
csaf_2_1_tests/6.1.49 |
518033 ns/iter (± 978) |
92307 ns/iter (± 259) |
5.61 |
csaf_2_1_tests/6.1.50 |
521176 ns/iter (± 754) |
90594 ns/iter (± 209) |
5.75 |
csaf_2_1_tests/6.1.51 |
614376 ns/iter (± 2983) |
167093 ns/iter (± 539) |
3.68 |
csaf_2_1_tests/6.1.52 |
626295 ns/iter (± 1341) |
171618 ns/iter (± 440) |
3.65 |
csaf_2_1_tests/6.1.53 |
496585 ns/iter (± 1321) |
57045 ns/iter (± 789) |
8.71 |
csaf_2_1_tests/6.1.54 |
502129 ns/iter (± 670) |
63184 ns/iter (± 144) |
7.95 |
csaf_2_1_tests/6.1.55 |
501458 ns/iter (± 967) |
64188 ns/iter (± 106) |
7.81 |
csaf_2_1_tests/6.1.56 |
548212 ns/iter (± 663) |
97401 ns/iter (± 451) |
5.63 |
csaf_2_1_tests/6.1.57 |
588431 ns/iter (± 1938) |
125792 ns/iter (± 587) |
4.68 |
csaf_2_1_tests/6.1.58 |
551095 ns/iter (± 986) |
88494 ns/iter (± 883) |
6.23 |
csaf_2_1_tests/6.1.59 |
554313 ns/iter (± 624) |
94658 ns/iter (± 188) |
5.86 |
csaf_2_1_tests/6.1.60.1 |
409970 ns/iter (± 621) |
69435 ns/iter (± 1050) |
5.90 |
csaf_2_1_tests/6.1.60.2 |
412071 ns/iter (± 866) |
69339 ns/iter (± 104) |
5.94 |
csaf_2_1_tests/6.1.60.3 |
414742 ns/iter (± 595) |
68804 ns/iter (± 104) |
6.03 |
csaf_2_1_tests/6.1.61 |
652479 ns/iter (± 1409) |
165925 ns/iter (± 834) |
3.93 |
csaf_2_1_tests/6.2.1 |
1085379 ns/iter (± 3540) |
658257 ns/iter (± 4492) |
1.65 |
csaf_2_1_tests/6.2.2 |
425463 ns/iter (± 714) |
80349 ns/iter (± 383) |
5.30 |
csaf_2_1_tests/6.2.3 |
421899 ns/iter (± 1492) |
76926 ns/iter (± 315) |
5.48 |
csaf_2_1_tests/6.2.4 |
422072 ns/iter (± 715) |
69185 ns/iter (± 273) |
6.10 |
csaf_2_1_tests/6.2.5 |
585105 ns/iter (± 5288) |
210223 ns/iter (± 637) |
2.78 |
csaf_2_1_tests/6.2.6 |
595075 ns/iter (± 1587) |
213901 ns/iter (± 471) |
2.78 |
csaf_2_1_tests/6.2.7 |
420049 ns/iter (± 943) |
60711 ns/iter (± 116) |
6.92 |
csaf_2_1_tests/6.2.8 |
564170 ns/iter (± 3223) |
171603 ns/iter (± 265) |
3.29 |
csaf_2_1_tests/6.2.9 |
576640 ns/iter (± 1132) |
173226 ns/iter (± 712) |
3.33 |
csaf_2_1_tests/6.2.11 |
1052669 ns/iter (± 960) |
537938 ns/iter (± 1115) |
1.96 |
csaf_2_1_tests/6.2.12 |
599741 ns/iter (± 3994) |
125636 ns/iter (± 148) |
4.77 |
csaf_2_1_tests/6.2.14 |
617951 ns/iter (± 1051) |
126898 ns/iter (± 1345) |
4.87 |
csaf_2_1_tests/6.2.15 |
584114 ns/iter (± 651) |
108148 ns/iter (± 282) |
5.40 |
csaf_2_1_tests/6.2.16 |
728496 ns/iter (± 4667) |
222743 ns/iter (± 945) |
3.27 |
csaf_2_1_tests/6.2.17 |
553857 ns/iter (± 6380) |
70441 ns/iter (± 585) |
7.86 |
csaf_2_1_tests/6.2.18 |
658692 ns/iter (± 1771) |
155318 ns/iter (± 238) |
4.24 |
csaf_2_1_tests/6.2.19 |
573663 ns/iter (± 712) |
82723 ns/iter (± 208) |
6.93 |
csaf_2_1_tests/6.2.21 |
877563 ns/iter (± 11960) |
352467 ns/iter (± 958) |
2.49 |
csaf_2_1_tests/6.2.22 |
699794 ns/iter (± 1887) |
168513 ns/iter (± 533) |
4.15 |
csaf_2_1_tests/6.2.23 |
579199 ns/iter (± 4253) |
83482 ns/iter (± 107) |
6.94 |
csaf_2_1_tests/6.2.24 |
583262 ns/iter (± 542) |
83735 ns/iter (± 97) |
6.97 |
csaf_2_1_tests/6.2.25 |
595349 ns/iter (± 1204) |
85141 ns/iter (± 212) |
6.99 |
csaf_2_1_tests/6.2.26 |
588254 ns/iter (± 953) |
84258 ns/iter (± 175) |
6.98 |
csaf_2_1_tests/6.2.27 |
594188 ns/iter (± 1413) |
84377 ns/iter (± 142) |
7.04 |
csaf_2_1_tests/6.2.28 |
590414 ns/iter (± 980) |
70880 ns/iter (± 512) |
8.33 |
csaf_2_1_tests/6.2.29 |
588267 ns/iter (± 388) |
72591 ns/iter (± 1399) |
8.10 |
csaf_2_1_tests/6.2.30 |
588067 ns/iter (± 858) |
71178 ns/iter (± 1852) |
8.26 |
csaf_2_1_tests/6.2.31 |
606738 ns/iter (± 834) |
84857 ns/iter (± 1063) |
7.15 |
csaf_2_1_tests/6.2.32 |
610566 ns/iter (± 656) |
86026 ns/iter (± 306) |
7.10 |
csaf_2_1_tests/6.2.33 |
799148 ns/iter (± 2228) |
244384 ns/iter (± 1667) |
3.27 |
csaf_2_1_tests/6.2.34 |
627857 ns/iter (± 3813) |
86687 ns/iter (± 174) |
7.24 |
csaf_2_1_tests/6.2.35 |
623936 ns/iter (± 693) |
87172 ns/iter (± 208) |
7.16 |
csaf_2_1_tests/6.2.36 |
629360 ns/iter (± 1047) |
88930 ns/iter (± 1032) |
7.08 |
csaf_2_1_tests/6.2.37 |
632842 ns/iter (± 4986) |
87951 ns/iter (± 101) |
7.20 |
csaf_2_1_tests/6.2.38 |
654239 ns/iter (± 739) |
97911 ns/iter (± 112) |
6.68 |
csaf_2_1_tests/6.2.39.1 |
425946 ns/iter (± 818) |
68821 ns/iter (± 139) |
6.19 |
csaf_2_1_tests/6.2.39.2 |
431940 ns/iter (± 11623) |
68776 ns/iter (± 88) |
6.28 |
csaf_2_1_tests/6.2.39.3 |
429034 ns/iter (± 847) |
68756 ns/iter (± 76) |
6.24 |
csaf_2_1_tests/6.2.39.4 |
431814 ns/iter (± 736) |
68749 ns/iter (± 62) |
6.28 |
csaf_2_1_tests/6.2.39.5 |
440406 ns/iter (± 564) |
68765 ns/iter (± 305) |
6.40 |
csaf_2_1_tests/6.2.40 |
646368 ns/iter (± 2903) |
88564 ns/iter (± 158) |
7.30 |
csaf_2_1_tests/6.2.41 |
773803 ns/iter (± 2565) |
200659 ns/iter (± 274) |
3.86 |
csaf_2_1_tests/6.2.42 |
655423 ns/iter (± 1350) |
89328 ns/iter (± 181) |
7.34 |
csaf_2_1_tests/6.2.43 |
655737 ns/iter (± 1608) |
89721 ns/iter (± 76) |
7.31 |
csaf_2_1_tests/6.2.44 |
660019 ns/iter (± 550) |
89975 ns/iter (± 573) |
7.34 |
csaf_2_1_tests/6.2.45 |
662558 ns/iter (± 2557) |
90444 ns/iter (± 157) |
7.33 |
csaf_2_1_tests/6.2.46 |
666274 ns/iter (± 3697) |
90852 ns/iter (± 188) |
7.33 |
csaf_2_1_tests/6.2.47 |
672400 ns/iter (± 906) |
91385 ns/iter (± 171) |
7.36 |
csaf_2_1_tests/6.2.48 |
759900 ns/iter (± 3014) |
171361 ns/iter (± 280) |
4.43 |
csaf_2_1_tests/6.2.49 |
678548 ns/iter (± 876) |
91929 ns/iter (± 102) |
7.38 |
csaf_2_1_tests/6.2.50.1 |
448536 ns/iter (± 616) |
68747 ns/iter (± 47) |
6.52 |
csaf_2_1_tests/6.2.50.2 |
443318 ns/iter (± 422) |
68725 ns/iter (± 39) |
6.45 |
csaf_2_1_tests/6.2.50.3 |
455070 ns/iter (± 6968) |
68804 ns/iter (± 70) |
6.61 |
csaf_2_1_tests/6.2.51 |
683002 ns/iter (± 1318) |
92457 ns/iter (± 439) |
7.39 |
csaf_2_1_tests/6.2.52 |
812123 ns/iter (± 6087) |
201955 ns/iter (± 1140) |
4.02 |
csaf_2_1_tests/6.2.53 |
683296 ns/iter (± 4799) |
82490 ns/iter (± 405) |
8.28 |
csaf_2_1_tests/6.2.54.1 |
451531 ns/iter (± 1096) |
68856 ns/iter (± 245) |
6.56 |
csaf_2_1_tests/6.2.54.2 |
456537 ns/iter (± 654) |
68776 ns/iter (± 210) |
6.64 |
csaf_2_1_tests/6.2.54.3 |
458274 ns/iter (± 573) |
68893 ns/iter (± 138) |
6.65 |
csaf_2_1_tests/6.2.54.4 |
459967 ns/iter (± 10596) |
68881 ns/iter (± 189) |
6.68 |
csaf_2_1_tests/6.3.1 |
449674 ns/iter (± 7043) |
71109 ns/iter (± 83) |
6.32 |
csaf_2_1_tests/6.3.2 |
497634 ns/iter (± 12824) |
98087 ns/iter (± 510) |
5.07 |
csaf_2_1_tests/6.3.3 |
453233 ns/iter (± 917) |
71102 ns/iter (± 2105) |
6.37 |
csaf_2_1_tests/6.3.4 |
456617 ns/iter (± 674) |
71659 ns/iter (± 401) |
6.37 |
csaf_2_1_tests/6.3.5 |
461404 ns/iter (± 665) |
70364 ns/iter (± 695) |
6.56 |
csaf_2_1_tests/6.3.6 |
464210 ns/iter (± 921) |
71408 ns/iter (± 114) |
6.50 |
csaf_2_1_tests/6.3.7 |
488935 ns/iter (± 12614) |
71622 ns/iter (± 316) |
6.83 |
csaf_2_1_tests/6.3.8 |
469889 ns/iter (± 26281) |
71824 ns/iter (± 281) |
6.54 |
csaf_2_1_tests/6.3.9 |
629675 ns/iter (± 1579) |
181676 ns/iter (± 987) |
3.47 |
csaf_2_1_tests/6.3.10 |
693938 ns/iter (± 1030) |
90508 ns/iter (± 1449) |
7.67 |
csaf_2_1_tests/6.3.11 |
696367 ns/iter (± 1183) |
93614 ns/iter (± 2562) |
7.44 |
csaf_2_1_tests/6.3.12 |
878048 ns/iter (± 1819) |
251241 ns/iter (± 5283) |
3.49 |
csaf_2_1_tests/6.3.13 |
697482 ns/iter (± 54655) |
91168 ns/iter (± 237) |
7.65 |
csaf_2_1_tests/6.3.14 |
707302 ns/iter (± 1271) |
91553 ns/iter (± 191) |
7.73 |
csaf_2_1_tests/6.3.15 |
710058 ns/iter (± 1456) |
91722 ns/iter (± 343) |
7.74 |
csaf_2_1_tests/6.3.16 |
716626 ns/iter (± 1755) |
92363 ns/iter (± 769) |
7.76 |
csaf_2_1_tests/6.3.17 |
717384 ns/iter (± 752) |
92315 ns/iter (± 573) |
7.77 |
csaf_2_1_tests/6.3.18 |
743804 ns/iter (± 5201) |
104802 ns/iter (± 173) |
7.10 |
csaf_2_1_tests/6.3.19.1 |
472331 ns/iter (± 18335) |
69060 ns/iter (± 516) |
6.84 |
csaf_2_1_tests/6.3.19.2 |
475701 ns/iter (± 5648) |
69061 ns/iter (± 598) |
6.89 |
csaf_2_1_tests/6.3.19.3 |
487819 ns/iter (± 16135) |
68833 ns/iter (± 452) |
7.09 |
csaf_2_1_tests/6.3.19.4 |
482958 ns/iter (± 24301) |
68950 ns/iter (± 234) |
7.00 |
csaf_2_1_tests/6.3.19.5 |
487648 ns/iter (± 736) |
68875 ns/iter (± 319) |
7.08 |
csaf_2_1_tests/6.3.20 |
747993 ns/iter (± 2819) |
100863 ns/iter (± 143) |
7.42 |
csaf_2_1_tests/6.3.21.1 |
487826 ns/iter (± 14393) |
69663 ns/iter (± 280) |
7.00 |
csaf_2_1_tests/6.3.21.2 |
495374 ns/iter (± 421) |
68800 ns/iter (± 80) |
7.20 |
csaf_2_1_tests/6.3.21.3 |
498049 ns/iter (± 838) |
69306 ns/iter (± 2974) |
7.19 |
csaf_2_1_tests/6.3.21.4 |
496513 ns/iter (± 663) |
68779 ns/iter (± 505) |
7.22 |
csaf_2_1_tests/6.3.21.5 |
504820 ns/iter (± 3701) |
68783 ns/iter (± 202) |
7.34 |
csaf_2_1_tests/6.3.21.6 |
503673 ns/iter (± 409) |
68785 ns/iter (± 172) |
7.32 |
csaf_2_1_tests/6.3.21.7 |
512863 ns/iter (± 6136) |
68853 ns/iter (± 261) |
7.45 |
csaf_2_1_tests/6.3.21.8 |
507843 ns/iter (± 7129) |
68766 ns/iter (± 2879) |
7.39 |
csaf_2_1_tests/6.3.21.9 |
510752 ns/iter (± 793) |
68805 ns/iter (± 629) |
7.42 |
csaf_2_1_tests/6.3.22 |
734072 ns/iter (± 1068) |
92793 ns/iter (± 251) |
7.91 |
full_validation/csaf_2_0_full_preset |
13932165 ns/iter (± 110945) |
7511390 ns/iter (± 132410) |
1.85 |
full_validation/csaf_2_1_full_preset |
137600792 ns/iter (± 431571) |
51867088 ns/iter (± 289727) |
2.65 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'CSAF Validation Benchmark'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.50.
| Benchmark suite | Current: 3ab6b83 | Previous: bbccec5 | Ratio |
|---|---|---|---|
csaf_2_0_tests/6.1.1 |
196627 ns/iter (± 391) |
127826 ns/iter (± 279) |
1.54 |
csaf_2_0_tests/6.1.2 |
112374 ns/iter (± 614) |
53197 ns/iter (± 63) |
2.11 |
csaf_2_0_tests/6.1.3 |
64158 ns/iter (± 77) |
12909 ns/iter (± 80) |
4.97 |
csaf_2_0_tests/6.1.4 |
82219 ns/iter (± 1889) |
27298 ns/iter (± 86) |
3.01 |
csaf_2_0_tests/6.1.5 |
67829 ns/iter (± 1573) |
14551 ns/iter (± 34) |
4.66 |
csaf_2_0_tests/6.1.6 |
97668 ns/iter (± 9202) |
38385 ns/iter (± 49) |
2.54 |
csaf_2_0_tests/6.1.7 |
89769 ns/iter (± 1605) |
34563 ns/iter (± 51) |
2.60 |
csaf_2_0_tests/6.1.8 |
146455 ns/iter (± 1531) |
86232 ns/iter (± 115) |
1.70 |
csaf_2_0_tests/6.1.9 |
141091 ns/iter (± 263) |
84357 ns/iter (± 2748) |
1.67 |
csaf_2_0_tests/6.1.11 |
71492 ns/iter (± 139) |
14475 ns/iter (± 207) |
4.94 |
csaf_2_0_tests/6.1.12 |
84192 ns/iter (± 212) |
30034 ns/iter (± 188) |
2.80 |
csaf_2_0_tests/6.1.13 |
92735 ns/iter (± 121) |
33254 ns/iter (± 38) |
2.79 |
csaf_2_0_tests/6.1.15 |
73607 ns/iter (± 322) |
12539 ns/iter (± 264) |
5.87 |
csaf_2_0_tests/6.1.16 |
110359 ns/iter (± 729) |
46056 ns/iter (± 121) |
2.40 |
csaf_2_0_tests/6.1.17 |
73568 ns/iter (± 134) |
13774 ns/iter (± 14) |
5.34 |
csaf_2_0_tests/6.1.18 |
76791 ns/iter (± 483) |
15848 ns/iter (± 336) |
4.85 |
csaf_2_0_tests/6.1.19 |
88572 ns/iter (± 249) |
15681 ns/iter (± 24) |
5.65 |
csaf_2_0_tests/6.1.20 |
74525 ns/iter (± 1201) |
13615 ns/iter (± 66) |
5.47 |
csaf_2_0_tests/6.1.21 |
116222 ns/iter (± 631) |
43934 ns/iter (± 365) |
2.65 |
csaf_2_0_tests/6.1.22 |
118513 ns/iter (± 1230) |
50276 ns/iter (± 109) |
2.36 |
csaf_2_0_tests/6.1.23 |
84203 ns/iter (± 1108) |
16143 ns/iter (± 22) |
5.22 |
csaf_2_0_tests/6.1.24 |
82812 ns/iter (± 213) |
17409 ns/iter (± 205) |
4.76 |
csaf_2_0_tests/6.1.25 |
107544 ns/iter (± 409) |
35731 ns/iter (± 184) |
3.01 |
csaf_2_0_tests/6.1.26 |
87864 ns/iter (± 1088) |
20303 ns/iter (± 72) |
4.33 |
csaf_2_0_tests/6.1.27.1 |
66975 ns/iter (± 82) |
13368 ns/iter (± 17) |
5.01 |
csaf_2_0_tests/6.1.27.2 |
67056 ns/iter (± 1353) |
13306 ns/iter (± 256) |
5.04 |
csaf_2_0_tests/6.1.27.3 |
68746 ns/iter (± 120) |
13221 ns/iter (± 33) |
5.20 |
csaf_2_0_tests/6.1.27.4 |
67801 ns/iter (± 67) |
13437 ns/iter (± 27) |
5.05 |
csaf_2_0_tests/6.1.27.5 |
74596 ns/iter (± 432) |
13972 ns/iter (± 22) |
5.34 |
csaf_2_0_tests/6.1.27.6 |
80864 ns/iter (± 789) |
12870 ns/iter (± 29) |
6.28 |
csaf_2_0_tests/6.1.27.7 |
76015 ns/iter (± 732) |
12758 ns/iter (± 29) |
5.96 |
csaf_2_0_tests/6.1.27.8 |
78930 ns/iter (± 104) |
12801 ns/iter (± 14) |
6.17 |
csaf_2_0_tests/6.1.27.9 |
86986 ns/iter (± 376) |
26952 ns/iter (± 1162) |
3.23 |
csaf_2_0_tests/6.1.27.10 |
67273 ns/iter (± 73) |
14081 ns/iter (± 94) |
4.78 |
csaf_2_0_tests/6.1.27.11 |
66777 ns/iter (± 409) |
13161 ns/iter (± 25) |
5.07 |
csaf_2_0_tests/6.1.28 |
92698 ns/iter (± 845) |
23846 ns/iter (± 267) |
3.89 |
csaf_2_0_tests/6.1.29 |
82202 ns/iter (± 80) |
13060 ns/iter (± 265) |
6.29 |
csaf_2_0_tests/6.1.30 |
123442 ns/iter (± 721) |
46567 ns/iter (± 54) |
2.65 |
csaf_2_0_tests/6.1.31 |
112087 ns/iter (± 1003) |
34176 ns/iter (± 64) |
3.28 |
csaf_2_0_tests/6.1.32 |
86036 ns/iter (± 193) |
13115 ns/iter (± 22) |
6.56 |
csaf_2_0_tests/6.1.33 |
95278 ns/iter (± 382) |
20451 ns/iter (± 85) |
4.66 |
csaf_2_0_tests/6.2.1 |
242115 ns/iter (± 427) |
153000 ns/iter (± 1824) |
1.58 |
csaf_2_0_tests/6.2.2 |
86641 ns/iter (± 54) |
21803 ns/iter (± 75) |
3.97 |
csaf_2_0_tests/6.2.3 |
87965 ns/iter (± 771) |
20914 ns/iter (± 75) |
4.21 |
csaf_2_0_tests/6.2.4 |
85479 ns/iter (± 104) |
20490 ns/iter (± 36) |
4.17 |
csaf_2_0_tests/6.2.5 |
129309 ns/iter (± 773) |
58027 ns/iter (± 151) |
2.23 |
csaf_2_0_tests/6.2.6 |
127535 ns/iter (± 354) |
58466 ns/iter (± 125) |
2.18 |
csaf_2_0_tests/6.2.7 |
85289 ns/iter (± 102) |
17678 ns/iter (± 87) |
4.82 |
csaf_2_0_tests/6.2.8 |
114226 ns/iter (± 460) |
37769 ns/iter (± 187) |
3.02 |
csaf_2_0_tests/6.2.9 |
111500 ns/iter (± 1615) |
37555 ns/iter (± 49) |
2.97 |
csaf_2_0_tests/6.2.10 |
110807 ns/iter (± 3633) |
28358 ns/iter (± 35) |
3.91 |
csaf_2_0_tests/6.2.11 |
250625 ns/iter (± 11205) |
152187 ns/iter (± 196) |
1.65 |
csaf_2_0_tests/6.2.12 |
115558 ns/iter (± 318) |
35583 ns/iter (± 274) |
3.25 |
csaf_2_0_tests/6.2.14 |
126242 ns/iter (± 183) |
46334 ns/iter (± 803) |
2.72 |
csaf_2_0_tests/6.2.15 |
119685 ns/iter (± 156) |
37532 ns/iter (± 1202) |
3.19 |
csaf_2_0_tests/6.2.16 |
133895 ns/iter (± 243) |
46339 ns/iter (± 132) |
2.89 |
csaf_2_0_tests/6.2.17 |
109192 ns/iter (± 379) |
18431 ns/iter (± 26) |
5.92 |
csaf_2_0_tests/6.2.18 |
115097 ns/iter (± 445) |
29444 ns/iter (± 103) |
3.91 |
csaf_2_0_tests/6.2.19 |
108090 ns/iter (± 200) |
21163 ns/iter (± 29) |
5.11 |
csaf_2_0_tests/6.3.1 |
109332 ns/iter (± 227) |
43404 ns/iter (± 113) |
2.52 |
csaf_2_0_tests/6.3.2 |
95603 ns/iter (± 113) |
28188 ns/iter (± 58) |
3.39 |
csaf_2_0_tests/6.3.3 |
97575 ns/iter (± 710) |
28264 ns/iter (± 34) |
3.45 |
csaf_2_0_tests/6.3.4 |
100768 ns/iter (± 475) |
30986 ns/iter (± 59) |
3.25 |
csaf_2_0_tests/6.3.5 |
118747 ns/iter (± 496) |
43210 ns/iter (± 78) |
2.75 |
csaf_2_0_tests/6.3.6 |
89342 ns/iter (± 131) |
20546 ns/iter (± 24) |
4.35 |
csaf_2_0_tests/6.3.7 |
89865 ns/iter (± 133) |
20344 ns/iter (± 38) |
4.42 |
csaf_2_0_tests/6.3.8 |
91195 ns/iter (± 201) |
20643 ns/iter (± 46) |
4.42 |
csaf_2_0_tests/6.3.9 |
111880 ns/iter (± 1018) |
36408 ns/iter (± 140) |
3.07 |
csaf_2_0_tests/6.3.10 |
116118 ns/iter (± 315) |
32706 ns/iter (± 70) |
3.55 |
csaf_2_0_tests/6.3.11 |
127288 ns/iter (± 310) |
34187 ns/iter (± 88) |
3.72 |
csaf_2_1_tests/6.1.1 |
917271 ns/iter (± 3816) |
584114 ns/iter (± 1592) |
1.57 |
csaf_2_1_tests/6.1.2 |
570031 ns/iter (± 5283) |
244935 ns/iter (± 574) |
2.33 |
csaf_2_1_tests/6.1.3 |
368628 ns/iter (± 7396) |
66894 ns/iter (± 250) |
5.51 |
csaf_2_1_tests/6.1.4 |
424589 ns/iter (± 4770) |
110357 ns/iter (± 216) |
3.85 |
csaf_2_1_tests/6.1.5 |
338823 ns/iter (± 373) |
47107 ns/iter (± 212) |
7.19 |
csaf_2_1_tests/6.1.6 |
432428 ns/iter (± 3905) |
111728 ns/iter (± 437) |
3.87 |
csaf_2_1_tests/6.1.7 |
380359 ns/iter (± 747) |
71679 ns/iter (± 402) |
5.31 |
csaf_2_1_tests/6.1.8 |
385201 ns/iter (± 1334) |
71615 ns/iter (± 99) |
5.38 |
csaf_2_1_tests/6.1.9 |
896170 ns/iter (± 1346) |
562740 ns/iter (± 1165) |
1.59 |
csaf_2_1_tests/6.1.11 |
383636 ns/iter (± 752) |
81689 ns/iter (± 104) |
4.70 |
csaf_2_1_tests/6.1.12 |
376567 ns/iter (± 574) |
85409 ns/iter (± 2186) |
4.41 |
csaf_2_1_tests/6.1.13 |
514871 ns/iter (± 1234) |
188829 ns/iter (± 1269) |
2.73 |
csaf_2_1_tests/6.1.15 |
346775 ns/iter (± 1147) |
41331 ns/iter (± 145) |
8.39 |
csaf_2_1_tests/6.1.16 |
484764 ns/iter (± 3211) |
159921 ns/iter (± 236) |
3.03 |
csaf_2_1_tests/6.1.17 |
359317 ns/iter (± 725) |
46260 ns/iter (± 91) |
7.77 |
csaf_2_1_tests/6.1.18 |
355299 ns/iter (± 1680) |
54604 ns/iter (± 210) |
6.51 |
csaf_2_1_tests/6.1.19 |
349132 ns/iter (± 1292) |
52343 ns/iter (± 315) |
6.67 |
csaf_2_1_tests/6.1.20 |
354072 ns/iter (± 539) |
46179 ns/iter (± 123) |
7.67 |
csaf_2_1_tests/6.1.21 |
506868 ns/iter (± 2762) |
147318 ns/iter (± 249) |
3.44 |
csaf_2_1_tests/6.1.22 |
504872 ns/iter (± 1281) |
146785 ns/iter (± 380) |
3.44 |
csaf_2_1_tests/6.1.23 |
395606 ns/iter (± 2877) |
52409 ns/iter (± 89) |
7.55 |
csaf_2_1_tests/6.1.24 |
393265 ns/iter (± 539) |
57758 ns/iter (± 332) |
6.81 |
csaf_2_1_tests/6.1.25 |
535460 ns/iter (± 1479) |
160324 ns/iter (± 575) |
3.34 |
csaf_2_1_tests/6.1.26 |
425063 ns/iter (± 5181) |
72163 ns/iter (± 295) |
5.89 |
csaf_2_1_tests/6.1.27.1 |
336139 ns/iter (± 1086) |
45616 ns/iter (± 94) |
7.37 |
csaf_2_1_tests/6.1.27.2 |
338268 ns/iter (± 767) |
45610 ns/iter (± 105) |
7.42 |
csaf_2_1_tests/6.1.27.3 |
349304 ns/iter (± 1387) |
46683 ns/iter (± 43) |
7.48 |
csaf_2_1_tests/6.1.27.4 |
336561 ns/iter (± 774) |
47215 ns/iter (± 163) |
7.13 |
csaf_2_1_tests/6.1.27.5 |
337598 ns/iter (± 946) |
50716 ns/iter (± 158) |
6.66 |
csaf_2_1_tests/6.1.27.6 |
338151 ns/iter (± 1308) |
43638 ns/iter (± 145) |
7.75 |
csaf_2_1_tests/6.1.27.7 |
331569 ns/iter (± 498) |
44336 ns/iter (± 84) |
7.48 |
csaf_2_1_tests/6.1.27.8 |
350841 ns/iter (± 544) |
43539 ns/iter (± 107) |
8.06 |
csaf_2_1_tests/6.1.27.9 |
387011 ns/iter (± 5933) |
58094 ns/iter (± 699) |
6.66 |
csaf_2_1_tests/6.1.27.10 |
322157 ns/iter (± 922) |
44195 ns/iter (± 928) |
7.29 |
csaf_2_1_tests/6.1.27.11 |
331286 ns/iter (± 930) |
46873 ns/iter (± 51) |
7.07 |
csaf_2_1_tests/6.1.27.12 |
328551 ns/iter (± 576) |
43617 ns/iter (± 40) |
7.53 |
csaf_2_1_tests/6.1.27.13 |
353628 ns/iter (± 564) |
67189 ns/iter (± 74) |
5.26 |
csaf_2_1_tests/6.1.27.14 |
348560 ns/iter (± 2649) |
47155 ns/iter (± 194) |
7.39 |
csaf_2_1_tests/6.1.27.15 |
368003 ns/iter (± 525) |
47506 ns/iter (± 210) |
7.75 |
csaf_2_1_tests/6.1.27.16 |
374373 ns/iter (± 830) |
47099 ns/iter (± 127) |
7.95 |
csaf_2_1_tests/6.1.27.17 |
382334 ns/iter (± 654) |
50475 ns/iter (± 99) |
7.57 |
csaf_2_1_tests/6.1.27.18 |
386800 ns/iter (± 710) |
53403 ns/iter (± 296) |
7.24 |
csaf_2_1_tests/6.1.27.19 |
391841 ns/iter (± 454) |
52813 ns/iter (± 60) |
7.42 |
csaf_2_1_tests/6.1.28 |
424664 ns/iter (± 3776) |
69353 ns/iter (± 522) |
6.12 |
csaf_2_1_tests/6.1.29 |
401510 ns/iter (± 865) |
46308 ns/iter (± 271) |
8.67 |
csaf_2_1_tests/6.1.30 |
544462 ns/iter (± 1139) |
160790 ns/iter (± 1794) |
3.39 |
csaf_2_1_tests/6.1.31 |
552139 ns/iter (± 601) |
154290 ns/iter (± 246) |
3.58 |
csaf_2_1_tests/6.1.32 |
418298 ns/iter (± 625) |
46568 ns/iter (± 43) |
8.98 |
csaf_2_1_tests/6.1.33 |
446752 ns/iter (± 4239) |
86398 ns/iter (± 202) |
5.17 |
csaf_2_1_tests/6.1.34 |
413686 ns/iter (± 1882) |
58059 ns/iter (± 306) |
7.13 |
csaf_2_1_tests/6.1.35 |
485388 ns/iter (± 2880) |
79078 ns/iter (± 78) |
6.14 |
csaf_2_1_tests/6.1.36 |
487321 ns/iter (± 908) |
86937 ns/iter (± 266) |
5.61 |
csaf_2_1_tests/6.1.37 |
476698 ns/iter (± 466) |
88122 ns/iter (± 233) |
5.41 |
csaf_2_1_tests/6.1.38 |
433290 ns/iter (± 305) |
46102 ns/iter (± 151) |
9.40 |
csaf_2_1_tests/6.1.39 |
436123 ns/iter (± 1280) |
46529 ns/iter (± 319) |
9.37 |
csaf_2_1_tests/6.1.40 |
458535 ns/iter (± 660) |
46644 ns/iter (± 77) |
9.83 |
csaf_2_1_tests/6.1.41 |
460158 ns/iter (± 538) |
47241 ns/iter (± 50) |
9.74 |
csaf_2_1_tests/6.1.42 |
649705 ns/iter (± 2335) |
200619 ns/iter (± 512) |
3.24 |
csaf_2_1_tests/6.1.43 |
618779 ns/iter (± 654) |
164088 ns/iter (± 263) |
3.77 |
csaf_2_1_tests/6.1.44 |
620233 ns/iter (± 1511) |
163859 ns/iter (± 1622) |
3.79 |
csaf_2_1_tests/6.1.45 |
611217 ns/iter (± 39131) |
160740 ns/iter (± 287) |
3.80 |
csaf_2_1_tests/6.1.46 |
735121 ns/iter (± 2389) |
280097 ns/iter (± 640) |
2.62 |
csaf_2_1_tests/6.1.47 |
943709 ns/iter (± 8868) |
514366 ns/iter (± 1080) |
1.83 |
csaf_2_1_tests/6.1.48 |
509705 ns/iter (± 1189) |
91541 ns/iter (± 2797) |
5.57 |
csaf_2_1_tests/6.1.49 |
513420 ns/iter (± 888) |
92307 ns/iter (± 259) |
5.56 |
csaf_2_1_tests/6.1.50 |
518586 ns/iter (± 2770) |
90594 ns/iter (± 209) |
5.72 |
csaf_2_1_tests/6.1.51 |
615320 ns/iter (± 3203) |
167093 ns/iter (± 539) |
3.68 |
csaf_2_1_tests/6.1.52 |
624207 ns/iter (± 4119) |
171618 ns/iter (± 440) |
3.64 |
csaf_2_1_tests/6.1.53 |
494107 ns/iter (± 1544) |
57045 ns/iter (± 789) |
8.66 |
csaf_2_1_tests/6.1.54 |
499321 ns/iter (± 2480) |
63184 ns/iter (± 144) |
7.90 |
csaf_2_1_tests/6.1.55 |
500702 ns/iter (± 2525) |
64188 ns/iter (± 106) |
7.80 |
csaf_2_1_tests/6.1.56 |
547472 ns/iter (± 1313) |
97401 ns/iter (± 451) |
5.62 |
csaf_2_1_tests/6.1.57 |
580194 ns/iter (± 13014) |
125792 ns/iter (± 587) |
4.61 |
csaf_2_1_tests/6.1.58 |
556566 ns/iter (± 2864) |
88494 ns/iter (± 883) |
6.29 |
csaf_2_1_tests/6.1.59 |
554169 ns/iter (± 1308) |
94658 ns/iter (± 188) |
5.85 |
csaf_2_1_tests/6.1.60.1 |
404443 ns/iter (± 505) |
69435 ns/iter (± 1050) |
5.82 |
csaf_2_1_tests/6.1.60.2 |
407456 ns/iter (± 667) |
69339 ns/iter (± 104) |
5.88 |
csaf_2_1_tests/6.1.60.3 |
409518 ns/iter (± 837) |
68804 ns/iter (± 104) |
5.95 |
csaf_2_1_tests/6.1.61 |
642875 ns/iter (± 25919) |
165925 ns/iter (± 834) |
3.87 |
csaf_2_1_tests/6.2.1 |
1079527 ns/iter (± 3132) |
658257 ns/iter (± 4492) |
1.64 |
csaf_2_1_tests/6.2.2 |
422804 ns/iter (± 746) |
80349 ns/iter (± 383) |
5.26 |
csaf_2_1_tests/6.2.3 |
419940 ns/iter (± 1124) |
76926 ns/iter (± 315) |
5.46 |
csaf_2_1_tests/6.2.4 |
421058 ns/iter (± 675) |
69185 ns/iter (± 273) |
6.09 |
csaf_2_1_tests/6.2.5 |
583156 ns/iter (± 1457) |
210223 ns/iter (± 637) |
2.77 |
csaf_2_1_tests/6.2.6 |
591504 ns/iter (± 2596) |
213901 ns/iter (± 471) |
2.77 |
csaf_2_1_tests/6.2.7 |
420001 ns/iter (± 414) |
60711 ns/iter (± 116) |
6.92 |
csaf_2_1_tests/6.2.8 |
557249 ns/iter (± 1019) |
171603 ns/iter (± 265) |
3.25 |
csaf_2_1_tests/6.2.9 |
569730 ns/iter (± 1206) |
173226 ns/iter (± 712) |
3.29 |
csaf_2_1_tests/6.2.11 |
1046793 ns/iter (± 1083) |
537938 ns/iter (± 1115) |
1.95 |
csaf_2_1_tests/6.2.12 |
597983 ns/iter (± 629) |
125636 ns/iter (± 148) |
4.76 |
csaf_2_1_tests/6.2.14 |
600062 ns/iter (± 1197) |
126898 ns/iter (± 1345) |
4.73 |
csaf_2_1_tests/6.2.15 |
582586 ns/iter (± 973) |
108148 ns/iter (± 282) |
5.39 |
csaf_2_1_tests/6.2.16 |
726840 ns/iter (± 4086) |
222743 ns/iter (± 945) |
3.26 |
csaf_2_1_tests/6.2.17 |
553241 ns/iter (± 1051) |
70441 ns/iter (± 585) |
7.85 |
csaf_2_1_tests/6.2.18 |
659401 ns/iter (± 1278) |
155318 ns/iter (± 238) |
4.25 |
csaf_2_1_tests/6.2.19 |
572480 ns/iter (± 369) |
82723 ns/iter (± 208) |
6.92 |
csaf_2_1_tests/6.2.21 |
894320 ns/iter (± 8738) |
352467 ns/iter (± 958) |
2.54 |
csaf_2_1_tests/6.2.22 |
726090 ns/iter (± 219324) |
168513 ns/iter (± 533) |
4.31 |
csaf_2_1_tests/6.2.23 |
591223 ns/iter (± 2901) |
83482 ns/iter (± 107) |
7.08 |
csaf_2_1_tests/6.2.24 |
590984 ns/iter (± 1479) |
83735 ns/iter (± 97) |
7.06 |
csaf_2_1_tests/6.2.25 |
597480 ns/iter (± 1121) |
85141 ns/iter (± 212) |
7.02 |
csaf_2_1_tests/6.2.26 |
600330 ns/iter (± 719) |
84258 ns/iter (± 175) |
7.12 |
csaf_2_1_tests/6.2.27 |
603727 ns/iter (± 977) |
84377 ns/iter (± 142) |
7.16 |
csaf_2_1_tests/6.2.28 |
589438 ns/iter (± 2077) |
70880 ns/iter (± 512) |
8.32 |
csaf_2_1_tests/6.2.29 |
595091 ns/iter (± 1691) |
72591 ns/iter (± 1399) |
8.20 |
csaf_2_1_tests/6.2.30 |
595340 ns/iter (± 4525) |
71178 ns/iter (± 1852) |
8.36 |
csaf_2_1_tests/6.2.31 |
614286 ns/iter (± 4940) |
84857 ns/iter (± 1063) |
7.24 |
csaf_2_1_tests/6.2.32 |
618072 ns/iter (± 1070) |
86026 ns/iter (± 306) |
7.18 |
csaf_2_1_tests/6.2.33 |
810479 ns/iter (± 6201) |
244384 ns/iter (± 1667) |
3.32 |
csaf_2_1_tests/6.2.34 |
631052 ns/iter (± 943) |
86687 ns/iter (± 174) |
7.28 |
csaf_2_1_tests/6.2.35 |
625556 ns/iter (± 662) |
87172 ns/iter (± 208) |
7.18 |
csaf_2_1_tests/6.2.36 |
638890 ns/iter (± 4527) |
88930 ns/iter (± 1032) |
7.18 |
csaf_2_1_tests/6.2.37 |
631370 ns/iter (± 814) |
87951 ns/iter (± 101) |
7.18 |
csaf_2_1_tests/6.2.38 |
667742 ns/iter (± 742) |
97911 ns/iter (± 112) |
6.82 |
csaf_2_1_tests/6.2.39.1 |
433259 ns/iter (± 728) |
68821 ns/iter (± 139) |
6.30 |
csaf_2_1_tests/6.2.39.2 |
431668 ns/iter (± 496) |
68776 ns/iter (± 88) |
6.28 |
csaf_2_1_tests/6.2.39.3 |
431428 ns/iter (± 663) |
68756 ns/iter (± 76) |
6.27 |
csaf_2_1_tests/6.2.39.4 |
434139 ns/iter (± 1253) |
68749 ns/iter (± 62) |
6.31 |
csaf_2_1_tests/6.2.39.5 |
443780 ns/iter (± 5103) |
68765 ns/iter (± 305) |
6.45 |
csaf_2_1_tests/6.2.40 |
654059 ns/iter (± 1358) |
88564 ns/iter (± 158) |
7.39 |
csaf_2_1_tests/6.2.41 |
787707 ns/iter (± 3743) |
200659 ns/iter (± 274) |
3.93 |
csaf_2_1_tests/6.2.42 |
663087 ns/iter (± 2238) |
89328 ns/iter (± 181) |
7.42 |
csaf_2_1_tests/6.2.43 |
667852 ns/iter (± 2015) |
89721 ns/iter (± 76) |
7.44 |
csaf_2_1_tests/6.2.44 |
669951 ns/iter (± 2752) |
89975 ns/iter (± 573) |
7.45 |
csaf_2_1_tests/6.2.45 |
672313 ns/iter (± 2127) |
90444 ns/iter (± 157) |
7.43 |
csaf_2_1_tests/6.2.46 |
676287 ns/iter (± 2178) |
90852 ns/iter (± 188) |
7.44 |
csaf_2_1_tests/6.2.47 |
680395 ns/iter (± 1553) |
91385 ns/iter (± 171) |
7.45 |
csaf_2_1_tests/6.2.48 |
770258 ns/iter (± 4003) |
171361 ns/iter (± 280) |
4.49 |
csaf_2_1_tests/6.2.49 |
686791 ns/iter (± 1612) |
91929 ns/iter (± 102) |
7.47 |
csaf_2_1_tests/6.2.50.1 |
445661 ns/iter (± 530) |
68747 ns/iter (± 47) |
6.48 |
csaf_2_1_tests/6.2.50.2 |
447343 ns/iter (± 1131) |
68725 ns/iter (± 39) |
6.51 |
csaf_2_1_tests/6.2.50.3 |
453635 ns/iter (± 777) |
68804 ns/iter (± 70) |
6.59 |
csaf_2_1_tests/6.2.51 |
692356 ns/iter (± 989) |
92457 ns/iter (± 439) |
7.49 |
csaf_2_1_tests/6.2.52 |
819600 ns/iter (± 1763) |
201955 ns/iter (± 1140) |
4.06 |
csaf_2_1_tests/6.2.53 |
685266 ns/iter (± 1347) |
82490 ns/iter (± 405) |
8.31 |
csaf_2_1_tests/6.2.54.1 |
454646 ns/iter (± 1186) |
68856 ns/iter (± 245) |
6.60 |
csaf_2_1_tests/6.2.54.2 |
457745 ns/iter (± 825) |
68776 ns/iter (± 210) |
6.66 |
csaf_2_1_tests/6.2.54.3 |
461301 ns/iter (± 14725) |
68893 ns/iter (± 138) |
6.70 |
csaf_2_1_tests/6.2.54.4 |
464799 ns/iter (± 3201) |
68881 ns/iter (± 189) |
6.75 |
csaf_2_1_tests/6.3.1 |
451467 ns/iter (± 1084) |
71109 ns/iter (± 83) |
6.35 |
csaf_2_1_tests/6.3.2 |
503080 ns/iter (± 1442) |
98087 ns/iter (± 510) |
5.13 |
csaf_2_1_tests/6.3.3 |
457752 ns/iter (± 13718) |
71102 ns/iter (± 2105) |
6.44 |
csaf_2_1_tests/6.3.4 |
462709 ns/iter (± 1747) |
71659 ns/iter (± 401) |
6.46 |
csaf_2_1_tests/6.3.5 |
464360 ns/iter (± 709) |
70364 ns/iter (± 695) |
6.60 |
csaf_2_1_tests/6.3.6 |
469873 ns/iter (± 765) |
71408 ns/iter (± 114) |
6.58 |
csaf_2_1_tests/6.3.7 |
473190 ns/iter (± 544) |
71622 ns/iter (± 316) |
6.61 |
csaf_2_1_tests/6.3.8 |
480257 ns/iter (± 1049) |
71824 ns/iter (± 281) |
6.69 |
csaf_2_1_tests/6.3.9 |
629230 ns/iter (± 1193) |
181676 ns/iter (± 987) |
3.46 |
csaf_2_1_tests/6.3.10 |
703904 ns/iter (± 1371) |
90508 ns/iter (± 1449) |
7.78 |
csaf_2_1_tests/6.3.11 |
705609 ns/iter (± 1926) |
93614 ns/iter (± 2562) |
7.54 |
csaf_2_1_tests/6.3.12 |
887645 ns/iter (± 1942) |
251241 ns/iter (± 5283) |
3.53 |
csaf_2_1_tests/6.3.13 |
709416 ns/iter (± 617) |
91168 ns/iter (± 237) |
7.78 |
csaf_2_1_tests/6.3.14 |
717040 ns/iter (± 748) |
91553 ns/iter (± 191) |
7.83 |
csaf_2_1_tests/6.3.15 |
718860 ns/iter (± 962) |
91722 ns/iter (± 343) |
7.84 |
csaf_2_1_tests/6.3.16 |
726850 ns/iter (± 2699) |
92363 ns/iter (± 769) |
7.87 |
csaf_2_1_tests/6.3.17 |
725549 ns/iter (± 921) |
92315 ns/iter (± 573) |
7.86 |
csaf_2_1_tests/6.3.18 |
745014 ns/iter (± 795) |
104802 ns/iter (± 173) |
7.11 |
csaf_2_1_tests/6.3.19.1 |
472521 ns/iter (± 697) |
69060 ns/iter (± 516) |
6.84 |
csaf_2_1_tests/6.3.19.2 |
480889 ns/iter (± 3761) |
69061 ns/iter (± 598) |
6.96 |
csaf_2_1_tests/6.3.19.3 |
483993 ns/iter (± 660) |
68833 ns/iter (± 452) |
7.03 |
csaf_2_1_tests/6.3.19.4 |
482189 ns/iter (± 760) |
68950 ns/iter (± 234) |
6.99 |
csaf_2_1_tests/6.3.19.5 |
486848 ns/iter (± 796) |
68875 ns/iter (± 319) |
7.07 |
csaf_2_1_tests/6.3.20 |
748813 ns/iter (± 2681) |
100863 ns/iter (± 143) |
7.42 |
csaf_2_1_tests/6.3.21.1 |
489779 ns/iter (± 995) |
69663 ns/iter (± 280) |
7.03 |
csaf_2_1_tests/6.3.21.2 |
493583 ns/iter (± 1019) |
68800 ns/iter (± 80) |
7.17 |
csaf_2_1_tests/6.3.21.3 |
495965 ns/iter (± 2284) |
69306 ns/iter (± 2974) |
7.16 |
csaf_2_1_tests/6.3.21.4 |
497424 ns/iter (± 24694) |
68779 ns/iter (± 505) |
7.23 |
csaf_2_1_tests/6.3.21.5 |
503414 ns/iter (± 2952) |
68783 ns/iter (± 202) |
7.32 |
csaf_2_1_tests/6.3.21.6 |
506108 ns/iter (± 2100) |
68785 ns/iter (± 172) |
7.36 |
csaf_2_1_tests/6.3.21.7 |
510208 ns/iter (± 729) |
68853 ns/iter (± 261) |
7.41 |
csaf_2_1_tests/6.3.21.8 |
512681 ns/iter (± 1799) |
68766 ns/iter (± 2879) |
7.46 |
csaf_2_1_tests/6.3.21.9 |
513802 ns/iter (± 548) |
68805 ns/iter (± 629) |
7.47 |
csaf_2_1_tests/6.3.22 |
739880 ns/iter (± 494) |
92793 ns/iter (± 251) |
7.97 |
full_validation/csaf_2_0_full_preset |
14330751 ns/iter (± 100196) |
7511390 ns/iter (± 132410) |
1.91 |
full_validation/csaf_2_1_full_preset |
109136140 ns/iter (± 11352543) |
51867088 ns/iter (± 289727) |
2.10 |
This comment was automatically generated by workflow using github-action-benchmark.
tziemek
force-pushed
the
feat/rust-service
branch
from
3ab6b83 to
e1c0c9f
Compare
There was a problem hiding this comment.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'CSAF Validation Benchmark'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.50.
| Benchmark suite | Current: e1c0c9f | Previous: 957d3f5 | Ratio |
|---|---|---|---|
csaf_2_0_tests/6.1.15 |
18102 ns/iter (± 29) |
11431 ns/iter (± 307) |
1.58 |
csaf_2_0_tests/6.1.17 |
21002 ns/iter (± 120) |
12954 ns/iter (± 16) |
1.62 |
csaf_2_0_tests/6.1.18 |
23775 ns/iter (± 25) |
15144 ns/iter (± 429) |
1.57 |
csaf_2_0_tests/6.1.19 |
24430 ns/iter (± 20) |
15320 ns/iter (± 11) |
1.59 |
csaf_2_0_tests/6.1.20 |
23162 ns/iter (± 107) |
12986 ns/iter (± 192) |
1.78 |
csaf_2_0_tests/6.1.23 |
29292 ns/iter (± 412) |
15416 ns/iter (± 48) |
1.90 |
csaf_2_0_tests/6.1.24 |
31766 ns/iter (± 808) |
16287 ns/iter (± 20) |
1.95 |
csaf_2_0_tests/6.1.26 |
36910 ns/iter (± 61) |
19797 ns/iter (± 20) |
1.86 |
csaf_2_0_tests/6.1.27.2 |
17872 ns/iter (± 20) |
11623 ns/iter (± 23) |
1.54 |
csaf_2_0_tests/6.1.27.3 |
18621 ns/iter (± 37) |
11416 ns/iter (± 108) |
1.63 |
csaf_2_0_tests/6.1.27.4 |
19335 ns/iter (± 52) |
11775 ns/iter (± 12) |
1.64 |
csaf_2_0_tests/6.1.27.5 |
21294 ns/iter (± 52) |
12689 ns/iter (± 93) |
1.68 |
csaf_2_0_tests/6.1.27.6 |
20896 ns/iter (± 410) |
11867 ns/iter (± 16) |
1.76 |
csaf_2_0_tests/6.1.27.7 |
21511 ns/iter (± 59) |
11053 ns/iter (± 82) |
1.95 |
csaf_2_0_tests/6.1.27.8 |
22474 ns/iter (± 49) |
11346 ns/iter (± 17) |
1.98 |
csaf_2_0_tests/6.1.27.11 |
17463 ns/iter (± 16) |
11516 ns/iter (± 47) |
1.52 |
csaf_2_0_tests/6.1.28 |
40645 ns/iter (± 238) |
23221 ns/iter (± 26) |
1.75 |
csaf_2_0_tests/6.1.29 |
31078 ns/iter (± 132) |
12915 ns/iter (± 38) |
2.41 |
csaf_2_0_tests/6.1.30 |
66391 ns/iter (± 186) |
44147 ns/iter (± 169) |
1.50 |
csaf_2_0_tests/6.1.32 |
33838 ns/iter (± 61) |
12973 ns/iter (± 38) |
2.61 |
csaf_2_0_tests/6.1.33 |
42964 ns/iter (± 35) |
19661 ns/iter (± 28) |
2.19 |
csaf_2_0_tests/6.2.2 |
33450 ns/iter (± 505) |
19292 ns/iter (± 157) |
1.73 |
csaf_2_0_tests/6.2.3 |
32612 ns/iter (± 88) |
18474 ns/iter (± 31) |
1.77 |
csaf_2_0_tests/6.2.4 |
31828 ns/iter (± 128) |
18352 ns/iter (± 38) |
1.73 |
csaf_2_0_tests/6.2.7 |
29272 ns/iter (± 102) |
15337 ns/iter (± 16) |
1.91 |
csaf_2_0_tests/6.2.10 |
49661 ns/iter (± 79) |
25574 ns/iter (± 49) |
1.94 |
csaf_2_0_tests/6.2.12 |
56968 ns/iter (± 53) |
33824 ns/iter (± 105) |
1.68 |
csaf_2_0_tests/6.2.14 |
66117 ns/iter (± 92) |
44025 ns/iter (± 64) |
1.50 |
csaf_2_0_tests/6.2.15 |
59647 ns/iter (± 934) |
34610 ns/iter (± 585) |
1.72 |
csaf_2_0_tests/6.2.16 |
68671 ns/iter (± 102) |
45122 ns/iter (± 224) |
1.52 |
csaf_2_0_tests/6.2.17 |
39870 ns/iter (± 77) |
16647 ns/iter (± 71) |
2.40 |
csaf_2_0_tests/6.2.18 |
51858 ns/iter (± 111) |
28779 ns/iter (± 56) |
1.80 |
csaf_2_0_tests/6.2.19 |
43111 ns/iter (± 46) |
19386 ns/iter (± 26) |
2.22 |
csaf_2_0_tests/6.3.2 |
40749 ns/iter (± 73) |
26467 ns/iter (± 82) |
1.54 |
csaf_2_0_tests/6.3.3 |
40992 ns/iter (± 289) |
25853 ns/iter (± 1036) |
1.59 |
csaf_2_0_tests/6.3.4 |
44037 ns/iter (± 116) |
29346 ns/iter (± 856) |
1.50 |
csaf_2_0_tests/6.3.6 |
32245 ns/iter (± 86) |
17772 ns/iter (± 108) |
1.81 |
csaf_2_0_tests/6.3.7 |
32412 ns/iter (± 90) |
17824 ns/iter (± 56) |
1.82 |
csaf_2_0_tests/6.3.8 |
32601 ns/iter (± 89) |
17832 ns/iter (± 31) |
1.83 |
csaf_2_0_tests/6.3.10 |
54900 ns/iter (± 139) |
32763 ns/iter (± 51) |
1.68 |
csaf_2_0_tests/6.3.11 |
56795 ns/iter (± 237) |
34056 ns/iter (± 119) |
1.67 |
csaf_2_1_tests/6.1.5 |
60981 ns/iter (± 115) |
39861 ns/iter (± 47) |
1.53 |
csaf_2_1_tests/6.1.15 |
63071 ns/iter (± 407) |
35077 ns/iter (± 61) |
1.80 |
csaf_2_1_tests/6.1.17 |
73408 ns/iter (± 268) |
40000 ns/iter (± 45) |
1.84 |
csaf_2_1_tests/6.1.18 |
83117 ns/iter (± 200) |
44885 ns/iter (± 77) |
1.85 |
csaf_2_1_tests/6.1.19 |
84221 ns/iter (± 204) |
44541 ns/iter (± 124) |
1.89 |
csaf_2_1_tests/6.1.20 |
81507 ns/iter (± 146) |
42090 ns/iter (± 138) |
1.94 |
csaf_2_1_tests/6.1.21 |
190879 ns/iter (± 309) |
125557 ns/iter (± 6139) |
1.52 |
csaf_2_1_tests/6.1.23 |
97600 ns/iter (± 332) |
47987 ns/iter (± 115) |
2.03 |
csaf_2_1_tests/6.1.24 |
105890 ns/iter (± 176) |
44730 ns/iter (± 74) |
2.37 |
csaf_2_1_tests/6.1.26 |
124207 ns/iter (± 4810) |
66068 ns/iter (± 102) |
1.88 |
csaf_2_1_tests/6.1.27.2 |
62082 ns/iter (± 666) |
38916 ns/iter (± 89) |
1.60 |
csaf_2_1_tests/6.1.27.3 |
65243 ns/iter (± 262) |
39728 ns/iter (± 76) |
1.64 |
csaf_2_1_tests/6.1.27.4 |
68504 ns/iter (± 140) |
41068 ns/iter (± 54) |
1.67 |
csaf_2_1_tests/6.1.27.5 |
72579 ns/iter (± 119) |
41916 ns/iter (± 62) |
1.73 |
csaf_2_1_tests/6.1.27.6 |
74385 ns/iter (± 172) |
41647 ns/iter (± 41) |
1.79 |
csaf_2_1_tests/6.1.27.7 |
74044 ns/iter (± 91) |
37181 ns/iter (± 210) |
1.99 |
csaf_2_1_tests/6.1.27.8 |
78959 ns/iter (± 228) |
37575 ns/iter (± 106) |
2.10 |
csaf_2_1_tests/6.1.27.9 |
94574 ns/iter (± 211) |
51747 ns/iter (± 261) |
1.83 |
csaf_2_1_tests/6.1.27.10 |
61860 ns/iter (± 104) |
37539 ns/iter (± 322) |
1.65 |
csaf_2_1_tests/6.1.27.11 |
62137 ns/iter (± 187) |
40046 ns/iter (± 62) |
1.55 |
csaf_2_1_tests/6.1.27.12 |
67161 ns/iter (± 76) |
40938 ns/iter (± 61) |
1.64 |
csaf_2_1_tests/6.1.27.13 |
91097 ns/iter (± 164) |
59132 ns/iter (± 268) |
1.54 |
csaf_2_1_tests/6.1.27.14 |
73119 ns/iter (± 126) |
41066 ns/iter (± 71) |
1.78 |
csaf_2_1_tests/6.1.27.15 |
76273 ns/iter (± 123) |
41186 ns/iter (± 78) |
1.85 |
csaf_2_1_tests/6.1.27.16 |
79693 ns/iter (± 1480) |
40663 ns/iter (± 43) |
1.96 |
csaf_2_1_tests/6.1.27.17 |
86408 ns/iter (± 141) |
44325 ns/iter (± 56) |
1.95 |
csaf_2_1_tests/6.1.27.18 |
91979 ns/iter (± 248) |
47640 ns/iter (± 98) |
1.93 |
csaf_2_1_tests/6.1.27.19 |
93557 ns/iter (± 318) |
46268 ns/iter (± 52) |
2.02 |
csaf_2_1_tests/6.1.28 |
129069 ns/iter (± 313) |
63398 ns/iter (± 273) |
2.04 |
csaf_2_1_tests/6.1.29 |
109633 ns/iter (± 867) |
41294 ns/iter (± 508) |
2.65 |
csaf_2_1_tests/6.1.30 |
226874 ns/iter (± 3771) |
133124 ns/iter (± 1105) |
1.70 |
csaf_2_1_tests/6.1.31 |
238362 ns/iter (± 1320) |
156703 ns/iter (± 1298) |
1.52 |
csaf_2_1_tests/6.1.32 |
120081 ns/iter (± 2971) |
43770 ns/iter (± 38) |
2.74 |
csaf_2_1_tests/6.1.33 |
155926 ns/iter (± 191) |
82424 ns/iter (± 158) |
1.89 |
csaf_2_1_tests/6.1.34 |
136641 ns/iter (± 1174) |
53388 ns/iter (± 103) |
2.56 |
csaf_2_1_tests/6.1.35 |
165141 ns/iter (± 974) |
71828 ns/iter (± 839) |
2.30 |
csaf_2_1_tests/6.1.36 |
164619 ns/iter (± 221) |
82681 ns/iter (± 456) |
1.99 |
csaf_2_1_tests/6.1.37 |
168076 ns/iter (± 203) |
83027 ns/iter (± 154) |
2.02 |
csaf_2_1_tests/6.1.38 |
133689 ns/iter (± 161) |
41016 ns/iter (± 62) |
3.26 |
csaf_2_1_tests/6.1.39 |
137446 ns/iter (± 358) |
41579 ns/iter (± 119) |
3.31 |
csaf_2_1_tests/6.1.40 |
139414 ns/iter (± 234) |
41408 ns/iter (± 75) |
3.37 |
csaf_2_1_tests/6.1.41 |
142665 ns/iter (± 115) |
42017 ns/iter (± 225) |
3.40 |
csaf_2_1_tests/6.1.42 |
309859 ns/iter (± 702) |
196526 ns/iter (± 313) |
1.58 |
csaf_2_1_tests/6.1.43 |
277200 ns/iter (± 1008) |
163625 ns/iter (± 358) |
1.69 |
csaf_2_1_tests/6.1.44 |
276928 ns/iter (± 981) |
160864 ns/iter (± 1430) |
1.72 |
csaf_2_1_tests/6.1.45 |
270416 ns/iter (± 526) |
134980 ns/iter (± 124) |
2.00 |
csaf_2_1_tests/6.1.48 |
201503 ns/iter (± 203) |
87020 ns/iter (± 117) |
2.32 |
csaf_2_1_tests/6.1.49 |
204566 ns/iter (± 215) |
87296 ns/iter (± 106) |
2.34 |
csaf_2_1_tests/6.1.50 |
207782 ns/iter (± 195) |
87878 ns/iter (± 2038) |
2.36 |
csaf_2_1_tests/6.1.51 |
295307 ns/iter (± 2934) |
140025 ns/iter (± 255) |
2.11 |
csaf_2_1_tests/6.1.52 |
306458 ns/iter (± 1821) |
142089 ns/iter (± 195) |
2.16 |
csaf_2_1_tests/6.1.53 |
198738 ns/iter (± 2179) |
50824 ns/iter (± 428) |
3.91 |
csaf_2_1_tests/6.1.54 |
204917 ns/iter (± 501) |
62810 ns/iter (± 48) |
3.26 |
csaf_2_1_tests/6.1.55 |
209543 ns/iter (± 570) |
58678 ns/iter (± 77) |
3.57 |
csaf_2_1_tests/6.1.56 |
240177 ns/iter (± 297) |
87711 ns/iter (± 268) |
2.74 |
csaf_2_1_tests/6.1.57 |
271050 ns/iter (± 604) |
124265 ns/iter (± 144) |
2.18 |
csaf_2_1_tests/6.1.58 |
241243 ns/iter (± 438) |
87899 ns/iter (± 91) |
2.74 |
csaf_2_1_tests/6.1.59 |
238598 ns/iter (± 3355) |
91962 ns/iter (± 108) |
2.59 |
csaf_2_1_tests/6.1.60.1 |
122410 ns/iter (± 4257) |
59912 ns/iter (± 85) |
2.04 |
csaf_2_1_tests/6.1.60.2 |
123963 ns/iter (± 384) |
60213 ns/iter (± 142) |
2.06 |
csaf_2_1_tests/6.1.60.3 |
126761 ns/iter (± 181) |
59925 ns/iter (± 440) |
2.12 |
csaf_2_1_tests/6.1.61 |
340726 ns/iter (± 2440) |
168769 ns/iter (± 152) |
2.02 |
csaf_2_1_tests/6.2.2 |
139465 ns/iter (± 178) |
69678 ns/iter (± 1974) |
2.00 |
csaf_2_1_tests/6.2.3 |
138697 ns/iter (± 267) |
67101 ns/iter (± 59) |
2.07 |
csaf_2_1_tests/6.2.4 |
133641 ns/iter (± 551) |
62173 ns/iter (± 372) |
2.15 |
csaf_2_1_tests/6.2.5 |
279208 ns/iter (± 396) |
178047 ns/iter (± 347) |
1.57 |
csaf_2_1_tests/6.2.6 |
287494 ns/iter (± 423) |
177783 ns/iter (± 2126) |
1.62 |
csaf_2_1_tests/6.2.7 |
137105 ns/iter (± 2568) |
54349 ns/iter (± 55) |
2.52 |
csaf_2_1_tests/6.2.8 |
255052 ns/iter (± 2890) |
168359 ns/iter (± 470) |
1.51 |
csaf_2_1_tests/6.2.9 |
256122 ns/iter (± 539) |
167993 ns/iter (± 538) |
1.52 |
csaf_2_1_tests/6.2.11 |
725676 ns/iter (± 1315) |
478489 ns/iter (± 1289) |
1.52 |
csaf_2_1_tests/6.2.12 |
300966 ns/iter (± 1294) |
125990 ns/iter (± 1460) |
2.39 |
csaf_2_1_tests/6.2.14 |
301030 ns/iter (± 610) |
124785 ns/iter (± 154) |
2.41 |
csaf_2_1_tests/6.2.15 |
282950 ns/iter (± 3044) |
109164 ns/iter (± 84) |
2.59 |
csaf_2_1_tests/6.2.16 |
409723 ns/iter (± 740) |
214004 ns/iter (± 353) |
1.91 |
csaf_2_1_tests/6.2.17 |
250297 ns/iter (± 387) |
70497 ns/iter (± 437) |
3.55 |
csaf_2_1_tests/6.2.18 |
348259 ns/iter (± 1943) |
151603 ns/iter (± 128) |
2.30 |
csaf_2_1_tests/6.2.19 |
274258 ns/iter (± 851) |
81811 ns/iter (± 160) |
3.35 |
csaf_2_1_tests/6.2.21 |
572525 ns/iter (± 12342) |
314379 ns/iter (± 2648) |
1.82 |
csaf_2_1_tests/6.2.22 |
383793 ns/iter (± 22650) |
162289 ns/iter (± 91) |
2.36 |
csaf_2_1_tests/6.2.23 |
289340 ns/iter (± 2286) |
82890 ns/iter (± 113) |
3.49 |
csaf_2_1_tests/6.2.24 |
285729 ns/iter (± 1627) |
83082 ns/iter (± 155) |
3.44 |
csaf_2_1_tests/6.2.25 |
296578 ns/iter (± 315) |
83151 ns/iter (± 192) |
3.57 |
csaf_2_1_tests/6.2.26 |
300402 ns/iter (± 323) |
83476 ns/iter (± 89) |
3.60 |
csaf_2_1_tests/6.2.27 |
296597 ns/iter (± 3666) |
84273 ns/iter (± 120) |
3.52 |
csaf_2_1_tests/6.2.28 |
289791 ns/iter (± 4723) |
72344 ns/iter (± 123) |
4.01 |
csaf_2_1_tests/6.2.29 |
292535 ns/iter (± 462) |
72557 ns/iter (± 63) |
4.03 |
csaf_2_1_tests/6.2.30 |
305087 ns/iter (± 547) |
73628 ns/iter (± 203) |
4.14 |
csaf_2_1_tests/6.2.31 |
323510 ns/iter (± 453) |
91637 ns/iter (± 129) |
3.53 |
csaf_2_1_tests/6.2.32 |
329377 ns/iter (± 475) |
85808 ns/iter (± 125) |
3.84 |
csaf_2_1_tests/6.2.33 |
486553 ns/iter (± 570) |
204654 ns/iter (± 343) |
2.38 |
csaf_2_1_tests/6.2.34 |
330035 ns/iter (± 459) |
86787 ns/iter (± 134) |
3.80 |
csaf_2_1_tests/6.2.35 |
334253 ns/iter (± 724) |
87304 ns/iter (± 120) |
3.83 |
csaf_2_1_tests/6.2.36 |
324596 ns/iter (± 747) |
88345 ns/iter (± 1273) |
3.67 |
csaf_2_1_tests/6.2.37 |
339931 ns/iter (± 666) |
87494 ns/iter (± 132) |
3.89 |
csaf_2_1_tests/6.2.38 |
354909 ns/iter (± 4934) |
102031 ns/iter (± 159) |
3.48 |
csaf_2_1_tests/6.2.39.1 |
142307 ns/iter (± 324) |
59929 ns/iter (± 138) |
2.37 |
csaf_2_1_tests/6.2.39.2 |
144118 ns/iter (± 298) |
60139 ns/iter (± 371) |
2.40 |
csaf_2_1_tests/6.2.39.3 |
147205 ns/iter (± 2408) |
60094 ns/iter (± 120) |
2.45 |
csaf_2_1_tests/6.2.39.4 |
149764 ns/iter (± 900) |
60070 ns/iter (± 252) |
2.49 |
csaf_2_1_tests/6.2.39.5 |
151915 ns/iter (± 233) |
60120 ns/iter (± 82) |
2.53 |
csaf_2_1_tests/6.2.40 |
351577 ns/iter (± 529) |
88703 ns/iter (± 125) |
3.96 |
csaf_2_1_tests/6.2.41 |
474710 ns/iter (± 2012) |
170890 ns/iter (± 4907) |
2.78 |
csaf_2_1_tests/6.2.42 |
357377 ns/iter (± 521) |
88404 ns/iter (± 251) |
4.04 |
csaf_2_1_tests/6.2.43 |
378407 ns/iter (± 22239) |
93038 ns/iter (± 241) |
4.07 |
csaf_2_1_tests/6.2.44 |
382649 ns/iter (± 3624) |
88431 ns/iter (± 2481) |
4.33 |
csaf_2_1_tests/6.2.45 |
352094 ns/iter (± 529) |
88770 ns/iter (± 1288) |
3.97 |
csaf_2_1_tests/6.2.46 |
355048 ns/iter (± 696) |
89279 ns/iter (± 176) |
3.98 |
csaf_2_1_tests/6.2.47 |
362309 ns/iter (± 478) |
89426 ns/iter (± 112) |
4.05 |
csaf_2_1_tests/6.2.48 |
445622 ns/iter (± 1131) |
173610 ns/iter (± 192) |
2.57 |
csaf_2_1_tests/6.2.49 |
368093 ns/iter (± 4468) |
91491 ns/iter (± 169) |
4.02 |
csaf_2_1_tests/6.2.50.1 |
159994 ns/iter (± 629) |
60170 ns/iter (± 139) |
2.66 |
csaf_2_1_tests/6.2.50.2 |
161995 ns/iter (± 736) |
60085 ns/iter (± 135) |
2.70 |
csaf_2_1_tests/6.2.50.3 |
170171 ns/iter (± 347) |
59927 ns/iter (± 148) |
2.84 |
csaf_2_1_tests/6.2.51 |
372904 ns/iter (± 940) |
91881 ns/iter (± 183) |
4.06 |
csaf_2_1_tests/6.2.52 |
501715 ns/iter (± 1204) |
200033 ns/iter (± 252) |
2.51 |
csaf_2_1_tests/6.2.53 |
377188 ns/iter (± 781) |
82255 ns/iter (± 54) |
4.59 |
csaf_2_1_tests/6.2.54.1 |
168934 ns/iter (± 553) |
59933 ns/iter (± 80) |
2.82 |
csaf_2_1_tests/6.2.54.2 |
173652 ns/iter (± 6243) |
60121 ns/iter (± 76) |
2.89 |
csaf_2_1_tests/6.2.54.3 |
176124 ns/iter (± 586) |
59873 ns/iter (± 245) |
2.94 |
csaf_2_1_tests/6.2.54.4 |
180309 ns/iter (± 263) |
60490 ns/iter (± 148) |
2.98 |
csaf_2_1_tests/6.3.1 |
172167 ns/iter (± 528) |
63874 ns/iter (± 184) |
2.70 |
csaf_2_1_tests/6.3.2 |
202241 ns/iter (± 579) |
90943 ns/iter (± 296) |
2.22 |
csaf_2_1_tests/6.3.3 |
174994 ns/iter (± 2232) |
64338 ns/iter (± 107) |
2.72 |
csaf_2_1_tests/6.3.4 |
179123 ns/iter (± 1364) |
64481 ns/iter (± 162) |
2.78 |
csaf_2_1_tests/6.3.5 |
181903 ns/iter (± 592) |
64646 ns/iter (± 527) |
2.81 |
csaf_2_1_tests/6.3.6 |
196587 ns/iter (± 1132) |
64998 ns/iter (± 98) |
3.02 |
csaf_2_1_tests/6.3.7 |
189276 ns/iter (± 462) |
64896 ns/iter (± 101) |
2.92 |
csaf_2_1_tests/6.3.8 |
193153 ns/iter (± 475) |
65282 ns/iter (± 113) |
2.96 |
csaf_2_1_tests/6.3.9 |
314296 ns/iter (± 672) |
186583 ns/iter (± 274) |
1.68 |
csaf_2_1_tests/6.3.10 |
391022 ns/iter (± 871) |
90225 ns/iter (± 182) |
4.33 |
csaf_2_1_tests/6.3.11 |
383957 ns/iter (± 1395) |
90315 ns/iter (± 148) |
4.25 |
csaf_2_1_tests/6.3.12 |
555289 ns/iter (± 1548) |
228821 ns/iter (± 848) |
2.43 |
csaf_2_1_tests/6.3.13 |
389902 ns/iter (± 393) |
90861 ns/iter (± 690) |
4.29 |
csaf_2_1_tests/6.3.14 |
411778 ns/iter (± 882) |
91220 ns/iter (± 255) |
4.51 |
csaf_2_1_tests/6.3.15 |
404467 ns/iter (± 1654) |
91435 ns/iter (± 75) |
4.42 |
csaf_2_1_tests/6.3.16 |
418733 ns/iter (± 640) |
91475 ns/iter (± 186) |
4.58 |
csaf_2_1_tests/6.3.17 |
411448 ns/iter (± 466) |
91933 ns/iter (± 131) |
4.48 |
csaf_2_1_tests/6.3.18 |
434273 ns/iter (± 4704) |
113207 ns/iter (± 125) |
3.84 |
csaf_2_1_tests/6.3.19.1 |
187193 ns/iter (± 754) |
60107 ns/iter (± 105) |
3.11 |
csaf_2_1_tests/6.3.19.2 |
190835 ns/iter (± 320) |
60096 ns/iter (± 106) |
3.18 |
csaf_2_1_tests/6.3.19.3 |
194572 ns/iter (± 1331) |
60439 ns/iter (± 281) |
3.22 |
csaf_2_1_tests/6.3.19.4 |
196696 ns/iter (± 615) |
60092 ns/iter (± 796) |
3.27 |
csaf_2_1_tests/6.3.19.5 |
203487 ns/iter (± 452) |
60121 ns/iter (± 99) |
3.38 |
csaf_2_1_tests/6.3.20 |
425964 ns/iter (± 637) |
102843 ns/iter (± 2923) |
4.14 |
csaf_2_1_tests/6.3.21.1 |
201896 ns/iter (± 3107) |
60099 ns/iter (± 129) |
3.36 |
csaf_2_1_tests/6.3.21.2 |
223775 ns/iter (± 487) |
60003 ns/iter (± 165) |
3.73 |
csaf_2_1_tests/6.3.21.3 |
211436 ns/iter (± 231) |
59991 ns/iter (± 116) |
3.52 |
csaf_2_1_tests/6.3.21.4 |
213472 ns/iter (± 333) |
60063 ns/iter (± 128) |
3.55 |
csaf_2_1_tests/6.3.21.5 |
214041 ns/iter (± 1053) |
60104 ns/iter (± 780) |
3.56 |
csaf_2_1_tests/6.3.21.6 |
218810 ns/iter (± 516) |
59957 ns/iter (± 115) |
3.65 |
csaf_2_1_tests/6.3.21.7 |
224604 ns/iter (± 888) |
60107 ns/iter (± 148) |
3.74 |
csaf_2_1_tests/6.3.21.8 |
224708 ns/iter (± 704) |
59935 ns/iter (± 77) |
3.75 |
csaf_2_1_tests/6.3.21.9 |
227605 ns/iter (± 218) |
60076 ns/iter (± 78) |
3.79 |
csaf_2_1_tests/6.3.22 |
423178 ns/iter (± 555) |
92564 ns/iter (± 273) |
4.57 |
full_validation/csaf_2_1_full_preset |
75340120 ns/iter (± 3437457) |
47500227 ns/iter (± 97251) |
1.59 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'CSAF Validation Benchmark'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.50.
| Benchmark suite | Current: 82204c8 | Previous: 957d3f5 | Ratio |
|---|---|---|---|
csaf_2_0_tests/6.1.5 |
18794 ns/iter (± 44) |
12373 ns/iter (± 13) |
1.52 |
csaf_2_0_tests/6.1.15 |
18670 ns/iter (± 20) |
11431 ns/iter (± 307) |
1.63 |
csaf_2_0_tests/6.1.17 |
21617 ns/iter (± 61) |
12954 ns/iter (± 16) |
1.67 |
csaf_2_0_tests/6.1.18 |
24532 ns/iter (± 37) |
15144 ns/iter (± 429) |
1.62 |
csaf_2_0_tests/6.1.19 |
25055 ns/iter (± 93) |
15320 ns/iter (± 11) |
1.64 |
csaf_2_0_tests/6.1.20 |
23924 ns/iter (± 44) |
12986 ns/iter (± 192) |
1.84 |
csaf_2_0_tests/6.1.23 |
29057 ns/iter (± 103) |
15416 ns/iter (± 48) |
1.88 |
csaf_2_0_tests/6.1.24 |
31774 ns/iter (± 72) |
16287 ns/iter (± 20) |
1.95 |
csaf_2_0_tests/6.1.26 |
36539 ns/iter (± 87) |
19797 ns/iter (± 20) |
1.85 |
csaf_2_0_tests/6.1.27.2 |
18241 ns/iter (± 21) |
11623 ns/iter (± 23) |
1.57 |
csaf_2_0_tests/6.1.27.3 |
17920 ns/iter (± 97) |
11416 ns/iter (± 108) |
1.57 |
csaf_2_0_tests/6.1.27.4 |
19723 ns/iter (± 29) |
11775 ns/iter (± 12) |
1.67 |
csaf_2_0_tests/6.1.27.5 |
21683 ns/iter (± 26) |
12689 ns/iter (± 93) |
1.71 |
csaf_2_0_tests/6.1.27.6 |
21535 ns/iter (± 1720) |
11867 ns/iter (± 16) |
1.81 |
csaf_2_0_tests/6.1.27.7 |
21473 ns/iter (± 122) |
11053 ns/iter (± 82) |
1.94 |
csaf_2_0_tests/6.1.27.8 |
22638 ns/iter (± 1024) |
11346 ns/iter (± 17) |
2.00 |
csaf_2_0_tests/6.1.27.11 |
18665 ns/iter (± 28) |
11516 ns/iter (± 47) |
1.62 |
csaf_2_0_tests/6.1.28 |
40537 ns/iter (± 81) |
23221 ns/iter (± 26) |
1.75 |
csaf_2_0_tests/6.1.29 |
31307 ns/iter (± 332) |
12915 ns/iter (± 38) |
2.42 |
csaf_2_0_tests/6.1.31 |
57098 ns/iter (± 151) |
37318 ns/iter (± 497) |
1.53 |
csaf_2_0_tests/6.1.32 |
34083 ns/iter (± 41) |
12973 ns/iter (± 38) |
2.63 |
csaf_2_0_tests/6.1.33 |
43818 ns/iter (± 1178) |
19661 ns/iter (± 28) |
2.23 |
csaf_2_0_tests/6.2.2 |
33326 ns/iter (± 32) |
19292 ns/iter (± 157) |
1.73 |
csaf_2_0_tests/6.2.3 |
32509 ns/iter (± 108) |
18474 ns/iter (± 31) |
1.76 |
csaf_2_0_tests/6.2.4 |
31567 ns/iter (± 36) |
18352 ns/iter (± 38) |
1.72 |
csaf_2_0_tests/6.2.7 |
29342 ns/iter (± 54) |
15337 ns/iter (± 16) |
1.91 |
csaf_2_0_tests/6.2.10 |
49817 ns/iter (± 35) |
25574 ns/iter (± 49) |
1.95 |
csaf_2_0_tests/6.2.12 |
56773 ns/iter (± 350) |
33824 ns/iter (± 105) |
1.68 |
csaf_2_0_tests/6.2.14 |
67578 ns/iter (± 675) |
44025 ns/iter (± 64) |
1.53 |
csaf_2_0_tests/6.2.15 |
57602 ns/iter (± 350) |
34610 ns/iter (± 585) |
1.66 |
csaf_2_0_tests/6.2.17 |
40876 ns/iter (± 296) |
16647 ns/iter (± 71) |
2.46 |
csaf_2_0_tests/6.2.18 |
51415 ns/iter (± 180) |
28779 ns/iter (± 56) |
1.79 |
csaf_2_0_tests/6.2.19 |
43201 ns/iter (± 40) |
19386 ns/iter (± 26) |
2.23 |
csaf_2_0_tests/6.3.2 |
40015 ns/iter (± 304) |
26467 ns/iter (± 82) |
1.51 |
csaf_2_0_tests/6.3.3 |
40665 ns/iter (± 54) |
25853 ns/iter (± 1036) |
1.57 |
csaf_2_0_tests/6.3.6 |
32019 ns/iter (± 25) |
17772 ns/iter (± 108) |
1.80 |
csaf_2_0_tests/6.3.7 |
31756 ns/iter (± 60) |
17824 ns/iter (± 56) |
1.78 |
csaf_2_0_tests/6.3.8 |
32273 ns/iter (± 72) |
17832 ns/iter (± 31) |
1.81 |
csaf_2_0_tests/6.3.10 |
55336 ns/iter (± 58) |
32763 ns/iter (± 51) |
1.69 |
csaf_2_0_tests/6.3.11 |
56529 ns/iter (± 75) |
34056 ns/iter (± 119) |
1.66 |
csaf_2_1_tests/6.1.5 |
64303 ns/iter (± 204) |
39861 ns/iter (± 47) |
1.61 |
csaf_2_1_tests/6.1.8 |
100934 ns/iter (± 398) |
66616 ns/iter (± 359) |
1.52 |
csaf_2_1_tests/6.1.15 |
66199 ns/iter (± 207) |
35077 ns/iter (± 61) |
1.89 |
csaf_2_1_tests/6.1.16 |
199885 ns/iter (± 722) |
129312 ns/iter (± 131) |
1.55 |
csaf_2_1_tests/6.1.17 |
76779 ns/iter (± 221) |
40000 ns/iter (± 45) |
1.92 |
csaf_2_1_tests/6.1.18 |
87535 ns/iter (± 483) |
44885 ns/iter (± 77) |
1.95 |
csaf_2_1_tests/6.1.19 |
91445 ns/iter (± 955) |
44541 ns/iter (± 124) |
2.05 |
csaf_2_1_tests/6.1.20 |
86356 ns/iter (± 203) |
42090 ns/iter (± 138) |
2.05 |
csaf_2_1_tests/6.1.21 |
192353 ns/iter (± 377) |
125557 ns/iter (± 6139) |
1.53 |
csaf_2_1_tests/6.1.23 |
105128 ns/iter (± 1863) |
47987 ns/iter (± 115) |
2.19 |
csaf_2_1_tests/6.1.24 |
112001 ns/iter (± 155) |
44730 ns/iter (± 74) |
2.50 |
csaf_2_1_tests/6.1.26 |
132963 ns/iter (± 125) |
66068 ns/iter (± 102) |
2.01 |
csaf_2_1_tests/6.1.27.1 |
65098 ns/iter (± 928) |
40065 ns/iter (± 64) |
1.62 |
csaf_2_1_tests/6.1.27.2 |
68475 ns/iter (± 205) |
38916 ns/iter (± 89) |
1.76 |
csaf_2_1_tests/6.1.27.3 |
68619 ns/iter (± 124) |
39728 ns/iter (± 76) |
1.73 |
csaf_2_1_tests/6.1.27.4 |
75395 ns/iter (± 133) |
41068 ns/iter (± 54) |
1.84 |
csaf_2_1_tests/6.1.27.5 |
82767 ns/iter (± 65) |
41916 ns/iter (± 62) |
1.97 |
csaf_2_1_tests/6.1.27.6 |
81646 ns/iter (± 256) |
41647 ns/iter (± 41) |
1.96 |
csaf_2_1_tests/6.1.27.7 |
81805 ns/iter (± 224) |
37181 ns/iter (± 210) |
2.20 |
csaf_2_1_tests/6.1.27.8 |
85100 ns/iter (± 180) |
37575 ns/iter (± 106) |
2.26 |
csaf_2_1_tests/6.1.27.9 |
103527 ns/iter (± 211) |
51747 ns/iter (± 261) |
2.00 |
csaf_2_1_tests/6.1.27.10 |
68745 ns/iter (± 365) |
37539 ns/iter (± 322) |
1.83 |
csaf_2_1_tests/6.1.27.11 |
73704 ns/iter (± 137) |
40046 ns/iter (± 62) |
1.84 |
csaf_2_1_tests/6.1.27.12 |
75947 ns/iter (± 142) |
40938 ns/iter (± 61) |
1.86 |
csaf_2_1_tests/6.1.27.13 |
100787 ns/iter (± 139) |
59132 ns/iter (± 268) |
1.70 |
csaf_2_1_tests/6.1.27.14 |
82945 ns/iter (± 102) |
41066 ns/iter (± 71) |
2.02 |
csaf_2_1_tests/6.1.27.15 |
86498 ns/iter (± 271) |
41186 ns/iter (± 78) |
2.10 |
csaf_2_1_tests/6.1.27.16 |
89741 ns/iter (± 214) |
40663 ns/iter (± 43) |
2.21 |
csaf_2_1_tests/6.1.27.17 |
97452 ns/iter (± 284) |
44325 ns/iter (± 56) |
2.20 |
csaf_2_1_tests/6.1.27.18 |
102714 ns/iter (± 332) |
47640 ns/iter (± 98) |
2.16 |
csaf_2_1_tests/6.1.27.19 |
104989 ns/iter (± 603) |
46268 ns/iter (± 52) |
2.27 |
csaf_2_1_tests/6.1.28 |
139389 ns/iter (± 277) |
63398 ns/iter (± 273) |
2.20 |
csaf_2_1_tests/6.1.29 |
121976 ns/iter (± 389) |
41294 ns/iter (± 508) |
2.95 |
csaf_2_1_tests/6.1.30 |
240947 ns/iter (± 890) |
133124 ns/iter (± 1105) |
1.81 |
csaf_2_1_tests/6.1.31 |
251680 ns/iter (± 933) |
156703 ns/iter (± 1298) |
1.61 |
csaf_2_1_tests/6.1.32 |
130860 ns/iter (± 163) |
43770 ns/iter (± 38) |
2.99 |
csaf_2_1_tests/6.1.33 |
167703 ns/iter (± 655) |
82424 ns/iter (± 158) |
2.03 |
csaf_2_1_tests/6.1.34 |
149184 ns/iter (± 282) |
53388 ns/iter (± 103) |
2.79 |
csaf_2_1_tests/6.1.35 |
178988 ns/iter (± 450) |
71828 ns/iter (± 839) |
2.49 |
csaf_2_1_tests/6.1.36 |
178295 ns/iter (± 168) |
82681 ns/iter (± 456) |
2.16 |
csaf_2_1_tests/6.1.37 |
181669 ns/iter (± 1067) |
83027 ns/iter (± 154) |
2.19 |
csaf_2_1_tests/6.1.38 |
152103 ns/iter (± 3457) |
41016 ns/iter (± 62) |
3.71 |
csaf_2_1_tests/6.1.39 |
160424 ns/iter (± 4803) |
41579 ns/iter (± 119) |
3.86 |
csaf_2_1_tests/6.1.40 |
154141 ns/iter (± 627) |
41408 ns/iter (± 75) |
3.72 |
csaf_2_1_tests/6.1.41 |
158874 ns/iter (± 193) |
42017 ns/iter (± 225) |
3.78 |
csaf_2_1_tests/6.1.42 |
327035 ns/iter (± 445) |
196526 ns/iter (± 313) |
1.66 |
csaf_2_1_tests/6.1.43 |
280475 ns/iter (± 340) |
163625 ns/iter (± 358) |
1.71 |
csaf_2_1_tests/6.1.44 |
293309 ns/iter (± 355) |
160864 ns/iter (± 1430) |
1.82 |
csaf_2_1_tests/6.1.45 |
287005 ns/iter (± 905) |
134980 ns/iter (± 124) |
2.13 |
csaf_2_1_tests/6.1.46 |
426069 ns/iter (± 13247) |
274530 ns/iter (± 1699) |
1.55 |
csaf_2_1_tests/6.1.48 |
221712 ns/iter (± 278) |
87020 ns/iter (± 117) |
2.55 |
csaf_2_1_tests/6.1.49 |
224886 ns/iter (± 516) |
87296 ns/iter (± 106) |
2.58 |
csaf_2_1_tests/6.1.50 |
230401 ns/iter (± 982) |
87878 ns/iter (± 2038) |
2.62 |
csaf_2_1_tests/6.1.51 |
328041 ns/iter (± 1285) |
140025 ns/iter (± 255) |
2.34 |
csaf_2_1_tests/6.1.52 |
327770 ns/iter (± 1597) |
142089 ns/iter (± 195) |
2.31 |
csaf_2_1_tests/6.1.53 |
214114 ns/iter (± 571) |
50824 ns/iter (± 428) |
4.21 |
csaf_2_1_tests/6.1.54 |
225807 ns/iter (± 698) |
62810 ns/iter (± 48) |
3.60 |
csaf_2_1_tests/6.1.55 |
230120 ns/iter (± 724) |
58678 ns/iter (± 77) |
3.92 |
csaf_2_1_tests/6.1.56 |
267536 ns/iter (± 699) |
87711 ns/iter (± 268) |
3.05 |
csaf_2_1_tests/6.1.57 |
295524 ns/iter (± 2559) |
124265 ns/iter (± 144) |
2.38 |
csaf_2_1_tests/6.1.58 |
261273 ns/iter (± 1120) |
87899 ns/iter (± 91) |
2.97 |
csaf_2_1_tests/6.1.59 |
265720 ns/iter (± 2663) |
91962 ns/iter (± 108) |
2.89 |
csaf_2_1_tests/6.1.60.1 |
139971 ns/iter (± 539) |
59912 ns/iter (± 85) |
2.34 |
csaf_2_1_tests/6.1.60.2 |
142770 ns/iter (± 159) |
60213 ns/iter (± 142) |
2.37 |
csaf_2_1_tests/6.1.60.3 |
146146 ns/iter (± 742) |
59925 ns/iter (± 440) |
2.44 |
csaf_2_1_tests/6.1.61 |
350358 ns/iter (± 568) |
168769 ns/iter (± 152) |
2.08 |
csaf_2_1_tests/6.2.2 |
160345 ns/iter (± 250) |
69678 ns/iter (± 1974) |
2.30 |
csaf_2_1_tests/6.2.3 |
160988 ns/iter (± 329) |
67101 ns/iter (± 59) |
2.40 |
csaf_2_1_tests/6.2.4 |
156078 ns/iter (± 388) |
62173 ns/iter (± 372) |
2.51 |
csaf_2_1_tests/6.2.5 |
301556 ns/iter (± 1216) |
178047 ns/iter (± 347) |
1.69 |
csaf_2_1_tests/6.2.6 |
306612 ns/iter (± 710) |
177783 ns/iter (± 2126) |
1.72 |
csaf_2_1_tests/6.2.7 |
160825 ns/iter (± 182) |
54349 ns/iter (± 55) |
2.96 |
csaf_2_1_tests/6.2.8 |
277105 ns/iter (± 793) |
168359 ns/iter (± 470) |
1.65 |
csaf_2_1_tests/6.2.9 |
283074 ns/iter (± 902) |
167993 ns/iter (± 538) |
1.69 |
csaf_2_1_tests/6.2.11 |
738922 ns/iter (± 2144) |
478489 ns/iter (± 1289) |
1.54 |
csaf_2_1_tests/6.2.12 |
317035 ns/iter (± 940) |
125990 ns/iter (± 1460) |
2.52 |
csaf_2_1_tests/6.2.14 |
326109 ns/iter (± 1461) |
124785 ns/iter (± 154) |
2.61 |
csaf_2_1_tests/6.2.15 |
312605 ns/iter (± 1012) |
109164 ns/iter (± 84) |
2.86 |
csaf_2_1_tests/6.2.16 |
441007 ns/iter (± 902) |
214004 ns/iter (± 353) |
2.06 |
csaf_2_1_tests/6.2.17 |
278841 ns/iter (± 847) |
70497 ns/iter (± 437) |
3.96 |
csaf_2_1_tests/6.2.18 |
387319 ns/iter (± 936) |
151603 ns/iter (± 128) |
2.55 |
csaf_2_1_tests/6.2.19 |
299799 ns/iter (± 1900) |
81811 ns/iter (± 160) |
3.66 |
csaf_2_1_tests/6.2.21 |
584959 ns/iter (± 1909) |
314379 ns/iter (± 2648) |
1.86 |
csaf_2_1_tests/6.2.22 |
422224 ns/iter (± 2625) |
162289 ns/iter (± 91) |
2.60 |
csaf_2_1_tests/6.2.23 |
322948 ns/iter (± 1865) |
82890 ns/iter (± 113) |
3.90 |
csaf_2_1_tests/6.2.24 |
318471 ns/iter (± 4060) |
83082 ns/iter (± 155) |
3.83 |
csaf_2_1_tests/6.2.25 |
319694 ns/iter (± 393) |
83151 ns/iter (± 192) |
3.84 |
csaf_2_1_tests/6.2.26 |
331653 ns/iter (± 5020) |
83476 ns/iter (± 89) |
3.97 |
csaf_2_1_tests/6.2.27 |
327217 ns/iter (± 774) |
84273 ns/iter (± 120) |
3.88 |
csaf_2_1_tests/6.2.28 |
329050 ns/iter (± 2444) |
72344 ns/iter (± 123) |
4.55 |
csaf_2_1_tests/6.2.29 |
330916 ns/iter (± 1921) |
72557 ns/iter (± 63) |
4.56 |
csaf_2_1_tests/6.2.30 |
335814 ns/iter (± 12351) |
73628 ns/iter (± 203) |
4.56 |
csaf_2_1_tests/6.2.31 |
350964 ns/iter (± 3315) |
91637 ns/iter (± 129) |
3.83 |
csaf_2_1_tests/6.2.32 |
367288 ns/iter (± 354) |
85808 ns/iter (± 125) |
4.28 |
csaf_2_1_tests/6.2.33 |
525442 ns/iter (± 53384) |
204654 ns/iter (± 343) |
2.57 |
csaf_2_1_tests/6.2.34 |
346918 ns/iter (± 595) |
86787 ns/iter (± 134) |
4.00 |
csaf_2_1_tests/6.2.35 |
350148 ns/iter (± 375) |
87304 ns/iter (± 120) |
4.01 |
csaf_2_1_tests/6.2.36 |
352001 ns/iter (± 590) |
88345 ns/iter (± 1273) |
3.98 |
csaf_2_1_tests/6.2.37 |
363214 ns/iter (± 3241) |
87494 ns/iter (± 132) |
4.15 |
csaf_2_1_tests/6.2.38 |
388831 ns/iter (± 268) |
102031 ns/iter (± 159) |
3.81 |
csaf_2_1_tests/6.2.39.1 |
170049 ns/iter (± 210) |
59929 ns/iter (± 138) |
2.84 |
csaf_2_1_tests/6.2.39.2 |
172965 ns/iter (± 3896) |
60139 ns/iter (± 371) |
2.88 |
csaf_2_1_tests/6.2.39.3 |
176660 ns/iter (± 3294) |
60094 ns/iter (± 120) |
2.94 |
csaf_2_1_tests/6.2.39.4 |
179385 ns/iter (± 930) |
60070 ns/iter (± 252) |
2.99 |
csaf_2_1_tests/6.2.39.5 |
182322 ns/iter (± 1207) |
60120 ns/iter (± 82) |
3.03 |
csaf_2_1_tests/6.2.40 |
370202 ns/iter (± 1005) |
88703 ns/iter (± 125) |
4.17 |
csaf_2_1_tests/6.2.41 |
488419 ns/iter (± 742) |
170890 ns/iter (± 4907) |
2.86 |
csaf_2_1_tests/6.2.42 |
382155 ns/iter (± 548) |
88404 ns/iter (± 251) |
4.32 |
csaf_2_1_tests/6.2.43 |
381787 ns/iter (± 2953) |
93038 ns/iter (± 241) |
4.10 |
csaf_2_1_tests/6.2.44 |
384449 ns/iter (± 1227) |
88431 ns/iter (± 2481) |
4.35 |
csaf_2_1_tests/6.2.45 |
385442 ns/iter (± 678) |
88770 ns/iter (± 1288) |
4.34 |
csaf_2_1_tests/6.2.46 |
388281 ns/iter (± 775) |
89279 ns/iter (± 176) |
4.35 |
csaf_2_1_tests/6.2.47 |
390876 ns/iter (± 2195) |
89426 ns/iter (± 112) |
4.37 |
csaf_2_1_tests/6.2.48 |
479516 ns/iter (± 1323) |
173610 ns/iter (± 192) |
2.76 |
csaf_2_1_tests/6.2.49 |
398836 ns/iter (± 607) |
91491 ns/iter (± 169) |
4.36 |
csaf_2_1_tests/6.2.50.1 |
190270 ns/iter (± 2424) |
60170 ns/iter (± 139) |
3.16 |
csaf_2_1_tests/6.2.50.2 |
195218 ns/iter (± 941) |
60085 ns/iter (± 135) |
3.25 |
csaf_2_1_tests/6.2.50.3 |
198275 ns/iter (± 376) |
59927 ns/iter (± 148) |
3.31 |
csaf_2_1_tests/6.2.51 |
405760 ns/iter (± 541) |
91881 ns/iter (± 183) |
4.42 |
csaf_2_1_tests/6.2.52 |
552550 ns/iter (± 4319) |
200033 ns/iter (± 252) |
2.76 |
csaf_2_1_tests/6.2.53 |
414098 ns/iter (± 2815) |
82255 ns/iter (± 54) |
5.03 |
csaf_2_1_tests/6.2.54.1 |
204009 ns/iter (± 306) |
59933 ns/iter (± 80) |
3.40 |
csaf_2_1_tests/6.2.54.2 |
207633 ns/iter (± 236) |
60121 ns/iter (± 76) |
3.45 |
csaf_2_1_tests/6.2.54.3 |
209600 ns/iter (± 233) |
59873 ns/iter (± 245) |
3.50 |
csaf_2_1_tests/6.2.54.4 |
213804 ns/iter (± 489) |
60490 ns/iter (± 148) |
3.53 |
csaf_2_1_tests/6.3.1 |
207074 ns/iter (± 253) |
63874 ns/iter (± 184) |
3.24 |
csaf_2_1_tests/6.3.2 |
240502 ns/iter (± 441) |
90943 ns/iter (± 296) |
2.64 |
csaf_2_1_tests/6.3.3 |
218600 ns/iter (± 340) |
64338 ns/iter (± 107) |
3.40 |
csaf_2_1_tests/6.3.4 |
216601 ns/iter (± 191) |
64481 ns/iter (± 162) |
3.36 |
csaf_2_1_tests/6.3.5 |
219641 ns/iter (± 1088) |
64646 ns/iter (± 527) |
3.40 |
csaf_2_1_tests/6.3.6 |
221803 ns/iter (± 2800) |
64998 ns/iter (± 98) |
3.41 |
csaf_2_1_tests/6.3.7 |
226584 ns/iter (± 1374) |
64896 ns/iter (± 101) |
3.49 |
csaf_2_1_tests/6.3.8 |
230215 ns/iter (± 7805) |
65282 ns/iter (± 113) |
3.53 |
csaf_2_1_tests/6.3.9 |
345631 ns/iter (± 585) |
186583 ns/iter (± 274) |
1.85 |
csaf_2_1_tests/6.3.10 |
421344 ns/iter (± 1271) |
90225 ns/iter (± 182) |
4.67 |
csaf_2_1_tests/6.3.11 |
422962 ns/iter (± 479) |
90315 ns/iter (± 148) |
4.68 |
csaf_2_1_tests/6.3.12 |
584450 ns/iter (± 1040) |
228821 ns/iter (± 848) |
2.55 |
csaf_2_1_tests/6.3.13 |
429436 ns/iter (± 456) |
90861 ns/iter (± 690) |
4.73 |
csaf_2_1_tests/6.3.14 |
436344 ns/iter (± 1905) |
91220 ns/iter (± 255) |
4.78 |
csaf_2_1_tests/6.3.15 |
441891 ns/iter (± 439) |
91435 ns/iter (± 75) |
4.83 |
csaf_2_1_tests/6.3.16 |
444999 ns/iter (± 676) |
91475 ns/iter (± 186) |
4.86 |
csaf_2_1_tests/6.3.17 |
449257 ns/iter (± 695) |
91933 ns/iter (± 131) |
4.89 |
csaf_2_1_tests/6.3.18 |
469996 ns/iter (± 6634) |
113207 ns/iter (± 125) |
4.15 |
csaf_2_1_tests/6.3.19.1 |
227087 ns/iter (± 256) |
60107 ns/iter (± 105) |
3.78 |
csaf_2_1_tests/6.3.19.2 |
230371 ns/iter (± 318) |
60096 ns/iter (± 106) |
3.83 |
csaf_2_1_tests/6.3.19.3 |
244403 ns/iter (± 369) |
60439 ns/iter (± 281) |
4.04 |
csaf_2_1_tests/6.3.19.4 |
237133 ns/iter (± 379) |
60092 ns/iter (± 796) |
3.95 |
csaf_2_1_tests/6.3.19.5 |
241981 ns/iter (± 431) |
60121 ns/iter (± 99) |
4.02 |
csaf_2_1_tests/6.3.20 |
469142 ns/iter (± 658) |
102843 ns/iter (± 2923) |
4.56 |
csaf_2_1_tests/6.3.21.1 |
242996 ns/iter (± 254) |
60099 ns/iter (± 129) |
4.04 |
csaf_2_1_tests/6.3.21.2 |
246961 ns/iter (± 8164) |
60003 ns/iter (± 165) |
4.12 |
csaf_2_1_tests/6.3.21.3 |
250780 ns/iter (± 2088) |
59991 ns/iter (± 116) |
4.18 |
csaf_2_1_tests/6.3.21.4 |
251438 ns/iter (± 217) |
60063 ns/iter (± 128) |
4.19 |
csaf_2_1_tests/6.3.21.5 |
256148 ns/iter (± 360) |
60104 ns/iter (± 780) |
4.26 |
csaf_2_1_tests/6.3.21.6 |
262540 ns/iter (± 177) |
59957 ns/iter (± 115) |
4.38 |
csaf_2_1_tests/6.3.21.7 |
273475 ns/iter (± 1127) |
60107 ns/iter (± 148) |
4.55 |
csaf_2_1_tests/6.3.21.8 |
266232 ns/iter (± 412) |
59935 ns/iter (± 77) |
4.44 |
csaf_2_1_tests/6.3.21.9 |
273603 ns/iter (± 7746) |
60076 ns/iter (± 78) |
4.55 |
csaf_2_1_tests/6.3.22 |
468211 ns/iter (± 13763) |
92564 ns/iter (± 273) |
5.06 |
This comment was automatically generated by workflow using github-action-benchmark.
tziemek
force-pushed
the
feat/rust-service
branch
from
82204c8 to
9e7d677
Compare
There was a problem hiding this comment.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'CSAF Validation Benchmark'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.50.
| Benchmark suite | Current: a3552fa | Previous: b723aec | Ratio |
|---|---|---|---|
csaf_2_0_tests/6.1.17 |
22389 ns/iter (± 21) |
13949 ns/iter (± 14) |
1.61 |
csaf_2_0_tests/6.1.18 |
24217 ns/iter (± 17) |
15528 ns/iter (± 12) |
1.56 |
csaf_2_0_tests/6.1.19 |
25921 ns/iter (± 24) |
15363 ns/iter (± 18) |
1.69 |
csaf_2_0_tests/6.1.20 |
24939 ns/iter (± 1047) |
13590 ns/iter (± 481) |
1.84 |
csaf_2_0_tests/6.1.23 |
30158 ns/iter (± 134) |
16116 ns/iter (± 19) |
1.87 |
csaf_2_0_tests/6.1.24 |
30948 ns/iter (± 97) |
15849 ns/iter (± 38) |
1.95 |
csaf_2_0_tests/6.1.26 |
38319 ns/iter (± 49) |
20701 ns/iter (± 30) |
1.85 |
csaf_2_0_tests/6.1.27.5 |
21625 ns/iter (± 35) |
14400 ns/iter (± 22) |
1.50 |
csaf_2_0_tests/6.1.27.6 |
21928 ns/iter (± 14) |
13862 ns/iter (± 23) |
1.58 |
csaf_2_0_tests/6.1.27.7 |
21932 ns/iter (± 45) |
12739 ns/iter (± 268) |
1.72 |
csaf_2_0_tests/6.1.27.8 |
23523 ns/iter (± 43) |
13056 ns/iter (± 9) |
1.80 |
csaf_2_0_tests/6.1.28 |
43475 ns/iter (± 69) |
24653 ns/iter (± 81) |
1.76 |
csaf_2_0_tests/6.1.29 |
32693 ns/iter (± 22) |
12770 ns/iter (± 34) |
2.56 |
csaf_2_0_tests/6.1.31 |
57499 ns/iter (± 38) |
33684 ns/iter (± 68) |
1.71 |
csaf_2_0_tests/6.1.32 |
36452 ns/iter (± 70) |
12820 ns/iter (± 51) |
2.84 |
csaf_2_0_tests/6.1.33 |
46038 ns/iter (± 1070) |
19962 ns/iter (± 25) |
2.31 |
csaf_2_0_tests/6.2.2 |
33606 ns/iter (± 64) |
21563 ns/iter (± 731) |
1.56 |
csaf_2_0_tests/6.2.3 |
33095 ns/iter (± 2590) |
20553 ns/iter (± 147) |
1.61 |
csaf_2_0_tests/6.2.4 |
33868 ns/iter (± 70) |
20431 ns/iter (± 30) |
1.66 |
csaf_2_0_tests/6.2.7 |
30921 ns/iter (± 87) |
17565 ns/iter (± 54) |
1.76 |
csaf_2_0_tests/6.2.10 |
52511 ns/iter (± 53) |
28811 ns/iter (± 172) |
1.82 |
csaf_2_0_tests/6.2.12 |
59658 ns/iter (± 175) |
39208 ns/iter (± 39) |
1.52 |
csaf_2_0_tests/6.2.14 |
70309 ns/iter (± 154) |
46276 ns/iter (± 35) |
1.52 |
csaf_2_0_tests/6.2.15 |
61444 ns/iter (± 203) |
36413 ns/iter (± 67) |
1.69 |
csaf_2_0_tests/6.2.17 |
42297 ns/iter (± 72) |
18052 ns/iter (± 20) |
2.34 |
csaf_2_0_tests/6.2.18 |
53898 ns/iter (± 162) |
29025 ns/iter (± 48) |
1.86 |
csaf_2_0_tests/6.2.19 |
46368 ns/iter (± 254) |
21798 ns/iter (± 268) |
2.13 |
csaf_2_0_tests/6.3.6 |
33625 ns/iter (± 95) |
21051 ns/iter (± 165) |
1.60 |
csaf_2_0_tests/6.3.7 |
33340 ns/iter (± 152) |
20869 ns/iter (± 199) |
1.60 |
csaf_2_0_tests/6.3.8 |
33403 ns/iter (± 193) |
21591 ns/iter (± 259) |
1.55 |
csaf_2_0_tests/6.3.10 |
58342 ns/iter (± 161) |
32867 ns/iter (± 66) |
1.78 |
csaf_2_0_tests/6.3.11 |
59287 ns/iter (± 108) |
34254 ns/iter (± 28) |
1.73 |
csaf_2_1_tests/6.1.15 |
67142 ns/iter (± 172) |
43506 ns/iter (± 48) |
1.54 |
csaf_2_1_tests/6.1.17 |
79382 ns/iter (± 76) |
47050 ns/iter (± 110) |
1.69 |
csaf_2_1_tests/6.1.18 |
87977 ns/iter (± 508) |
51799 ns/iter (± 143) |
1.70 |
csaf_2_1_tests/6.1.19 |
91175 ns/iter (± 388) |
51128 ns/iter (± 90) |
1.78 |
csaf_2_1_tests/6.1.20 |
88011 ns/iter (± 82) |
46325 ns/iter (± 96) |
1.90 |
csaf_2_1_tests/6.1.23 |
103995 ns/iter (± 95) |
52473 ns/iter (± 52) |
1.98 |
csaf_2_1_tests/6.1.24 |
105020 ns/iter (± 76) |
49683 ns/iter (± 41) |
2.11 |
csaf_2_1_tests/6.1.26 |
138079 ns/iter (± 182) |
73106 ns/iter (± 155) |
1.89 |
csaf_2_1_tests/6.1.27.5 |
74863 ns/iter (± 163) |
49819 ns/iter (± 121) |
1.50 |
csaf_2_1_tests/6.1.27.6 |
78029 ns/iter (± 93) |
50524 ns/iter (± 184) |
1.54 |
csaf_2_1_tests/6.1.27.7 |
80117 ns/iter (± 1009) |
45662 ns/iter (± 156) |
1.75 |
csaf_2_1_tests/6.1.27.8 |
83187 ns/iter (± 810) |
46691 ns/iter (± 32) |
1.78 |
csaf_2_1_tests/6.1.27.9 |
108748 ns/iter (± 374) |
67684 ns/iter (± 103) |
1.61 |
csaf_2_1_tests/6.1.27.14 |
75293 ns/iter (± 89) |
48967 ns/iter (± 300) |
1.54 |
csaf_2_1_tests/6.1.27.15 |
80975 ns/iter (± 323) |
48649 ns/iter (± 55) |
1.66 |
csaf_2_1_tests/6.1.27.16 |
85416 ns/iter (± 269) |
48944 ns/iter (± 458) |
1.75 |
csaf_2_1_tests/6.1.27.17 |
88756 ns/iter (± 79) |
52002 ns/iter (± 52) |
1.71 |
csaf_2_1_tests/6.1.27.18 |
95876 ns/iter (± 208) |
54858 ns/iter (± 172) |
1.75 |
csaf_2_1_tests/6.1.27.19 |
100014 ns/iter (± 1450) |
54301 ns/iter (± 95) |
1.84 |
csaf_2_1_tests/6.1.28 |
138949 ns/iter (± 190) |
72058 ns/iter (± 76) |
1.93 |
csaf_2_1_tests/6.1.29 |
115115 ns/iter (± 237) |
45958 ns/iter (± 137) |
2.50 |
csaf_2_1_tests/6.1.31 |
246354 ns/iter (± 1873) |
159454 ns/iter (± 401) |
1.54 |
csaf_2_1_tests/6.1.32 |
125305 ns/iter (± 132) |
46086 ns/iter (± 112) |
2.72 |
csaf_2_1_tests/6.1.33 |
167541 ns/iter (± 200) |
87766 ns/iter (± 226) |
1.91 |
csaf_2_1_tests/6.1.34 |
147696 ns/iter (± 371) |
57229 ns/iter (± 374) |
2.58 |
csaf_2_1_tests/6.1.35 |
171045 ns/iter (± 457) |
77695 ns/iter (± 379) |
2.20 |
csaf_2_1_tests/6.1.36 |
177638 ns/iter (± 438) |
84289 ns/iter (± 384) |
2.11 |
csaf_2_1_tests/6.1.37 |
181676 ns/iter (± 661) |
84492 ns/iter (± 160) |
2.15 |
csaf_2_1_tests/6.1.38 |
148615 ns/iter (± 508) |
46384 ns/iter (± 43) |
3.20 |
csaf_2_1_tests/6.1.39 |
152414 ns/iter (± 97) |
46856 ns/iter (± 181) |
3.25 |
csaf_2_1_tests/6.1.40 |
155849 ns/iter (± 172) |
47389 ns/iter (± 37) |
3.29 |
csaf_2_1_tests/6.1.41 |
152185 ns/iter (± 708) |
46890 ns/iter (± 149) |
3.25 |
csaf_2_1_tests/6.1.42 |
316402 ns/iter (± 918) |
197882 ns/iter (± 205) |
1.60 |
csaf_2_1_tests/6.1.43 |
290366 ns/iter (± 370) |
168308 ns/iter (± 214) |
1.73 |
csaf_2_1_tests/6.1.44 |
295383 ns/iter (± 474) |
168616 ns/iter (± 403) |
1.75 |
csaf_2_1_tests/6.1.45 |
306181 ns/iter (± 1151) |
164307 ns/iter (± 586) |
1.86 |
csaf_2_1_tests/6.1.46 |
424607 ns/iter (± 948) |
269182 ns/iter (± 250) |
1.58 |
csaf_2_1_tests/6.1.48 |
222815 ns/iter (± 291) |
87292 ns/iter (± 77) |
2.55 |
csaf_2_1_tests/6.1.49 |
231155 ns/iter (± 890) |
87572 ns/iter (± 102) |
2.64 |
csaf_2_1_tests/6.1.50 |
234236 ns/iter (± 399) |
87752 ns/iter (± 128) |
2.67 |
csaf_2_1_tests/6.1.51 |
324172 ns/iter (± 392) |
170806 ns/iter (± 376) |
1.90 |
csaf_2_1_tests/6.1.52 |
329642 ns/iter (± 1773) |
175526 ns/iter (± 145) |
1.88 |
csaf_2_1_tests/6.1.53 |
206711 ns/iter (± 155) |
54651 ns/iter (± 82) |
3.78 |
csaf_2_1_tests/6.1.54 |
221258 ns/iter (± 171) |
63319 ns/iter (± 88) |
3.49 |
csaf_2_1_tests/6.1.55 |
228769 ns/iter (± 133) |
64151 ns/iter (± 77) |
3.57 |
csaf_2_1_tests/6.1.56 |
259696 ns/iter (± 361) |
95440 ns/iter (± 198) |
2.72 |
csaf_2_1_tests/6.1.57 |
305869 ns/iter (± 8871) |
136174 ns/iter (± 1009) |
2.25 |
csaf_2_1_tests/6.1.58 |
256627 ns/iter (± 8623) |
87032 ns/iter (± 999) |
2.95 |
csaf_2_1_tests/6.1.59 |
261552 ns/iter (± 4273) |
90185 ns/iter (± 110) |
2.90 |
csaf_2_1_tests/6.1.60.1 |
131842 ns/iter (± 2923) |
74629 ns/iter (± 918) |
1.77 |
csaf_2_1_tests/6.1.60.2 |
135047 ns/iter (± 411) |
76609 ns/iter (± 654) |
1.76 |
csaf_2_1_tests/6.1.60.3 |
133961 ns/iter (± 2745) |
73026 ns/iter (± 156) |
1.83 |
csaf_2_1_tests/6.1.61 |
350660 ns/iter (± 925) |
168337 ns/iter (± 270) |
2.08 |
csaf_2_1_tests/6.2.2 |
141813 ns/iter (± 463) |
79222 ns/iter (± 254) |
1.79 |
csaf_2_1_tests/6.2.3 |
142281 ns/iter (± 526) |
76631 ns/iter (± 193) |
1.86 |
csaf_2_1_tests/6.2.4 |
134656 ns/iter (± 486) |
66374 ns/iter (± 83) |
2.03 |
csaf_2_1_tests/6.2.7 |
142480 ns/iter (± 461) |
63063 ns/iter (± 145) |
2.26 |
csaf_2_1_tests/6.2.12 |
332628 ns/iter (± 1017) |
124412 ns/iter (± 168) |
2.67 |
csaf_2_1_tests/6.2.14 |
346267 ns/iter (± 474) |
126403 ns/iter (± 635) |
2.74 |
csaf_2_1_tests/6.2.15 |
333299 ns/iter (± 267) |
108757 ns/iter (± 90) |
3.06 |
csaf_2_1_tests/6.2.16 |
449941 ns/iter (± 794) |
219378 ns/iter (± 824) |
2.05 |
csaf_2_1_tests/6.2.17 |
289097 ns/iter (± 410) |
69998 ns/iter (± 112) |
4.13 |
csaf_2_1_tests/6.2.18 |
363058 ns/iter (± 615) |
151768 ns/iter (± 488) |
2.39 |
csaf_2_1_tests/6.2.19 |
293901 ns/iter (± 416) |
83528 ns/iter (± 139) |
3.52 |
csaf_2_1_tests/6.2.21 |
579748 ns/iter (± 6616) |
350545 ns/iter (± 576) |
1.65 |
csaf_2_1_tests/6.2.22 |
392970 ns/iter (± 394) |
163996 ns/iter (± 1063) |
2.40 |
csaf_2_1_tests/6.2.23 |
316945 ns/iter (± 819) |
83200 ns/iter (± 169) |
3.81 |
csaf_2_1_tests/6.2.24 |
315749 ns/iter (± 377) |
83462 ns/iter (± 57) |
3.78 |
csaf_2_1_tests/6.2.25 |
307279 ns/iter (± 8625) |
83944 ns/iter (± 595) |
3.66 |
csaf_2_1_tests/6.2.26 |
325659 ns/iter (± 1589) |
84170 ns/iter (± 582) |
3.87 |
csaf_2_1_tests/6.2.27 |
328797 ns/iter (± 1877) |
84162 ns/iter (± 121) |
3.91 |
csaf_2_1_tests/6.2.28 |
318300 ns/iter (± 5034) |
73430 ns/iter (± 263) |
4.33 |
csaf_2_1_tests/6.2.29 |
324858 ns/iter (± 2135) |
71173 ns/iter (± 299) |
4.56 |
csaf_2_1_tests/6.2.30 |
322343 ns/iter (± 3916) |
71643 ns/iter (± 313) |
4.50 |
csaf_2_1_tests/6.2.31 |
348089 ns/iter (± 2273) |
85412 ns/iter (± 124) |
4.08 |
csaf_2_1_tests/6.2.32 |
343803 ns/iter (± 631) |
85572 ns/iter (± 189) |
4.02 |
csaf_2_1_tests/6.2.33 |
497385 ns/iter (± 3177) |
231105 ns/iter (± 1035) |
2.15 |
csaf_2_1_tests/6.2.34 |
373345 ns/iter (± 553) |
85916 ns/iter (± 467) |
4.35 |
csaf_2_1_tests/6.2.35 |
358071 ns/iter (± 787) |
86168 ns/iter (± 131) |
4.16 |
csaf_2_1_tests/6.2.36 |
381338 ns/iter (± 489) |
86616 ns/iter (± 329) |
4.40 |
csaf_2_1_tests/6.2.37 |
365633 ns/iter (± 9514) |
86845 ns/iter (± 98) |
4.21 |
csaf_2_1_tests/6.2.38 |
402385 ns/iter (± 575) |
100298 ns/iter (± 184) |
4.01 |
csaf_2_1_tests/6.2.39.1 |
155566 ns/iter (± 336) |
75349 ns/iter (± 695) |
2.06 |
csaf_2_1_tests/6.2.39.2 |
158053 ns/iter (± 530) |
75728 ns/iter (± 150) |
2.09 |
csaf_2_1_tests/6.2.39.3 |
161284 ns/iter (± 675) |
75061 ns/iter (± 695) |
2.15 |
csaf_2_1_tests/6.2.39.4 |
163417 ns/iter (± 726) |
74700 ns/iter (± 177) |
2.19 |
csaf_2_1_tests/6.2.39.5 |
167630 ns/iter (± 593) |
75236 ns/iter (± 646) |
2.23 |
csaf_2_1_tests/6.2.40 |
369510 ns/iter (± 551) |
90499 ns/iter (± 208) |
4.08 |
csaf_2_1_tests/6.2.41 |
486651 ns/iter (± 745) |
196650 ns/iter (± 466) |
2.47 |
csaf_2_1_tests/6.2.42 |
357118 ns/iter (± 9345) |
87777 ns/iter (± 178) |
4.07 |
csaf_2_1_tests/6.2.43 |
385571 ns/iter (± 2078) |
88032 ns/iter (± 92) |
4.38 |
csaf_2_1_tests/6.2.44 |
368481 ns/iter (± 1872) |
88331 ns/iter (± 90) |
4.17 |
csaf_2_1_tests/6.2.45 |
390667 ns/iter (± 442) |
88712 ns/iter (± 200) |
4.40 |
csaf_2_1_tests/6.2.46 |
398069 ns/iter (± 807) |
88829 ns/iter (± 239) |
4.48 |
csaf_2_1_tests/6.2.47 |
402787 ns/iter (± 7108) |
89007 ns/iter (± 144) |
4.53 |
csaf_2_1_tests/6.2.48 |
490034 ns/iter (± 1355) |
171995 ns/iter (± 725) |
2.85 |
csaf_2_1_tests/6.2.49 |
419923 ns/iter (± 944) |
89580 ns/iter (± 478) |
4.69 |
csaf_2_1_tests/6.2.50.1 |
174788 ns/iter (± 298) |
75207 ns/iter (± 600) |
2.32 |
csaf_2_1_tests/6.2.50.2 |
177290 ns/iter (± 259) |
75100 ns/iter (± 809) |
2.36 |
csaf_2_1_tests/6.2.50.3 |
183356 ns/iter (± 600) |
73370 ns/iter (± 549) |
2.50 |
csaf_2_1_tests/6.2.51 |
414687 ns/iter (± 669) |
89832 ns/iter (± 541) |
4.62 |
csaf_2_1_tests/6.2.52 |
537574 ns/iter (± 3006) |
200178 ns/iter (± 251) |
2.69 |
csaf_2_1_tests/6.2.53 |
436527 ns/iter (± 1215) |
80875 ns/iter (± 268) |
5.40 |
csaf_2_1_tests/6.2.54.1 |
187031 ns/iter (± 351) |
74046 ns/iter (± 253) |
2.53 |
csaf_2_1_tests/6.2.54.2 |
188269 ns/iter (± 548) |
75034 ns/iter (± 166) |
2.51 |
csaf_2_1_tests/6.2.54.3 |
195314 ns/iter (± 449) |
75131 ns/iter (± 60) |
2.60 |
csaf_2_1_tests/6.2.54.4 |
199686 ns/iter (± 320) |
74863 ns/iter (± 102) |
2.67 |
csaf_2_1_tests/6.3.1 |
180381 ns/iter (± 418) |
75154 ns/iter (± 226) |
2.40 |
csaf_2_1_tests/6.3.2 |
210326 ns/iter (± 224) |
98477 ns/iter (± 473) |
2.14 |
csaf_2_1_tests/6.3.3 |
186246 ns/iter (± 540) |
75733 ns/iter (± 81) |
2.46 |
csaf_2_1_tests/6.3.4 |
184938 ns/iter (± 512) |
75726 ns/iter (± 58) |
2.44 |
csaf_2_1_tests/6.3.5 |
193347 ns/iter (± 338) |
74554 ns/iter (± 103) |
2.59 |
csaf_2_1_tests/6.3.6 |
197096 ns/iter (± 632) |
75428 ns/iter (± 733) |
2.61 |
csaf_2_1_tests/6.3.7 |
203107 ns/iter (± 782) |
77299 ns/iter (± 311) |
2.63 |
csaf_2_1_tests/6.3.8 |
204608 ns/iter (± 1352) |
76630 ns/iter (± 276) |
2.67 |
csaf_2_1_tests/6.3.9 |
325294 ns/iter (± 1842) |
192895 ns/iter (± 234) |
1.69 |
csaf_2_1_tests/6.3.10 |
425109 ns/iter (± 602) |
88081 ns/iter (± 82) |
4.83 |
csaf_2_1_tests/6.3.11 |
422606 ns/iter (± 486) |
88056 ns/iter (± 97) |
4.80 |
csaf_2_1_tests/6.3.12 |
593381 ns/iter (± 1175) |
236631 ns/iter (± 1773) |
2.51 |
csaf_2_1_tests/6.3.13 |
438926 ns/iter (± 11092) |
88677 ns/iter (± 88) |
4.95 |
csaf_2_1_tests/6.3.14 |
440822 ns/iter (± 628) |
92576 ns/iter (± 101) |
4.76 |
csaf_2_1_tests/6.3.15 |
448318 ns/iter (± 1741) |
89197 ns/iter (± 72) |
5.03 |
csaf_2_1_tests/6.3.16 |
443676 ns/iter (± 532) |
89504 ns/iter (± 298) |
4.96 |
csaf_2_1_tests/6.3.17 |
452828 ns/iter (± 511) |
89519 ns/iter (± 44) |
5.06 |
csaf_2_1_tests/6.3.18 |
471168 ns/iter (± 510) |
99454 ns/iter (± 219) |
4.74 |
csaf_2_1_tests/6.3.19.1 |
210219 ns/iter (± 343) |
74520 ns/iter (± 592) |
2.82 |
csaf_2_1_tests/6.3.19.2 |
211643 ns/iter (± 431) |
74660 ns/iter (± 336) |
2.83 |
csaf_2_1_tests/6.3.19.3 |
216066 ns/iter (± 261) |
75125 ns/iter (± 339) |
2.88 |
csaf_2_1_tests/6.3.19.4 |
218685 ns/iter (± 3667) |
75444 ns/iter (± 92) |
2.90 |
csaf_2_1_tests/6.3.19.5 |
222594 ns/iter (± 857) |
73059 ns/iter (± 445) |
3.05 |
csaf_2_1_tests/6.3.20 |
496436 ns/iter (± 1895) |
100245 ns/iter (± 141) |
4.95 |
csaf_2_1_tests/6.3.21.1 |
225982 ns/iter (± 348) |
75159 ns/iter (± 101) |
3.01 |
csaf_2_1_tests/6.3.21.2 |
227859 ns/iter (± 296) |
75438 ns/iter (± 213) |
3.02 |
csaf_2_1_tests/6.3.21.3 |
233024 ns/iter (± 364) |
76552 ns/iter (± 2004) |
3.04 |
csaf_2_1_tests/6.3.21.4 |
226083 ns/iter (± 675) |
74545 ns/iter (± 864) |
3.03 |
csaf_2_1_tests/6.3.21.5 |
239787 ns/iter (± 821) |
73216 ns/iter (± 1560) |
3.28 |
csaf_2_1_tests/6.3.21.6 |
242313 ns/iter (± 205) |
74526 ns/iter (± 45) |
3.25 |
csaf_2_1_tests/6.3.21.7 |
249564 ns/iter (± 1732) |
74181 ns/iter (± 72) |
3.36 |
csaf_2_1_tests/6.3.21.8 |
251040 ns/iter (± 490) |
74520 ns/iter (± 38) |
3.37 |
csaf_2_1_tests/6.3.21.9 |
252513 ns/iter (± 264) |
74541 ns/iter (± 212) |
3.39 |
csaf_2_1_tests/6.3.22 |
488606 ns/iter (± 1052) |
90416 ns/iter (± 135) |
5.40 |
This comment was automatically generated by workflow using github-action-benchmark.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.