Allow choosing which annotations to accept#882
Conversation
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
965ecef to
02e91ed
Compare
🤖 Augment PR SummarySummary: This PR adds a way to selectively enable/disable annotation emission during exhaustive compilation, so users can control which schema keywords produce annotations. Changes:
Technical Notes: The allowlist only affects annotation emission; evaluation tracking for 🤖 Was this summary useful? React with 👍 or 👎 |
| bool format_assertion{false}; | ||
| /// Select which keywords emit annotations in exhaustive mode. When not set, | ||
| /// every annotation keyword is emitted | ||
| std::optional<std::unordered_set<sourcemeta::core::JSON::StringView>> |
There was a problem hiding this comment.
src/compiler/include/sourcemeta/blaze/compiler.h:104: Tweaks::annotations stores JSON::StringView (std::string_view) inside an unordered_set, which can dangle if callers build the set from temporary/short-lived strings (UB when annotations_enabled() checks contains). It might be worth clearly documenting the required lifetime expectations for these views (or otherwise ensuring the keys are owned).
Severity: medium
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: 51e649b | Previous: 1dc7105 | Ratio |
|---|---|---|---|
Schema_Iterator_ISO_Language |
2205706.8854163866 ns/iter |
2328046.687295952 ns/iter |
0.95 |
Schema_Tracker_ISO_Language |
4237127.476190359 ns/iter |
5031408.606666143 ns/iter |
0.84 |
Schema_Tracker_ISO_Language_To_JSON |
14679657.608696843 ns/iter |
15961652.489363102 ns/iter |
0.92 |
Schema_Frame_WoT_References |
4504602.134146331 ns/iter |
6080209.517730065 ns/iter |
0.74 |
Schema_Frame_OMC_References |
31533635.77777984 ns/iter |
26394413.319994785 ns/iter |
1.19 |
Schema_Frame_OMC_Locations |
20478303.741935723 ns/iter |
22613945.833328824 ns/iter |
0.91 |
Schema_Frame_ISO_Language_Locations |
72381546.33334185 ns/iter |
103157050.88889141 ns/iter |
0.70 |
Schema_Frame_KrakenD_References |
39716259.76471253 ns/iter |
54569306.57141714 ns/iter |
0.73 |
Schema_Frame_KrakenD_Reachable |
362320063.0000838 ns/iter |
615323749.0000265 ns/iter |
0.59 |
Schema_Frame_ISO_Language_Locations_To_JSON |
69473231.44446374 ns/iter |
99520285.71430154 ns/iter |
0.70 |
Schema_Frame_Many_Resources_References |
264305305.33336118 ns/iter |
439164333.5000026 ns/iter |
0.60 |
Schema_Bundle_Meta_2020_12 |
1218738.496503364 ns/iter |
1880735.9014379936 ns/iter |
0.65 |
Schema_Format_ISO_Language_To_JSON |
72084856.44443701 ns/iter |
109882048.83335584 ns/iter |
0.66 |
E2E_Compiler_adaptivecard |
62551805.49999296 ns/iter |
76277678.09090486 ns/iter |
0.82 |
E2E_Compiler_ansible_meta |
30568427.444441788 ns/iter |
41187562.49999933 ns/iter |
0.74 |
E2E_Compiler_aws_cdk |
323759.0671609207 ns/iter |
576920.3539170926 ns/iter |
0.56 |
E2E_Compiler_babelrc |
2187537.9770492264 ns/iter |
4239247.294999586 ns/iter |
0.52 |
E2E_Compiler_clang_format |
14681481.215686789 ns/iter |
27963447.51851831 ns/iter |
0.53 |
E2E_Compiler_cmake_presets |
25923516.962966125 ns/iter |
47618986.1333296 ns/iter |
0.54 |
E2E_Compiler_code_climate |
2109441.0529412124 ns/iter |
3986945.7671956434 ns/iter |
0.53 |
E2E_Compiler_cql2 |
13078563.90000097 ns/iter |
20294617.187502693 ns/iter |
0.64 |
E2E_Compiler_cspell |
19299082.031253077 ns/iter |
32483787.315784767 ns/iter |
0.59 |
E2E_Compiler_cypress |
3336353.0092595248 ns/iter |
6037932.795699954 ns/iter |
0.55 |
E2E_Compiler_deno |
6223350.071428918 ns/iter |
10199448.227274733 ns/iter |
0.61 |
E2E_Compiler_dependabot |
3261445.2598043536 ns/iter |
5429670.194915824 ns/iter |
0.60 |
E2E_Compiler_draft_04 |
1918696.350922995 ns/iter |
3624835.41818144 ns/iter |
0.53 |
E2E_Compiler_fabric_mod |
3430213.1767672664 ns/iter |
5669464.338982341 ns/iter |
0.61 |
E2E_Compiler_geojson |
23287319.057148386 ns/iter |
36315710.6666626 ns/iter |
0.64 |
E2E_Compiler_gitpod_configuration |
4091993.9064336005 ns/iter |
6546830.275231205 ns/iter |
0.63 |
E2E_Compiler_helm_chart_lock |
486379.2528352262 ns/iter |
666858.7438422673 ns/iter |
0.73 |
E2E_Compiler_importmap |
195721.65722305162 ns/iter |
352401.4806377471 ns/iter |
0.56 |
E2E_Compiler_jasmine |
989503.8154068352 ns/iter |
2101449.0107818516 ns/iter |
0.47 |
E2E_Compiler_jshintrc |
3026198.04453482 ns/iter |
5757954.590001191 ns/iter |
0.53 |
E2E_Compiler_jsconfig |
17993289.538463403 ns/iter |
26420989.130438894 ns/iter |
0.68 |
E2E_Compiler_krakend |
123494441.79999408 ns/iter |
224331402.66669703 ns/iter |
0.55 |
E2E_Compiler_lazygit |
30733208.30434489 ns/iter |
39049226.56251131 ns/iter |
0.79 |
E2E_Compiler_lerna |
1216249.2517985345 ns/iter |
1492359.5653105546 ns/iter |
0.81 |
E2E_Compiler_nest_cli |
5845665.948276417 ns/iter |
6963173.5360820405 ns/iter |
0.84 |
E2E_Compiler_omc |
160494979.25001788 ns/iter |
171083666.7500075 ns/iter |
0.94 |
E2E_Compiler_omnisharp |
6129482.664000534 ns/iter |
5905160.066667274 ns/iter |
1.04 |
E2E_Compiler_openapi |
21451735.2258099 ns/iter |
23299916.65516806 ns/iter |
0.92 |
E2E_Compiler_pre_commit_hooks |
3864915.277778083 ns/iter |
4223552.206896272 ns/iter |
0.92 |
E2E_Compiler_pulumi |
3142266.489361104 ns/iter |
3293424.2060308857 ns/iter |
0.95 |
E2E_Compiler_semantic_release |
1167958.0577556528 ns/iter |
1197626.9787233078 ns/iter |
0.98 |
E2E_Compiler_stale |
1119697.5159127212 ns/iter |
1672482.2934233684 ns/iter |
0.67 |
E2E_Compiler_stylecop |
5077155.040816851 ns/iter |
5508296.7807018645 ns/iter |
0.92 |
E2E_Compiler_tmuxinator |
1425946.3552360446 ns/iter |
1477372.8778001338 ns/iter |
0.97 |
E2E_Compiler_ui5 |
52627824.35714339 ns/iter |
56373535.230774835 ns/iter |
0.93 |
E2E_Compiler_ui5_manifest |
289370604.50004995 ns/iter |
322847874.9999795 ns/iter |
0.90 |
E2E_Compiler_unreal_engine_uproject |
3369422.475961196 ns/iter |
3391726.851852447 ns/iter |
0.99 |
E2E_Compiler_users_array |
777768.5950413271 ns/iter |
692389.9202227365 ns/iter |
1.12 |
E2E_Compiler_vercel |
12057164.351850353 ns/iter |
11434729.178570738 ns/iter |
1.05 |
E2E_Compiler_yamllint |
227037.32174742484 ns/iter |
218666.20637419858 ns/iter |
1.04 |
E2E_Evaluator_adaptivecard |
18666.246432400134 ns/iter |
20146.198623484914 ns/iter |
0.93 |
E2E_Evaluator_ansible_meta |
157637.96051178707 ns/iter |
158399.68248172288 ns/iter |
1.00 |
E2E_Evaluator_aws_cdk |
33575.45464569892 ns/iter |
32778.73328700541 ns/iter |
1.02 |
E2E_Evaluator_babelrc |
81898.98142599009 ns/iter |
82198.61615903077 ns/iter |
1.00 |
E2E_Evaluator_cerebrum_criminal_case |
704534.5104960904 ns/iter |
633978.9667540615 ns/iter |
1.11 |
E2E_Evaluator_clang_format |
133550.2120248718 ns/iter |
88427.02593984884 ns/iter |
1.51 |
E2E_Evaluator_cmake_presets |
4189180.0065356437 ns/iter |
3666647.180554921 ns/iter |
1.14 |
E2E_Evaluator_code_climate |
167106.0523476372 ns/iter |
127666.23361522063 ns/iter |
1.31 |
E2E_Evaluator_cql2 |
205951.54169829327 ns/iter |
135879.7810146476 ns/iter |
1.52 |
E2E_Evaluator_cspell |
563614.2633279185 ns/iter |
383400.9094279189 ns/iter |
1.47 |
E2E_Evaluator_cypress |
163283.7701612678 ns/iter |
138154.67230366505 ns/iter |
1.18 |
E2E_Evaluator_deno |
307135.20183484716 ns/iter |
217742.77000311986 ns/iter |
1.41 |
E2E_Evaluator_dependabot |
294038.50102663256 ns/iter |
223904.13124238388 ns/iter |
1.31 |
E2E_Evaluator_draft_04 |
7553935.606061585 ns/iter |
5715738.138686351 ns/iter |
1.32 |
E2E_Evaluator_fabric_mod |
822590.4314160423 ns/iter |
528272.3502747243 ns/iter |
1.56 |
E2E_Evaluator_geojson |
10863687.93877617 ns/iter |
9200945.095240995 ns/iter |
1.18 |
E2E_Evaluator_gitpod_configuration |
279218.2888264249 ns/iter |
202617.85044541862 ns/iter |
1.38 |
E2E_Evaluator_helm_chart_lock |
288228.2072368211 ns/iter |
380307.447916645 ns/iter |
0.76 |
E2E_Evaluator_importmap |
52487.96669998228 ns/iter |
40647.80109829216 ns/iter |
1.29 |
E2E_Evaluator_jasmine |
118831.26144907993 ns/iter |
133124.9184206208 ns/iter |
0.89 |
E2E_Evaluator_jshintrc |
1435126.73611094 ns/iter |
1242746.563972788 ns/iter |
1.15 |
E2E_Evaluator_jsconfig |
487075.04988815426 ns/iter |
344165.39509531716 ns/iter |
1.42 |
E2E_Evaluator_krakend |
180434.77982034607 ns/iter |
160425.69906206356 ns/iter |
1.12 |
E2E_Evaluator_lazygit |
113237.22525140109 ns/iter |
123146.11298837751 ns/iter |
0.92 |
E2E_Evaluator_lerna |
156655.56214247338 ns/iter |
183007.19905800998 ns/iter |
0.86 |
E2E_Evaluator_nest_cli |
182553.7102030651 ns/iter |
180921.8429242088 ns/iter |
1.01 |
E2E_Evaluator_omc |
19590.406621218353 ns/iter |
34704.177076325635 ns/iter |
0.56 |
E2E_Evaluator_omnisharp |
620893.6009317586 ns/iter |
484107.8090710762 ns/iter |
1.28 |
E2E_Evaluator_openapi |
11326759.514288044 ns/iter |
6206107.542857353 ns/iter |
1.83 |
E2E_Evaluator_pre_commit_hooks |
595906.4999999555 ns/iter |
346218.6162134874 ns/iter |
1.72 |
E2E_Evaluator_pulumi |
871725.4098359892 ns/iter |
565251.6268980519 ns/iter |
1.54 |
E2E_Evaluator_semantic_release |
112696.12613750472 ns/iter |
99179.22924343178 ns/iter |
1.14 |
E2E_Evaluator_stale |
163393.6457310849 ns/iter |
118297.20210611238 ns/iter |
1.38 |
E2E_Evaluator_stylecop |
226699.51456317166 ns/iter |
187483.7719886879 ns/iter |
1.21 |
E2E_Evaluator_tmuxinator |
84994.39605698269 ns/iter |
73800.47864346152 ns/iter |
1.15 |
E2E_Evaluator_ui5 |
467347.6550897521 ns/iter |
361391.1882234365 ns/iter |
1.29 |
E2E_Evaluator_ui5_manifest |
2105770.1423843955 ns/iter |
1788949.6914890853 ns/iter |
1.18 |
E2E_Evaluator_unreal_engine_uproject |
352041.8254648689 ns/iter |
326614.49724004284 ns/iter |
1.08 |
E2E_Evaluator_users_array |
501567.03397605655 ns/iter |
523988.58300011855 ns/iter |
0.96 |
E2E_Evaluator_vercel |
326836.8918645897 ns/iter |
280979.7668688727 ns/iter |
1.16 |
E2E_Evaluator_yamllint |
8803.314740601767 ns/iter |
8514.055641364703 ns/iter |
1.03 |
Micro_Draft4_Meta_1_No_Callback |
171.98656435422077 ns/iter |
215.395072474442 ns/iter |
0.80 |
Micro_Draft4_Required_Properties |
815.433467556764 ns/iter |
788.5945096557057 ns/iter |
1.03 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
25.027217121006142 ns/iter |
19.607445537071918 ns/iter |
1.28 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
10.237304896242762 ns/iter |
10.18864862653979 ns/iter |
1.00 |
Micro_Draft4_Items_Schema |
306.0948938471664 ns/iter |
240.6450534409752 ns/iter |
1.27 |
Micro_Draft4_Nested_Object |
0.8419131063709511 ns/iter |
0.8263963217554586 ns/iter |
1.02 |
Micro_Draft4_Properties_Triad_Optional |
289.9244052364505 ns/iter |
251.08748170054704 ns/iter |
1.15 |
Micro_Draft4_Properties_Triad_Closed |
226.01371440734312 ns/iter |
204.40224810008587 ns/iter |
1.11 |
Micro_Draft4_Properties_Triad_Required |
306.5036283043971 ns/iter |
240.20825720311993 ns/iter |
1.28 |
Micro_Draft4_Properties_Closed |
55.52945297043014 ns/iter |
48.00083363922327 ns/iter |
1.16 |
Micro_Draft4_Non_Recursive_Ref |
16.569813792957973 ns/iter |
13.563955673896839 ns/iter |
1.22 |
Micro_Draft4_Pattern_Properties_True |
183.8777852577067 ns/iter |
179.36846981084494 ns/iter |
1.03 |
Micro_Draft4_Ref_To_Single_Property |
9.122118386979258 ns/iter |
9.602037118878531 ns/iter |
0.95 |
Micro_Draft4_Additional_Properties_Type |
31.901362137137735 ns/iter |
28.794401755964238 ns/iter |
1.11 |
Micro_Draft4_Nested_Oneof |
51.505683400000635 ns/iter |
47.4573646255743 ns/iter |
1.09 |
Micro_Draft4_Short_Enum |
6.505044094738369 ns/iter |
5.486678843817807 ns/iter |
1.19 |
Micro_Draft4_Long_Enum |
12.72220732108044 ns/iter |
10.488345486090095 ns/iter |
1.21 |
Micro_Draft4_Long_Enum_Short_Strings |
8.612720445023927 ns/iter |
6.46813000906692 ns/iter |
1.33 |
Micro_Draft4_Type_Object |
3.2717500767396084 ns/iter |
2.5171246686791693 ns/iter |
1.30 |
Micro_Draft4_Ref_Single_100 |
2424220.082707165 ns/iter |
1658170.9735577786 ns/iter |
1.46 |
Micro_Draft4_Compile_Ref_Many_Nested |
1757863.7722219054 ns/iter |
1216603.3051722355 ns/iter |
1.44 |
Micro_Draft4_Compile_Wrap |
2903388.8859644006 ns/iter |
2180429.4969511805 ns/iter |
1.33 |
Micro_Draft6_Property_Names |
115.32189517311443 ns/iter |
99.99202533348135 ns/iter |
1.15 |
Micro_Draft6_Compile_FHIR |
16878484167.000124 ns/iter |
9874017542.000048 ns/iter |
1.71 |
Micro_Draft7_If_Then_Else |
25.86637871418262 ns/iter |
18.418295478345915 ns/iter |
1.40 |
Micro_2019_09_Unevaluated_Properties |
34.531655747634 ns/iter |
28.982577362868525 ns/iter |
1.19 |
Micro_2019_09_Compile_Wrap |
525337583.00000954 ns/iter |
309465082.99996364 ns/iter |
1.70 |
Micro_2020_12_Dynamic_Ref |
271.7991943615262 ns/iter |
200.82670019697775 ns/iter |
1.35 |
Micro_2020_12_Dynamic_Ref_Single |
3.552884724310107 ns/iter |
2.764597124083041 ns/iter |
1.29 |
Micro_2020_12_Simple_Output_Mask |
902.8504749183307 ns/iter |
791.3826931372637 ns/iter |
1.14 |
Micro_2020_12_Simple_Output_Annotations |
104956.86276999145 ns/iter |
87335.64755660764 ns/iter |
1.20 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1050618.2104430662 ns/iter |
747650.0582752144 ns/iter |
1.41 |
Micro_2020_12_Exhaustive_Deep_Numeric |
7325.845592042663 ns/iter |
5150.150353762148 ns/iter |
1.42 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
154273.93370419217 ns/iter |
112238.55787755718 ns/iter |
1.37 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
16880.179706499723 ns/iter |
14517.345337823155 ns/iter |
1.16 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
144.4855615681875 ns/iter |
88.19304169700148 ns/iter |
1.64 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
5407.402933123106 ns/iter |
5064.022453852105 ns/iter |
1.07 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
370445749.99993074 ns/iter |
251427555.66669926 ns/iter |
1.47 |
Alterschema_Check_Readibility_OMC |
89380629.66667026 ns/iter |
59868201.33333974 ns/iter |
1.49 |
Alterschema_Check_Readibility_KrakenD |
1008793542.0001485 ns/iter |
675342042.0000111 ns/iter |
1.49 |
Alterschema_Apply_Readibility_KrakenD |
100229654417.00012 ns/iter |
68246952874.99981 ns/iter |
1.47 |
Alterschema_Check_Invalid_External_Refs |
183988500.00005496 ns/iter |
185892760.49999624 ns/iter |
0.99 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (macos/llvm)
Details
| Benchmark suite | Current: 51e649b | Previous: 1dc7105 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
121130 ns |
104160 ns |
1.16 |
E2E_Evaluator_ansible-meta |
359020 ns |
361095 ns |
0.99 |
E2E_Evaluator_aws-cdk |
150008 ns |
115523 ns |
1.30 |
E2E_Evaluator_babelrc |
339105 ns |
304509 ns |
1.11 |
E2E_Evaluator_cerebrum-criminal-case |
2147926 ns |
1726204 ns |
1.24 |
E2E_Evaluator_clang-format |
291641 ns |
251457 ns |
1.16 |
E2E_Evaluator_cmake-presets |
23928863 ns |
19550657 ns |
1.22 |
E2E_Evaluator_code-climate |
532963 ns |
475411 ns |
1.12 |
E2E_Evaluator_cql2 |
1340981 ns |
1227137 ns |
1.09 |
E2E_Evaluator_cspell |
1487349 ns |
1221013 ns |
1.22 |
E2E_Evaluator_cypress |
670520 ns |
657352 ns |
1.02 |
E2E_Evaluator_deno |
856215 ns |
746183 ns |
1.15 |
E2E_Evaluator_dependabot |
827940 ns |
789785 ns |
1.05 |
E2E_Evaluator_draft-04 |
18053565 ns |
16767999 ns |
1.08 |
E2E_Evaluator_fabric-mod |
1497269 ns |
1363334 ns |
1.10 |
E2E_Evaluator_geojson |
16769818 ns |
14893866 ns |
1.13 |
E2E_Evaluator_gitpod-configuration |
541228 ns |
463878 ns |
1.17 |
E2E_Evaluator_helm-chart-lock |
846825 ns |
810289 ns |
1.05 |
E2E_Evaluator_importmap |
216104 ns |
258807 ns |
0.84 |
E2E_Evaluator_jasmine |
225092 ns |
218685 ns |
1.03 |
E2E_Evaluator_jsconfig |
1076794 ns |
1033219 ns |
1.04 |
E2E_Evaluator_jshintrc |
2148612 ns |
2033576 ns |
1.06 |
E2E_Evaluator_krakend |
482406 ns |
469507 ns |
1.03 |
E2E_Evaluator_lazygit |
322855 ns |
298443 ns |
1.08 |
E2E_Evaluator_lerna |
345696 ns |
315943 ns |
1.09 |
E2E_Evaluator_nest-cli |
421839 ns |
398531 ns |
1.06 |
E2E_Evaluator_omc |
75625 ns |
70571 ns |
1.07 |
E2E_Evaluator_omnisharp |
1031754 ns |
978199 ns |
1.05 |
E2E_Evaluator_openapi |
22107901 ns |
16232831 ns |
1.36 |
E2E_Evaluator_pre-commit-hooks |
1398884 ns |
1482163 ns |
0.94 |
E2E_Evaluator_pulumi |
1436455 ns |
1454408 ns |
0.99 |
E2E_Evaluator_semantic-release |
190663 ns |
175673 ns |
1.09 |
E2E_Evaluator_stale |
291017 ns |
306799 ns |
0.95 |
E2E_Evaluator_stylecop |
851517 ns |
931317 ns |
0.91 |
E2E_Evaluator_tmuxinator |
167423 ns |
174507 ns |
0.96 |
E2E_Evaluator_ui5 |
1902291 ns |
1631448 ns |
1.17 |
E2E_Evaluator_ui5-manifest |
8170336 ns |
9371350 ns |
0.87 |
E2E_Evaluator_unreal-engine-uproject |
1172351 ns |
1294207 ns |
0.91 |
E2E_Evaluator_users-array |
1822387 ns |
2009016 ns |
0.91 |
E2E_Evaluator_vercel |
758214 ns |
751465 ns |
1.01 |
E2E_Evaluator_yamllint |
24013 ns |
24457 ns |
0.98 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
1 issue found across 7 files
Reply with feedback, questions, or to request a fix.
Re-trigger cubic
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: 51e649b | Previous: 1dc7105 | Ratio |
|---|---|---|---|
Alterschema_Check_Readibility_ISO_Language_Set_3 |
377893289.4999798 ns/iter |
340365145.499959 ns/iter |
1.11 |
Alterschema_Check_Readibility_OMC |
106779331.57142304 ns/iter |
102605049.42857552 ns/iter |
1.04 |
Alterschema_Check_Readibility_KrakenD |
1447796643.9999363 ns/iter |
1390775861.0000656 ns/iter |
1.04 |
Alterschema_Apply_Readibility_KrakenD |
136907081038.99988 ns/iter |
132105273791.99994 ns/iter |
1.04 |
Alterschema_Check_Invalid_External_Refs |
295303180.5000137 ns/iter |
293745321.499955 ns/iter |
1.01 |
Micro_2020_12_Dynamic_Ref |
260.31153813295776 ns/iter |
269.7638687745869 ns/iter |
0.96 |
Micro_2020_12_Dynamic_Ref_Single |
4.222143149283362 ns/iter |
4.223725217483778 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Mask |
1122.6269866527307 ns/iter |
1123.2063445341894 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Annotations |
103094.24543850472 ns/iter |
117590.94296683301 ns/iter |
0.88 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1190443.4795917573 ns/iter |
1178542.1703202554 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8785.789455973054 ns/iter |
8908.085584666662 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
166775.5335515563 ns/iter |
165743.44160672335 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
26629.926117156687 ns/iter |
26672.39713679856 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
152.30128920944716 ns/iter |
153.20256592893077 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4670.372657458144 ns/iter |
4469.881766453392 ns/iter |
1.04 |
Micro_2019_09_Unevaluated_Properties |
28.539978748887098 ns/iter |
28.169109854596364 ns/iter |
1.01 |
Micro_2019_09_Compile_Wrap |
349501491.99994487 ns/iter |
319289385.0000473 ns/iter |
1.09 |
Micro_Draft7_If_Then_Else |
24.99594501760422 ns/iter |
25.006556194250344 ns/iter |
1.00 |
Micro_Draft6_Property_Names |
151.09526604422882 ns/iter |
143.0224241905666 ns/iter |
1.06 |
Micro_Draft6_Compile_FHIR |
16436211161.000074 ns/iter |
14202258354.00015 ns/iter |
1.16 |
Micro_Draft4_Meta_1_No_Callback |
177.8519101319297 ns/iter |
176.54704272912969 ns/iter |
1.01 |
Micro_Draft4_Required_Properties |
815.2028470619581 ns/iter |
826.3808560059052 ns/iter |
0.99 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
21.522870223391184 ns/iter |
21.102663185087994 ns/iter |
1.02 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
12.667568695322538 ns/iter |
12.662185934306276 ns/iter |
1.00 |
Micro_Draft4_Items_Schema |
298.86151521277463 ns/iter |
318.2028896478923 ns/iter |
0.94 |
Micro_Draft4_Nested_Object |
2.1114805384794737 ns/iter |
2.1177275660077615 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Optional |
418.54898808531846 ns/iter |
442.0815203905197 ns/iter |
0.95 |
Micro_Draft4_Properties_Triad_Closed |
339.9161402827085 ns/iter |
343.69819042014143 ns/iter |
0.99 |
Micro_Draft4_Properties_Triad_Required |
466.8341283310425 ns/iter |
457.2786745042494 ns/iter |
1.02 |
Micro_Draft4_Properties_Closed |
61.80183308826681 ns/iter |
61.45075198807072 ns/iter |
1.01 |
Micro_Draft4_Non_Recursive_Ref |
8.451050458289565 ns/iter |
9.152779566730846 ns/iter |
0.92 |
Micro_Draft4_Pattern_Properties_True |
200.25933103570893 ns/iter |
187.49293903897154 ns/iter |
1.07 |
Micro_Draft4_Ref_To_Single_Property |
12.673191352137858 ns/iter |
13.04820100801606 ns/iter |
0.97 |
Micro_Draft4_Additional_Properties_Type |
13.761292336472755 ns/iter |
13.899114589192184 ns/iter |
0.99 |
Micro_Draft4_Nested_Oneof |
65.46112558871636 ns/iter |
63.340641345179755 ns/iter |
1.03 |
Micro_Draft4_Short_Enum |
14.543072350214011 ns/iter |
14.606666135644925 ns/iter |
1.00 |
Micro_Draft4_Long_Enum |
13.752699803326848 ns/iter |
13.38331721253409 ns/iter |
1.03 |
Micro_Draft4_Long_Enum_Short_Strings |
14.497978564865083 ns/iter |
14.486245259858256 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
4.223476292039062 ns/iter |
4.220039173875495 ns/iter |
1.00 |
Micro_Draft4_Ref_Single_100 |
2529501.4784172988 ns/iter |
2500713.215827156 ns/iter |
1.01 |
Micro_Draft4_Compile_Ref_Many_Nested |
1850150.632274938 ns/iter |
1852124.9708221718 ns/iter |
1.00 |
Micro_Draft4_Compile_Wrap |
2679112.817829736 ns/iter |
2669919.5000002375 ns/iter |
1.00 |
E2E_Compiler_adaptivecard |
66493008.29999447 ns/iter |
65493768.800001815 ns/iter |
1.02 |
E2E_Compiler_ansible_meta |
32005138.363636184 ns/iter |
31830388.227273367 ns/iter |
1.01 |
E2E_Compiler_aws_cdk |
391904.96696531604 ns/iter |
387267.95916118455 ns/iter |
1.01 |
E2E_Compiler_babelrc |
2776657.5515874326 ns/iter |
2752186.846456554 ns/iter |
1.01 |
E2E_Compiler_clang_format |
19938756.857144263 ns/iter |
19334520.194440253 ns/iter |
1.03 |
E2E_Compiler_cmake_presets |
28522287.559999313 ns/iter |
28417640.199995734 ns/iter |
1.00 |
E2E_Compiler_code_climate |
2822829.3225813485 ns/iter |
2798931.203187749 ns/iter |
1.01 |
E2E_Compiler_cql2 |
14456796.897956317 ns/iter |
14444087.387754716 ns/iter |
1.00 |
E2E_Compiler_cspell |
25325815.42857315 ns/iter |
24956297.82142877 ns/iter |
1.01 |
E2E_Compiler_cypress |
4352524.825000615 ns/iter |
4323220.627329138 ns/iter |
1.01 |
E2E_Compiler_deno |
8704083.12499933 ns/iter |
8851447.000001883 ns/iter |
0.98 |
E2E_Compiler_dependabot |
4272502.737805786 ns/iter |
4237530.999999072 ns/iter |
1.01 |
E2E_Compiler_draft_04 |
2947242.9327727566 ns/iter |
2939165.7436976973 ns/iter |
1.00 |
E2E_Compiler_fabric_mod |
5131791.182482656 ns/iter |
5126893.116788526 ns/iter |
1.00 |
E2E_Compiler_geojson |
25488747.857147183 ns/iter |
24138679.3793089 ns/iter |
1.06 |
E2E_Compiler_gitpod_configuration |
5468493.346456388 ns/iter |
5379865.015384684 ns/iter |
1.02 |
E2E_Compiler_helm_chart_lock |
718655.3915726071 ns/iter |
702728.8096676964 ns/iter |
1.02 |
E2E_Compiler_importmap |
294791.07118785934 ns/iter |
288952.3065451773 ns/iter |
1.02 |
E2E_Compiler_jasmine |
1488011.0652627894 ns/iter |
1451325.3929314096 ns/iter |
1.03 |
E2E_Compiler_jshintrc |
4522679.901961085 ns/iter |
4520565.580645369 ns/iter |
1.00 |
E2E_Compiler_jsconfig |
23412789.83333268 ns/iter |
23195087.733332302 ns/iter |
1.01 |
E2E_Compiler_krakend |
145748061.19999266 ns/iter |
144674739.6000319 ns/iter |
1.01 |
E2E_Compiler_lazygit |
37360704.894737005 ns/iter |
35893965.368419036 ns/iter |
1.04 |
E2E_Compiler_lerna |
1726880.155940357 ns/iter |
1693490.966183211 ns/iter |
1.02 |
E2E_Compiler_nest_cli |
8223853.988373628 ns/iter |
7977276.9999987185 ns/iter |
1.03 |
E2E_Compiler_omc |
178188420.74996156 ns/iter |
172058689.00003907 ns/iter |
1.04 |
E2E_Compiler_omnisharp |
7317382.687498745 ns/iter |
7191915.628864174 ns/iter |
1.02 |
E2E_Compiler_openapi |
27844573.399997897 ns/iter |
27522057.26922232 ns/iter |
1.01 |
E2E_Compiler_pre_commit_hooks |
5652286.12903147 ns/iter |
5621347.320000496 ns/iter |
1.01 |
E2E_Compiler_pulumi |
4374759.906249892 ns/iter |
4345174.818750763 ns/iter |
1.01 |
E2E_Compiler_semantic_release |
1681506.5251797086 ns/iter |
1668052.5584721388 ns/iter |
1.01 |
E2E_Compiler_stale |
1665827.0906923907 ns/iter |
1643407.8047057162 ns/iter |
1.01 |
E2E_Compiler_stylecop |
6867697.495050775 ns/iter |
6720406.961538682 ns/iter |
1.02 |
E2E_Compiler_tmuxinator |
2064944.1740409853 ns/iter |
2033964.1686045662 ns/iter |
1.02 |
E2E_Compiler_ui5 |
53151054.9999926 ns/iter |
51538288.92857096 ns/iter |
1.03 |
E2E_Compiler_ui5_manifest |
365872779.5000232 ns/iter |
325526412.50003946 ns/iter |
1.12 |
E2E_Compiler_unreal_engine_uproject |
4985830.164285485 ns/iter |
4911310.464788739 ns/iter |
1.02 |
E2E_Compiler_users_array |
895931.0502577348 ns/iter |
883878.8751574708 ns/iter |
1.01 |
E2E_Compiler_vercel |
13772683.058826206 ns/iter |
13364990.499999644 ns/iter |
1.03 |
E2E_Compiler_yamllint |
357712.7706941007 ns/iter |
357595.9576962734 ns/iter |
1.00 |
E2E_Evaluator_adaptivecard |
23343.26196068142 ns/iter |
23294.539750905045 ns/iter |
1.00 |
E2E_Evaluator_ansible_meta |
241535.063143449 ns/iter |
239198.98169263406 ns/iter |
1.01 |
E2E_Evaluator_aws_cdk |
47532.61768970357 ns/iter |
48003.489497406765 ns/iter |
0.99 |
E2E_Evaluator_babelrc |
93759.17570816808 ns/iter |
94489.34152563501 ns/iter |
0.99 |
E2E_Evaluator_cerebrum_criminal_case |
1277760.706270618 ns/iter |
1138391.9819377782 ns/iter |
1.12 |
E2E_Evaluator_clang_format |
104713.94717942798 ns/iter |
100377.0004276244 ns/iter |
1.04 |
E2E_Evaluator_cmake_presets |
7052759.129999232 ns/iter |
4669534.55555533 ns/iter |
1.51 |
E2E_Evaluator_code_climate |
171226.67987205044 ns/iter |
170233.58133268726 ns/iter |
1.01 |
E2E_Evaluator_cql2 |
206854.6681495032 ns/iter |
212584.92417907846 ns/iter |
0.97 |
E2E_Evaluator_cspell |
540918.4890564609 ns/iter |
512431.23520713014 ns/iter |
1.06 |
E2E_Evaluator_cypress |
145163.52080760073 ns/iter |
143911.05482545623 ns/iter |
1.01 |
E2E_Evaluator_deno |
311343.73833758745 ns/iter |
291695.1212378568 ns/iter |
1.07 |
E2E_Evaluator_dependabot |
359523.11111100804 ns/iter |
357286.4489690557 ns/iter |
1.01 |
E2E_Evaluator_draft_04 |
12724565.50909324 ns/iter |
7302802.340658532 ns/iter |
1.74 |
E2E_Evaluator_fabric_mod |
766081.3767797702 ns/iter |
733055.4059195304 ns/iter |
1.05 |
E2E_Evaluator_geojson |
21326075.625005104 ns/iter |
19042932.324325465 ns/iter |
1.12 |
E2E_Evaluator_gitpod_configuration |
235609.00746521182 ns/iter |
231320.35458168926 ns/iter |
1.02 |
E2E_Evaluator_helm_chart_lock |
218587.75860958945 ns/iter |
217526.7350722703 ns/iter |
1.00 |
E2E_Evaluator_importmap |
38927.677729834664 ns/iter |
41633.60425480924 ns/iter |
0.94 |
E2E_Evaluator_jasmine |
106166.21747014862 ns/iter |
104376.33617848593 ns/iter |
1.02 |
E2E_Evaluator_jshintrc |
1052232.385542407 ns/iter |
1026341.5102940598 ns/iter |
1.03 |
E2E_Evaluator_jsconfig |
375557.3994638097 ns/iter |
386771.246590287 ns/iter |
0.97 |
E2E_Evaluator_krakend |
191205.0489490717 ns/iter |
188717.39312568313 ns/iter |
1.01 |
E2E_Evaluator_lazygit |
130256.10834443118 ns/iter |
129451.42418673864 ns/iter |
1.01 |
E2E_Evaluator_lerna |
138182.13164658457 ns/iter |
136168.77779953319 ns/iter |
1.01 |
E2E_Evaluator_nest_cli |
186224.93005524823 ns/iter |
189048.54358972955 ns/iter |
0.99 |
E2E_Evaluator_omc |
19344.98307912167 ns/iter |
18522.16999999863 ns/iter |
1.04 |
E2E_Evaluator_omnisharp |
532063.6451128131 ns/iter |
522756.74183750496 ns/iter |
1.02 |
E2E_Evaluator_openapi |
16562353.904760132 ns/iter |
10066726.367647467 ns/iter |
1.65 |
E2E_Evaluator_pre_commit_hooks |
477246.1834925094 ns/iter |
478323.3006756327 ns/iter |
1.00 |
E2E_Evaluator_pulumi |
752664.1078748208 ns/iter |
749713.8234018876 ns/iter |
1.00 |
E2E_Evaluator_semantic_release |
87059.92989022857 ns/iter |
86751.30998250932 ns/iter |
1.00 |
E2E_Evaluator_stale |
163978.68970378925 ns/iter |
159349.60373116858 ns/iter |
1.03 |
E2E_Evaluator_stylecop |
302214.093920326 ns/iter |
292567.34105269733 ns/iter |
1.03 |
E2E_Evaluator_tmuxinator |
86984.07527283745 ns/iter |
90762.5208851361 ns/iter |
0.96 |
E2E_Evaluator_ui5 |
518914.7808527884 ns/iter |
527973.8765893418 ns/iter |
0.98 |
E2E_Evaluator_ui5_manifest |
2662422.1098488346 ns/iter |
2678452.0568179977 ns/iter |
0.99 |
E2E_Evaluator_unreal_engine_uproject |
439845.44556325447 ns/iter |
449953.5305867096 ns/iter |
0.98 |
E2E_Evaluator_users_array |
691406.5084914851 ns/iter |
702888.3635448181 ns/iter |
0.98 |
E2E_Evaluator_vercel |
279317.0849359355 ns/iter |
282873.2454110297 ns/iter |
0.99 |
E2E_Evaluator_yamllint |
10062.854918624656 ns/iter |
9180.430506830948 ns/iter |
1.10 |
Schema_Format_ISO_Language_To_JSON |
120777731.8333001 ns/iter |
109577500.16666524 ns/iter |
1.10 |
Schema_Bundle_Meta_2020_12 |
1867743.6480011237 ns/iter |
1852155.0211664997 ns/iter |
1.01 |
Schema_Frame_WoT_References |
5827772.672269365 ns/iter |
5850781.133333763 ns/iter |
1.00 |
Schema_Frame_OMC_References |
27024234.30769858 ns/iter |
24281920.275864746 ns/iter |
1.11 |
Schema_Frame_OMC_Locations |
24077837.10344214 ns/iter |
22333390.06452004 ns/iter |
1.08 |
Schema_Frame_ISO_Language_Locations |
112566185.83331601 ns/iter |
102392023.57141559 ns/iter |
1.10 |
Schema_Frame_KrakenD_References |
50565761.29998121 ns/iter |
43860932.93749127 ns/iter |
1.15 |
Schema_Frame_KrakenD_Reachable |
653514676.9999756 ns/iter |
577628190.0000412 ns/iter |
1.13 |
Schema_Frame_ISO_Language_Locations_To_JSON |
190060978.00001952 ns/iter |
174570798.49998537 ns/iter |
1.09 |
Schema_Frame_Many_Resources_References |
399955009.4999904 ns/iter |
384210594.0000238 ns/iter |
1.04 |
Schema_Iterator_ISO_Language |
3890442.744444853 ns/iter |
3671127.8969072006 ns/iter |
1.06 |
Schema_Tracker_ISO_Language |
5249496.8030308 ns/iter |
5216434.729322657 ns/iter |
1.01 |
Schema_Tracker_ISO_Language_To_JSON |
26578251.846156213 ns/iter |
25848063.22222364 ns/iter |
1.03 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/gcc)
Details
| Benchmark suite | Current: 51e649b | Previous: 1dc7105 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
117220 ns |
120993 ns |
0.97 |
E2E_Evaluator_ansible-meta |
601885 ns |
542476 ns |
1.11 |
E2E_Evaluator_aws-cdk |
129321 ns |
126691 ns |
1.02 |
E2E_Evaluator_babelrc |
374164 ns |
343931 ns |
1.09 |
E2E_Evaluator_cerebrum-criminal-case |
2720762 ns |
2735153 ns |
0.99 |
E2E_Evaluator_clang-format |
286042 ns |
260902 ns |
1.10 |
E2E_Evaluator_cmake-presets |
19844745 ns |
18124292 ns |
1.09 |
E2E_Evaluator_code-climate |
505139 ns |
496984 ns |
1.02 |
E2E_Evaluator_cql2 |
1221954 ns |
1233179 ns |
0.99 |
E2E_Evaluator_cspell |
1711043 ns |
1592126 ns |
1.07 |
E2E_Evaluator_cypress |
928141 ns |
845225 ns |
1.10 |
E2E_Evaluator_deno |
1069531 ns |
1109528 ns |
0.96 |
E2E_Evaluator_dependabot |
1062640 ns |
1057747 ns |
1.00 |
E2E_Evaluator_draft-04 |
21180710 ns |
22421334 ns |
0.94 |
E2E_Evaluator_fabric-mod |
2454054 ns |
2491998 ns |
0.98 |
E2E_Evaluator_geojson |
28381106 ns |
24624474 ns |
1.15 |
E2E_Evaluator_gitpod-configuration |
763898 ns |
727342 ns |
1.05 |
E2E_Evaluator_helm-chart-lock |
1048031 ns |
997814 ns |
1.05 |
E2E_Evaluator_importmap |
270174 ns |
262085 ns |
1.03 |
E2E_Evaluator_jasmine |
278502 ns |
280545 ns |
0.99 |
E2E_Evaluator_jsconfig |
1482948 ns |
1435983 ns |
1.03 |
E2E_Evaluator_jshintrc |
2931469 ns |
2953732 ns |
0.99 |
E2E_Evaluator_krakend |
628679 ns |
630441 ns |
1.00 |
E2E_Evaluator_lazygit |
466161 ns |
439714 ns |
1.06 |
E2E_Evaluator_lerna |
453159 ns |
440498 ns |
1.03 |
E2E_Evaluator_nest-cli |
594368 ns |
593181 ns |
1.00 |
E2E_Evaluator_omc |
92484 ns |
93283 ns |
0.99 |
E2E_Evaluator_omnisharp |
1496666 ns |
1464628 ns |
1.02 |
E2E_Evaluator_openapi |
23402874 ns |
26007623 ns |
0.90 |
E2E_Evaluator_pre-commit-hooks |
2040459 ns |
2053147 ns |
0.99 |
E2E_Evaluator_pulumi |
2028744 ns |
2039534 ns |
0.99 |
E2E_Evaluator_semantic-release |
223752 ns |
225353 ns |
0.99 |
E2E_Evaluator_stale |
376297 ns |
380269 ns |
0.99 |
E2E_Evaluator_stylecop |
1199501 ns |
1144974 ns |
1.05 |
E2E_Evaluator_tmuxinator |
218544 ns |
215500 ns |
1.01 |
E2E_Evaluator_ui5 |
2161511 ns |
2143924 ns |
1.01 |
E2E_Evaluator_ui5-manifest |
9844034 ns |
10858944 ns |
0.91 |
E2E_Evaluator_unreal-engine-uproject |
1624885 ns |
1580958 ns |
1.03 |
E2E_Evaluator_users-array |
2449359 ns |
2576448 ns |
0.95 |
E2E_Evaluator_vercel |
1003955 ns |
1009231 ns |
0.99 |
E2E_Evaluator_yamllint |
24118 ns |
24281 ns |
0.99 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: 51e649b | Previous: 1dc7105 | Ratio |
|---|---|---|---|
Schema_Iterator_ISO_Language |
3570618.7999995816 ns/iter |
3178463.522726815 ns/iter |
1.12 |
Schema_Tracker_ISO_Language |
4708226.093959375 ns/iter |
4599266.946309479 ns/iter |
1.02 |
Schema_Tracker_ISO_Language_To_JSON |
21051747.969694946 ns/iter |
20924729.18749877 ns/iter |
1.01 |
Schema_Frame_WoT_References |
4890474.67132903 ns/iter |
4808251.703448621 ns/iter |
1.02 |
Schema_Frame_OMC_References |
22420398.468753435 ns/iter |
20831707.212120377 ns/iter |
1.08 |
Schema_Frame_OMC_Locations |
19449345.499999203 ns/iter |
19114102.5277817 ns/iter |
1.02 |
Schema_Frame_ISO_Language_Locations |
100293125.00000744 ns/iter |
98510487.66665827 ns/iter |
1.02 |
Schema_Frame_KrakenD_References |
41901386.82353041 ns/iter |
40271263.16666201 ns/iter |
1.04 |
Schema_Frame_KrakenD_Reachable |
612610637.9997509 ns/iter |
572686564.9999126 ns/iter |
1.07 |
Schema_Frame_ISO_Language_Locations_To_JSON |
127301974.4999715 ns/iter |
119961710.40000263 ns/iter |
1.06 |
Schema_Frame_Many_Resources_References |
354033721.0000644 ns/iter |
367967168.99993956 ns/iter |
0.96 |
Schema_Bundle_Meta_2020_12 |
1560359.6311105625 ns/iter |
1539552.4326704096 ns/iter |
1.01 |
Schema_Format_ISO_Language_To_JSON |
109024357.28572917 ns/iter |
107383302.7143272 ns/iter |
1.02 |
E2E_Compiler_adaptivecard |
62652829.18182245 ns/iter |
60816923.66666403 ns/iter |
1.03 |
E2E_Compiler_ansible_meta |
27484238.920005735 ns/iter |
27294832.3461588 ns/iter |
1.01 |
E2E_Compiler_aws_cdk |
352914.50126202055 ns/iter |
345150.437223051 ns/iter |
1.02 |
E2E_Compiler_babelrc |
2448140.729824158 ns/iter |
2413940.9037805223 ns/iter |
1.01 |
E2E_Compiler_clang_format |
17495852.475002494 ns/iter |
17051332.512199048 ns/iter |
1.03 |
E2E_Compiler_cmake_presets |
26047496.259260934 ns/iter |
25730837.925923172 ns/iter |
1.01 |
E2E_Compiler_code_climate |
2460564.0947372685 ns/iter |
2403585.6701030033 ns/iter |
1.02 |
E2E_Compiler_cql2 |
13073972.320754828 ns/iter |
12995816.166667115 ns/iter |
1.01 |
E2E_Compiler_cspell |
23300960.200003825 ns/iter |
22882126.129036717 ns/iter |
1.02 |
E2E_Compiler_cypress |
4012254.8742861655 ns/iter |
3950409.727272069 ns/iter |
1.02 |
E2E_Compiler_deno |
7535233.763441264 ns/iter |
7452757.354837647 ns/iter |
1.01 |
E2E_Compiler_dependabot |
3735883.540107328 ns/iter |
3672691.031579234 ns/iter |
1.02 |
E2E_Compiler_draft_04 |
2585710.595588065 ns/iter |
2577875.4492754107 ns/iter |
1.00 |
E2E_Compiler_fabric_mod |
4528314.858064351 ns/iter |
4542944.038216861 ns/iter |
1.00 |
E2E_Compiler_geojson |
21290657.212120727 ns/iter |
20925286.363638986 ns/iter |
1.02 |
E2E_Compiler_gitpod_configuration |
4770240.979451357 ns/iter |
4692903.027027163 ns/iter |
1.02 |
E2E_Compiler_helm_chart_lock |
666259.063507099 ns/iter |
655469.4565013997 ns/iter |
1.02 |
E2E_Compiler_importmap |
266436.4195511119 ns/iter |
261285.0239520998 ns/iter |
1.02 |
E2E_Compiler_jasmine |
1300438.1537038407 ns/iter |
1279921.2943330645 ns/iter |
1.02 |
E2E_Compiler_jshintrc |
4102265.4411763675 ns/iter |
4024228.627218346 ns/iter |
1.02 |
E2E_Compiler_jsconfig |
21048574.93939314 ns/iter |
20696291.794111483 ns/iter |
1.02 |
E2E_Compiler_krakend |
150699792.20002097 ns/iter |
146292424.8000036 ns/iter |
1.03 |
E2E_Compiler_lazygit |
32400242.090912715 ns/iter |
31511044.272726644 ns/iter |
1.03 |
E2E_Compiler_lerna |
1517982.6065219536 ns/iter |
1494868.5948828785 ns/iter |
1.02 |
E2E_Compiler_nest_cli |
7109238.808080783 ns/iter |
7011776.0800008 ns/iter |
1.01 |
E2E_Compiler_omc |
164403722.75002345 ns/iter |
155801993.0000114 ns/iter |
1.06 |
E2E_Compiler_omnisharp |
6416246.5779824965 ns/iter |
6346915.828829027 ns/iter |
1.01 |
E2E_Compiler_openapi |
24457500.321424115 ns/iter |
24352601.724135168 ns/iter |
1.00 |
E2E_Compiler_pre_commit_hooks |
4967831.886523663 ns/iter |
4891943.295774582 ns/iter |
1.02 |
E2E_Compiler_pulumi |
3841157.699453802 ns/iter |
3778824.231182371 ns/iter |
1.02 |
E2E_Compiler_semantic_release |
1468861.4728032285 ns/iter |
1454236.376299366 ns/iter |
1.01 |
E2E_Compiler_stale |
1480971.7579615826 ns/iter |
1462117.9382977951 ns/iter |
1.01 |
E2E_Compiler_stylecop |
5919773.111110352 ns/iter |
5828898.274999498 ns/iter |
1.02 |
E2E_Compiler_tmuxinator |
1807075.765464223 ns/iter |
1782231.4554706435 ns/iter |
1.01 |
E2E_Compiler_ui5 |
47680968.6666608 ns/iter |
48291383.06666513 ns/iter |
0.99 |
E2E_Compiler_ui5_manifest |
328718525.5001077 ns/iter |
318606125.4999686 ns/iter |
1.03 |
E2E_Compiler_unreal_engine_uproject |
4388581.194968177 ns/iter |
4310182.722222488 ns/iter |
1.02 |
E2E_Compiler_users_array |
805530.4170507924 ns/iter |
792372.2751983141 ns/iter |
1.02 |
E2E_Compiler_vercel |
12398425.803569678 ns/iter |
12279703.315790245 ns/iter |
1.01 |
E2E_Compiler_yamllint |
324808.14531100605 ns/iter |
318271.2396544241 ns/iter |
1.02 |
E2E_Evaluator_adaptivecard |
25619.80226686729 ns/iter |
25054.573511497045 ns/iter |
1.02 |
E2E_Evaluator_ansible_meta |
258383.54725194597 ns/iter |
234945.8326653586 ns/iter |
1.10 |
E2E_Evaluator_aws_cdk |
53516.54179208404 ns/iter |
52319.96568702502 ns/iter |
1.02 |
E2E_Evaluator_babelrc |
116794.58525191338 ns/iter |
116288.05878498674 ns/iter |
1.00 |
E2E_Evaluator_cerebrum_criminal_case |
1011453.1014495157 ns/iter |
1007171.4063400923 ns/iter |
1.00 |
E2E_Evaluator_clang_format |
116945.10886758694 ns/iter |
119080.71080850936 ns/iter |
0.98 |
E2E_Evaluator_cmake_presets |
6124413.955356138 ns/iter |
4951546.944445549 ns/iter |
1.24 |
E2E_Evaluator_code_climate |
186551.4916334604 ns/iter |
181847.39937436036 ns/iter |
1.03 |
E2E_Evaluator_cql2 |
214248.34778622253 ns/iter |
212886.1939116709 ns/iter |
1.01 |
E2E_Evaluator_cspell |
593213.2969958577 ns/iter |
584018.3701842643 ns/iter |
1.02 |
E2E_Evaluator_cypress |
191758.88121245021 ns/iter |
193297.7731301868 ns/iter |
0.99 |
E2E_Evaluator_deno |
327726.64058106195 ns/iter |
317963.1501849159 ns/iter |
1.03 |
E2E_Evaluator_dependabot |
328525.95870485227 ns/iter |
332220.5854701178 ns/iter |
0.99 |
E2E_Evaluator_draft_04 |
9938397.573528297 ns/iter |
10016647.718749994 ns/iter |
0.99 |
E2E_Evaluator_fabric_mod |
685024.8966861417 ns/iter |
678052.3027614247 ns/iter |
1.01 |
E2E_Evaluator_geojson |
17598753.66666655 ns/iter |
17230260.85366056 ns/iter |
1.02 |
E2E_Evaluator_gitpod_configuration |
241300.6686186772 ns/iter |
235112.75000000763 ns/iter |
1.03 |
E2E_Evaluator_helm_chart_lock |
316826.4570523769 ns/iter |
318092.992763434 ns/iter |
1.00 |
E2E_Evaluator_importmap |
51728.21233480325 ns/iter |
50950.02077064445 ns/iter |
1.02 |
E2E_Evaluator_jasmine |
106498.06435493019 ns/iter |
105865.13667766817 ns/iter |
1.01 |
E2E_Evaluator_jshintrc |
1198012.8051280377 ns/iter |
1203612.65694719 ns/iter |
1.00 |
E2E_Evaluator_jsconfig |
428262.92279418046 ns/iter |
422582.31585299224 ns/iter |
1.01 |
E2E_Evaluator_krakend |
213574.1233587743 ns/iter |
207224.80660514455 ns/iter |
1.03 |
E2E_Evaluator_lazygit |
151168.27552113263 ns/iter |
147776.59827626072 ns/iter |
1.02 |
E2E_Evaluator_lerna |
136492.83489829506 ns/iter |
138016.44192069845 ns/iter |
0.99 |
E2E_Evaluator_nest_cli |
185653.90928555524 ns/iter |
189532.11701848634 ns/iter |
0.98 |
E2E_Evaluator_omc |
19498.622632723207 ns/iter |
18369.67896873605 ns/iter |
1.06 |
E2E_Evaluator_omnisharp |
625955.7654214409 ns/iter |
616918.6800699682 ns/iter |
1.01 |
E2E_Evaluator_openapi |
10469251.808217451 ns/iter |
9814189.465755153 ns/iter |
1.07 |
E2E_Evaluator_pre_commit_hooks |
490891.681149212 ns/iter |
482999.38286116073 ns/iter |
1.02 |
E2E_Evaluator_pulumi |
681692.7926949488 ns/iter |
690204.6792453082 ns/iter |
0.99 |
E2E_Evaluator_semantic_release |
104386.47551528127 ns/iter |
102216.5188855226 ns/iter |
1.02 |
E2E_Evaluator_stale |
151198.7664952963 ns/iter |
149455.4061969462 ns/iter |
1.01 |
E2E_Evaluator_stylecop |
306703.73722623655 ns/iter |
288247.8923894788 ns/iter |
1.06 |
E2E_Evaluator_tmuxinator |
99819.78790035693 ns/iter |
99063.9679369869 ns/iter |
1.01 |
E2E_Evaluator_ui5 |
544650.5105058276 ns/iter |
522542.6353550082 ns/iter |
1.04 |
E2E_Evaluator_ui5_manifest |
2668168.7680608877 ns/iter |
2609686.0846153577 ns/iter |
1.02 |
E2E_Evaluator_unreal_engine_uproject |
428152.6627977445 ns/iter |
435708.3910336335 ns/iter |
0.98 |
E2E_Evaluator_users_array |
580709.0216125423 ns/iter |
580214.6310844674 ns/iter |
1.00 |
E2E_Evaluator_vercel |
329383.0945626003 ns/iter |
316735.4833183748 ns/iter |
1.04 |
E2E_Evaluator_yamllint |
8987.471751121533 ns/iter |
8630.21403300189 ns/iter |
1.04 |
Micro_Draft4_Meta_1_No_Callback |
194.0499428970147 ns/iter |
195.868628981265 ns/iter |
0.99 |
Micro_Draft4_Required_Properties |
800.6392705133323 ns/iter |
796.9447084451712 ns/iter |
1.00 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
25.081299715583175 ns/iter |
23.22464988172612 ns/iter |
1.08 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
11.54637008010211 ns/iter |
11.531256134312352 ns/iter |
1.00 |
Micro_Draft4_Items_Schema |
275.3888767754573 ns/iter |
274.68614711835846 ns/iter |
1.00 |
Micro_Draft4_Nested_Object |
1.8670446642043266 ns/iter |
1.79414950859428 ns/iter |
1.04 |
Micro_Draft4_Properties_Triad_Optional |
336.887424127134 ns/iter |
323.5867369958254 ns/iter |
1.04 |
Micro_Draft4_Properties_Triad_Closed |
277.65008252204734 ns/iter |
306.7075079545981 ns/iter |
0.91 |
Micro_Draft4_Properties_Triad_Required |
344.3057538598044 ns/iter |
348.8926334718486 ns/iter |
0.99 |
Micro_Draft4_Properties_Closed |
57.31901669705711 ns/iter |
57.309658575472575 ns/iter |
1.00 |
Micro_Draft4_Non_Recursive_Ref |
14.01306294412552 ns/iter |
13.96755682386976 ns/iter |
1.00 |
Micro_Draft4_Pattern_Properties_True |
155.63639950372718 ns/iter |
155.6659714642761 ns/iter |
1.00 |
Micro_Draft4_Ref_To_Single_Property |
11.537407159183445 ns/iter |
11.525903294183388 ns/iter |
1.00 |
Micro_Draft4_Additional_Properties_Type |
32.95348348295764 ns/iter |
32.981749886256395 ns/iter |
1.00 |
Micro_Draft4_Nested_Oneof |
58.88091087960544 ns/iter |
58.8389918145443 ns/iter |
1.00 |
Micro_Draft4_Short_Enum |
12.15821908592221 ns/iter |
9.97175260169451 ns/iter |
1.22 |
Micro_Draft4_Long_Enum |
16.09634292638607 ns/iter |
14.650534578206585 ns/iter |
1.10 |
Micro_Draft4_Long_Enum_Short_Strings |
12.14584443985536 ns/iter |
9.971100055161633 ns/iter |
1.22 |
Micro_Draft4_Type_Object |
3.4270983454678188 ns/iter |
3.430473026294138 ns/iter |
1.00 |
Micro_Draft4_Ref_Single_100 |
2401377.20962184 ns/iter |
2358714.5084171295 ns/iter |
1.02 |
Micro_Draft4_Compile_Ref_Many_Nested |
1731415.1940298919 ns/iter |
1714649.5207829222 ns/iter |
1.01 |
Micro_Draft4_Compile_Wrap |
2383267.804794766 ns/iter |
2355611.84175093 ns/iter |
1.01 |
Micro_Draft6_Property_Names |
123.26834029752311 ns/iter |
137.47932984198087 ns/iter |
0.90 |
Micro_Draft6_Compile_FHIR |
14964735532.99984 ns/iter |
14442920303.999926 ns/iter |
1.04 |
Micro_Draft7_If_Then_Else |
24.339408463344775 ns/iter |
24.009437569684902 ns/iter |
1.01 |
Micro_2019_09_Unevaluated_Properties |
27.823471614885587 ns/iter |
26.962875817689493 ns/iter |
1.03 |
Micro_2019_09_Compile_Wrap |
308604040.99996686 ns/iter |
294200171.9999325 ns/iter |
1.05 |
Micro_2020_12_Dynamic_Ref |
233.16074356946558 ns/iter |
234.33623086717182 ns/iter |
0.99 |
Micro_2020_12_Dynamic_Ref_Single |
3.4287746135820845 ns/iter |
3.427948869803089 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Mask |
1098.1613371707017 ns/iter |
1124.0518846549876 ns/iter |
0.98 |
Micro_2020_12_Simple_Output_Annotations |
112783.52374860705 ns/iter |
102743.66573241417 ns/iter |
1.10 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1048138.2529940287 ns/iter |
1036010.4697191132 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8420.349926472469 ns/iter |
8200.659244749364 ns/iter |
1.03 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
178937.8774209735 ns/iter |
173996.17020750634 ns/iter |
1.03 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
23213.282646873664 ns/iter |
22877.10845139221 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
166.45484730077587 ns/iter |
142.24616843615752 ns/iter |
1.17 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4516.64956859184 ns/iter |
4273.528375595556 ns/iter |
1.06 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
369120684.9999844 ns/iter |
369766489.49996614 ns/iter |
1.00 |
Alterschema_Check_Readibility_OMC |
85755400.12498096 ns/iter |
84150166.99999 ns/iter |
1.02 |
Alterschema_Check_Readibility_KrakenD |
1223297336.999849 ns/iter |
1174369705.0001173 ns/iter |
1.04 |
Alterschema_Apply_Readibility_KrakenD |
121795383375.00026 ns/iter |
118479401916.99991 ns/iter |
1.03 |
Alterschema_Check_Invalid_External_Refs |
304496029.500001 ns/iter |
304948371.0000231 ns/iter |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/llvm)
Details
| Benchmark suite | Current: 51e649b | Previous: 1dc7105 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
119754 ns |
116044 ns |
1.03 |
E2E_Evaluator_ansible-meta |
527807 ns |
518158 ns |
1.02 |
E2E_Evaluator_aws-cdk |
143418 ns |
146815 ns |
0.98 |
E2E_Evaluator_babelrc |
350021 ns |
353804 ns |
0.99 |
E2E_Evaluator_cerebrum-criminal-case |
2556857 ns |
2467911 ns |
1.04 |
E2E_Evaluator_clang-format |
262682 ns |
264040 ns |
0.99 |
E2E_Evaluator_cmake-presets |
18472100 ns |
18409293 ns |
1.00 |
E2E_Evaluator_code-climate |
509666 ns |
506138 ns |
1.01 |
E2E_Evaluator_cql2 |
1210083 ns |
1218319 ns |
0.99 |
E2E_Evaluator_cspell |
1517895 ns |
1481302 ns |
1.02 |
E2E_Evaluator_cypress |
778360 ns |
767365 ns |
1.01 |
E2E_Evaluator_deno |
1040025 ns |
1044859 ns |
1.00 |
E2E_Evaluator_dependabot |
1096347 ns |
1096149 ns |
1.00 |
E2E_Evaluator_draft-04 |
22340285 ns |
23692315 ns |
0.94 |
E2E_Evaluator_fabric-mod |
2389480 ns |
2417614 ns |
0.99 |
E2E_Evaluator_geojson |
27123640 ns |
25035426 ns |
1.08 |
E2E_Evaluator_gitpod-configuration |
736568 ns |
739667 ns |
1.00 |
E2E_Evaluator_helm-chart-lock |
996280 ns |
989430 ns |
1.01 |
E2E_Evaluator_importmap |
273851 ns |
279264 ns |
0.98 |
E2E_Evaluator_jasmine |
296457 ns |
305814 ns |
0.97 |
E2E_Evaluator_jsconfig |
1288018 ns |
1249845 ns |
1.03 |
E2E_Evaluator_jshintrc |
2832807 ns |
2794461 ns |
1.01 |
E2E_Evaluator_krakend |
708650 ns |
677175 ns |
1.05 |
E2E_Evaluator_lazygit |
518599 ns |
510843 ns |
1.02 |
E2E_Evaluator_lerna |
472266 ns |
474583 ns |
1.00 |
E2E_Evaluator_nest-cli |
602870 ns |
606921 ns |
0.99 |
E2E_Evaluator_omc |
93856 ns |
94019 ns |
1.00 |
E2E_Evaluator_omnisharp |
1435986 ns |
1418697 ns |
1.01 |
E2E_Evaluator_openapi |
25863516 ns |
25818560 ns |
1.00 |
E2E_Evaluator_pre-commit-hooks |
2036865 ns |
2045791 ns |
1.00 |
E2E_Evaluator_pulumi |
1948620 ns |
1921012 ns |
1.01 |
E2E_Evaluator_semantic-release |
254203 ns |
262668 ns |
0.97 |
E2E_Evaluator_stale |
397638 ns |
407074 ns |
0.98 |
E2E_Evaluator_stylecop |
1231782 ns |
1240364 ns |
0.99 |
E2E_Evaluator_tmuxinator |
232914 ns |
235185 ns |
0.99 |
E2E_Evaluator_ui5 |
2216925 ns |
2314729 ns |
0.96 |
E2E_Evaluator_ui5-manifest |
11131893 ns |
13831431 ns |
0.80 |
E2E_Evaluator_unreal-engine-uproject |
1511747 ns |
1567038 ns |
0.96 |
E2E_Evaluator_users-array |
2558086 ns |
2776398 ns |
0.92 |
E2E_Evaluator_vercel |
1020704 ns |
1029211 ns |
0.99 |
E2E_Evaluator_yamllint |
25809 ns |
25987 ns |
0.99 |
This comment was automatically generated by workflow using github-action-benchmark.
Signed-off-by: Juan Cruz Viotti jv@jviotti.com