Benchmark annotation dropping in SimpleOutput

[jviotti]

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

[augmentcode]

🤖 Augment PR Summary

Summary: This PR adds a new microbenchmark focused on measuring annotation collection/retraction behavior in sourcemeta::blaze::SimpleOutput.

Changes:

• Introduces Micro_2020_12_Simple_Output_Annotation_Dropping, constructing an array instance whose items validate against exactly one oneOf branch.
• Uses Mode::Exhaustive compilation to force evaluation of all branches, stressing the “collect then drop” annotation path.
• Adds required standard headers for std::size_t and std::int64_t.
• Registers the new benchmark in the benchmark list.

Technical Notes: The benchmark validates a fixed 512-element instance against a 2020-12 schema with title/description annotations on each branch to maximize annotation churn under exhaustive evaluation.

_{🤖 Was this summary useful? React with 👍 or 👎}

[augmentcode]

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

[github-actions]

Benchmark (macos/llvm)

Details

Benchmark suite	Current: ecedb9a	Previous: 4abcf44	Ratio
Schema_Iterator_ISO_Language	1890733.1137023063 ns/iter	2125742.681003375 ns/iter	0.89
Schema_Tracker_ISO_Language	3221215.1287550298 ns/iter	5903345.435483735 ns/iter	0.55
Schema_Tracker_ISO_Language_To_JSON	15998654.363636948 ns/iter	17775585.08333262 ns/iter	0.90
Schema_Frame_WoT_References	4943719.673468766 ns/iter	6844354.166667854 ns/iter	0.72
Schema_Frame_OMC_References	23554523.148146912 ns/iter	28156965.909095727 ns/iter	0.84
Schema_Frame_OMC_Locations	19331664.473686248 ns/iter	24772291.65384205 ns/iter	0.78
Schema_Frame_ISO_Language_Locations	76273444.44444539 ns/iter	74289906.24998732 ns/iter	1.03
Schema_Frame_KrakenD_References	41554263.00000187 ns/iter	50848753.23076141 ns/iter	0.82
Schema_Frame_KrakenD_Reachable	371097686.999974 ns/iter	418731875.50004333 ns/iter	0.89
Schema_Frame_ISO_Language_Locations_To_JSON	79374494.1428583 ns/iter	92083101.14286177 ns/iter	0.86
Schema_Frame_Many_Resources_References	272535729.0000261 ns/iter	346075750.0000682 ns/iter	0.79
Schema_Bundle_Meta_2020_12	1265116.2955738483 ns/iter	1373202.9682884822 ns/iter	0.92
Schema_Format_ISO_Language_To_JSON	74853777.66662773 ns/iter	78544729.00001496 ns/iter	0.95
E2E_Compiler_adaptivecard	51180682.69230382 ns/iter	57996937.49997914 ns/iter	0.88
E2E_Compiler_ansible_meta	20891493.852940693 ns/iter	25966265.300000183 ns/iter	0.80
E2E_Compiler_aws_cdk	243809.06105048215 ns/iter	280098.98237517267 ns/iter	0.87
E2E_Compiler_babelrc	1856634.7493037116 ns/iter	2070561.6234942998 ns/iter	0.90
E2E_Compiler_clang_format	13119210.69811287 ns/iter	14453060.000000732 ns/iter	0.91
E2E_Compiler_cmake_presets	21190850.99999748 ns/iter	26773908.962965194 ns/iter	0.79
E2E_Compiler_code_climate	1868499.8906668017 ns/iter	2053796.7645259553 ns/iter	0.91
E2E_Compiler_cql2	9868502.338029327 ns/iter	11257682.692310201 ns/iter	0.88
E2E_Compiler_cspell	18808472.97297498 ns/iter	18710577.37142629 ns/iter	1.01
E2E_Compiler_cypress	3040993.506493535 ns/iter	3383854.4688998596 ns/iter	0.90
E2E_Compiler_deno	5970515.368852695 ns/iter	6645594.798163809 ns/iter	0.90
E2E_Compiler_dependabot	3054823.2711860775 ns/iter	3431839.0243908386 ns/iter	0.89
E2E_Compiler_draft_04	1817451.6450702432 ns/iter	1871275.959893393 ns/iter	0.97
E2E_Compiler_fabric_mod	3169559.4954955825 ns/iter	4753435.233161265 ns/iter	0.67
E2E_Compiler_geojson	19255225.000000563 ns/iter	24116673.82758925 ns/iter	0.80
E2E_Compiler_gitpod_configuration	3474233.089108755 ns/iter	4489717.443750863 ns/iter	0.77
E2E_Compiler_helm_chart_lock	488241.7768698901 ns/iter	478137.413194525 ns/iter	1.02
E2E_Compiler_importmap	181237.37234044 ns/iter	227692.5164877597 ns/iter	0.80
E2E_Compiler_jasmine	889513.8716644862 ns/iter	990795.584045743 ns/iter	0.90
E2E_Compiler_jshintrc	2893771.090534868 ns/iter	3178566.3900412135 ns/iter	0.91
E2E_Compiler_jsconfig	15874040.727272712 ns/iter	19215731.820511978 ns/iter	0.83
E2E_Compiler_krakend	112659555.50000702 ns/iter	131428275.00000748 ns/iter	0.86
E2E_Compiler_lazygit	28299415.000001315 ns/iter	39139387.23529582 ns/iter	0.72
E2E_Compiler_lerna	1116136.0971523947 ns/iter	1594063.9440714729 ns/iter	0.70
E2E_Compiler_nest_cli	5355783.39694793 ns/iter	9623782.686273944 ns/iter	0.56
E2E_Compiler_omc	142861216.6000221 ns/iter	203233166.6666778 ns/iter	0.70
E2E_Compiler_omnisharp	6098809.725000365 ns/iter	6567936.3170728 ns/iter	0.93
E2E_Compiler_openapi	19771924.750001643 ns/iter	23290043.10344913 ns/iter	0.85
E2E_Compiler_pre_commit_hooks	3983620.7700532484 ns/iter	4132475.1461990927 ns/iter	0.96
E2E_Compiler_pulumi	3186148.52586185 ns/iter	2947508.158333297 ns/iter	1.08
E2E_Compiler_semantic_release	1111992.759016533 ns/iter	1101489.4374034402 ns/iter	1.01
E2E_Compiler_stale	1052638.0859257053 ns/iter	1155943.1352202266 ns/iter	0.91
E2E_Compiler_stylecop	5242699.594404499 ns/iter	5437788.934307181 ns/iter	0.96
E2E_Compiler_tmuxinator	1421433.6304350558 ns/iter	1784932.5447572428 ns/iter	0.80
E2E_Compiler_ui5	49408020.85715339 ns/iter	49432562.500003636 ns/iter	1.00
E2E_Compiler_ui5_manifest	288667916.5000032 ns/iter	325968749.9999775 ns/iter	0.89
E2E_Compiler_unreal_engine_uproject	3345983.331817851 ns/iter	5610377.07999958 ns/iter	0.60
E2E_Compiler_users_array	680980.9542909053 ns/iter	1259451.0649089457 ns/iter	0.54
E2E_Compiler_vercel	10511028.176468326 ns/iter	13885295.518518971 ns/iter	0.76
E2E_Compiler_yamllint	253349.49192755265 ns/iter	247386.13659696598 ns/iter	1.02
E2E_Evaluator_adaptivecard	19656.93734163977 ns/iter	24521.02173303368 ns/iter	0.80
E2E_Evaluator_ansible_meta	167808.3293079674 ns/iter	193258.36085880906 ns/iter	0.87
E2E_Evaluator_aws_cdk	35975.10186491212 ns/iter	43891.32317037767 ns/iter	0.82
E2E_Evaluator_babelrc	80030.13729212228 ns/iter	105836.892386323 ns/iter	0.76
E2E_Evaluator_cerebrum_criminal_case	663113.4453479446 ns/iter	970384.0634441874 ns/iter	0.68
E2E_Evaluator_clang_format	92150.52845745983 ns/iter	134368.14982786888 ns/iter	0.69
E2E_Evaluator_cmake_presets	2924461.82008317 ns/iter	5088814.511110387 ns/iter	0.57
E2E_Evaluator_code_climate	120567.34517848675 ns/iter	193246.51178537044 ns/iter	0.62
E2E_Evaluator_cql2	133410.53048297772 ns/iter	238397.19512195402 ns/iter	0.56
E2E_Evaluator_cspell	391769.40256830596 ns/iter	645522.7118786623 ns/iter	0.61
E2E_Evaluator_cypress	132018.0374060222 ns/iter	166165.17637794357 ns/iter	0.79
E2E_Evaluator_deno	212572.73559013443 ns/iter	233482.0802761325 ns/iter	0.91
E2E_Evaluator_dependabot	221915.8684638074 ns/iter	251479.72436565164 ns/iter	0.88
E2E_Evaluator_draft_04	5220915.991870472 ns/iter	5488982.235292764 ns/iter	0.95
E2E_Evaluator_fabric_mod	434116.6720297001 ns/iter	481951.0180635327 ns/iter	0.90
E2E_Evaluator_geojson	8282386.764706055 ns/iter	11340227.526315367 ns/iter	0.73
E2E_Evaluator_gitpod_configuration	162043.87278386016 ns/iter	192780.58516412362 ns/iter	0.84
E2E_Evaluator_helm_chart_lock	202261.53421570393 ns/iter	266251.16744496743 ns/iter	0.76
E2E_Evaluator_importmap	33081.354805270465 ns/iter	37914.95299598009 ns/iter	0.87
E2E_Evaluator_jasmine	79045.18127266013 ns/iter	133067.334236029 ns/iter	0.59
E2E_Evaluator_jshintrc	868129.5199500581 ns/iter	1149852.5684211405 ns/iter	0.75
E2E_Evaluator_jsconfig	281938.2506005059 ns/iter	315839.3398567777 ns/iter	0.89
E2E_Evaluator_krakend	120301.27820333533 ns/iter	152958.00649930077 ns/iter	0.79
E2E_Evaluator_lazygit	87428.77649177742 ns/iter	92318.04805369771 ns/iter	0.95
E2E_Evaluator_lerna	107714.13661972566 ns/iter	128656.15166907103 ns/iter	0.84
E2E_Evaluator_nest_cli	121585.70722893119 ns/iter	136430.00927602584 ns/iter	0.89
E2E_Evaluator_omc	11972.040513075062 ns/iter	13928.28426644389 ns/iter	0.86
E2E_Evaluator_omnisharp	412982.18358035036 ns/iter	476832.7878787642 ns/iter	0.87
E2E_Evaluator_openapi	4683096.804510706 ns/iter	5817236.461539363 ns/iter	0.81
E2E_Evaluator_pre_commit_hooks	319062.3468261375 ns/iter	412531.4859763108 ns/iter	0.77
E2E_Evaluator_pulumi	470898.61368202214 ns/iter	588967.3599670758 ns/iter	0.80
E2E_Evaluator_semantic_release	66029.17425477316 ns/iter	78045.78654706995 ns/iter	0.85
E2E_Evaluator_stale	109913.89928283446 ns/iter	126831.34266885086 ns/iter	0.87
E2E_Evaluator_stylecop	175666.65609140307 ns/iter	222158.975843953 ns/iter	0.79
E2E_Evaluator_tmuxinator	63755.41980343016 ns/iter	80533.52765867332 ns/iter	0.79
E2E_Evaluator_ui5	336699.8496066845 ns/iter	435178.8161616073 ns/iter	0.77
E2E_Evaluator_ui5_manifest	1418025.386639879 ns/iter	3216494.4456142844 ns/iter	0.44
E2E_Evaluator_unreal_engine_uproject	323040.1123748786 ns/iter	458236.8352638189 ns/iter	0.70
E2E_Evaluator_users_array	372292.5905014208 ns/iter	518544.6556961976 ns/iter	0.72
E2E_Evaluator_vercel	212545.24504507167 ns/iter	285833.36828854884 ns/iter	0.74
E2E_Evaluator_yamllint	5986.980614589973 ns/iter	7456.31225859062 ns/iter	0.80
JSONLD_Catalog	49585259.615381666 ns/iter	66667685.54545011 ns/iter	0.74
Micro_Draft4_Meta_1_No_Callback	120.79478108561288 ns/iter	177.50078064216697 ns/iter	0.68
Micro_Draft4_Required_Properties	630.8841609394677 ns/iter	792.8633942208046 ns/iter	0.80
Micro_Draft4_Many_Optional_Properties_Minimal_Match	15.067374035159881 ns/iter	20.801885106122498 ns/iter	0.72
Micro_Draft4_Few_Optional_Properties_Minimal_Match	7.391967682616466 ns/iter	8.599294636632452 ns/iter	0.86
Micro_Draft4_Items_Schema	205.44441853233218 ns/iter	276.7493753665942 ns/iter	0.74
Micro_Draft4_Nested_Object	0.9411148263534816 ns/iter	0.9411616176217207 ns/iter	1.00
Micro_Draft4_Properties_Triad_Optional	189.3961766542435 ns/iter	243.54767921583368 ns/iter	0.78
Micro_Draft4_Properties_Triad_Closed	165.68092667760527 ns/iter	196.45636315288706 ns/iter	0.84
Micro_Draft4_Properties_Triad_Required	204.51951259939028 ns/iter	243.14985422735919 ns/iter	0.84
Micro_Draft4_Properties_Closed	38.93870065174761 ns/iter	60.62438330000077 ns/iter	0.64
Micro_Draft4_Non_Recursive_Ref	11.695407631152971 ns/iter	17.963326144292292 ns/iter	0.65
Micro_Draft4_Pattern_Properties_True	135.7183345731126 ns/iter	178.6867337485305 ns/iter	0.76
Micro_Draft4_Ref_To_Single_Property	7.371713791186285 ns/iter	9.297128712018 ns/iter	0.79
Micro_Draft4_Additional_Properties_Type	24.704716422233883 ns/iter	28.222662397287625 ns/iter	0.88
Micro_Draft4_Nested_Oneof	34.40570048874947 ns/iter	43.87820084526237 ns/iter	0.78
Micro_Draft4_Short_Enum	4.761233990700161 ns/iter	4.937985126786221 ns/iter	0.96
Micro_Draft4_Long_Enum	9.087453125180314 ns/iter	12.852891237279547 ns/iter	0.71
Micro_Draft4_Long_Enum_Short_Strings	6.087294886037575 ns/iter	7.275626017452115 ns/iter	0.84
Micro_Draft4_Type_Object	2.3416675193526713 ns/iter	2.6654192424706826 ns/iter	0.88
Micro_Draft4_Ref_Single_100	1619176.2440754436 ns/iter	1732538.0586590255 ns/iter	0.93
Micro_Draft4_Compile_Ref_Many_Nested	1129073.454838788 ns/iter	1304933.8531185589 ns/iter	0.87
Micro_Draft4_Compile_Wrap	1997468.4903048647 ns/iter	2106503.7899689544 ns/iter	0.95
Micro_Draft6_Property_Names	94.7864626254461 ns/iter	103.67459539321608 ns/iter	0.91
Micro_Draft6_Compile_FHIR	9619345666.999834 ns/iter	9459886459.000017 ns/iter	1.02
Micro_Draft7_If_Then_Else	15.444351927004048 ns/iter	16.93967910492856 ns/iter	0.91
Micro_2019_09_Unevaluated_Properties	25.096847390273123 ns/iter	24.68361718484458 ns/iter	1.02
Micro_2019_09_Compile_Wrap	259664055.66661403 ns/iter	276137395.99996734 ns/iter	0.94
Micro_2020_12_Dynamic_Ref	549.1370625039053 ns/iter	581.1775497893971 ns/iter	0.94
Micro_2020_12_Dynamic_Ref_Single	2.239543529751168 ns/iter	2.335959491845665 ns/iter	0.96
Micro_2020_12_Simple_Output_Mask	790.555175670895 ns/iter	734.8096832875467 ns/iter	1.08
Micro_2020_12_Simple_Output_Annotations	82124.40684317968 ns/iter	84550.02438476786 ns/iter	0.97
Micro_2020_12_Simple_Output_Annotation_Dropping	12510107.142856797 ns/iter	13063572.72727093 ns/iter	0.96
Micro_2020_12_Compile_NonCircular_Shared_Refs	738819.1032720483 ns/iter	759626.3325714451 ns/iter	0.97
Micro_2020_12_Exhaustive_Deep_Numeric	4556.013307132177 ns/iter	4926.923284127535 ns/iter	0.92
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	130534.4039710068 ns/iter	111007.04960286902 ns/iter	1.18
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	13739.378237751522 ns/iter	14558.05781033537 ns/iter	0.94
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	81.42594777515431 ns/iter	91.85767819118078 ns/iter	0.89
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4396.583248888529 ns/iter	4477.71912112123 ns/iter	0.98
Alterschema_Check_Readibility_ISO_Language_Set_3	205852139.00001994 ns/iter	221695041.666635 ns/iter	0.93
Alterschema_Check_Readibility_OMC	50995249.99999566 ns/iter	50986858.92308962 ns/iter	1.00
Alterschema_Check_Readibility_KrakenD	564125749.9999028 ns/iter	562485333.0000405 ns/iter	1.00
Alterschema_Apply_Readibility_KrakenD	61963957208.00001 ns/iter	68845714332.99994 ns/iter	0.90
Alterschema_Check_Invalid_External_Refs	143214983.4000029 ns/iter	163598187.49998567 ns/iter	0.88

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (macos/llvm)

Details

Benchmark suite	Current: ecedb9a	Previous: 4abcf44	Ratio
E2E_Evaluator_adaptivecard	91147 ns	133674 ns	0.68
E2E_Evaluator_ansible-meta	323627 ns	437870 ns	0.74
E2E_Evaluator_aws-cdk	108703 ns	135560 ns	0.80
E2E_Evaluator_babelrc	273079 ns	337006 ns	0.81
E2E_Evaluator_cerebrum-criminal-case	1548844 ns	2432959 ns	0.64
E2E_Evaluator_clang-format	173936 ns	294464 ns	0.59
E2E_Evaluator_cmake-presets	11057481 ns	20880372 ns	0.53
E2E_Evaluator_code-climate	359570 ns	496399 ns	0.72
E2E_Evaluator_cql2	945726 ns	1344933 ns	0.70
E2E_Evaluator_cspell	1026022 ns	1866596 ns	0.55
E2E_Evaluator_cypress	530871 ns	1029938 ns	0.52
E2E_Evaluator_deno	602276 ns	1465116 ns	0.41
E2E_Evaluator_dependabot	692304 ns	1121349 ns	0.62
E2E_Evaluator_draft-04	13814209 ns	19519419 ns	0.71
E2E_Evaluator_fabric-mod	1332936 ns	2357816 ns	0.57
E2E_Evaluator_geojson	18888721 ns	24682744 ns	0.77
E2E_Evaluator_gitpod-configuration	499101 ns	685557 ns	0.73
E2E_Evaluator_helm-chart-lock	926866 ns	1026466 ns	0.90
E2E_Evaluator_importmap	200729 ns	298995 ns	0.67
E2E_Evaluator_jasmine	197454 ns	240254 ns	0.82
E2E_Evaluator_jsconfig	783394 ns	1217185 ns	0.64
E2E_Evaluator_jshintrc	1836463 ns	2628744 ns	0.70
E2E_Evaluator_krakend	414602 ns	566516 ns	0.73
E2E_Evaluator_lazygit	264371 ns	524451 ns	0.50
E2E_Evaluator_lerna	296003 ns	430366 ns	0.69
E2E_Evaluator_nest-cli	391561 ns	545571 ns	0.72
E2E_Evaluator_omc	70801 ns	87782 ns	0.81
E2E_Evaluator_omnisharp	895094 ns	1230182 ns	0.73
E2E_Evaluator_openapi	14043605 ns	19504744 ns	0.72
E2E_Evaluator_pre-commit-hooks	1400530 ns	2612677 ns	0.54
E2E_Evaluator_pulumi	1297633 ns	2488450 ns	0.52
E2E_Evaluator_semantic-release	163539 ns	218514 ns	0.75
E2E_Evaluator_stale	271683 ns	337296 ns	0.81
E2E_Evaluator_stylecop	679096 ns	938018 ns	0.72
E2E_Evaluator_tmuxinator	150359 ns	195284 ns	0.77
E2E_Evaluator_ui5	1412928 ns	2691081 ns	0.53
E2E_Evaluator_ui5-manifest	7936739 ns	13534073 ns	0.59
E2E_Evaluator_unreal-engine-uproject	1062727 ns	1712795 ns	0.62
E2E_Evaluator_users-array	1982191 ns	3038811 ns	0.65
E2E_Evaluator_vercel	702019 ns	865090 ns	0.81
E2E_Evaluator_yamllint	22100 ns	24203 ns	0.91

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/llvm)

Details

Benchmark suite	Current: ecedb9a	Previous: 4abcf44	Ratio
Schema_Iterator_ISO_Language	2999336.330434665 ns/iter	2987123.905983127 ns/iter	1.00
Schema_Tracker_ISO_Language	4458147.74358939 ns/iter	4455286.171973474 ns/iter	1.00
Schema_Tracker_ISO_Language_To_JSON	20719680.94117651 ns/iter	20823385.757577136 ns/iter	1.00
Schema_Frame_WoT_References	4514989.090908968 ns/iter	4555876.144736789 ns/iter	0.99
Schema_Frame_OMC_References	19225941.333334934 ns/iter	19439899.722221475 ns/iter	0.99
Schema_Frame_OMC_Locations	17844851.149999388 ns/iter	18082525.38461229 ns/iter	0.99
Schema_Frame_ISO_Language_Locations	96921914.00000638 ns/iter	99518912.33333755 ns/iter	0.97
Schema_Frame_KrakenD_References	36355690.894735835 ns/iter	37705950.89474084 ns/iter	0.96
Schema_Frame_KrakenD_Reachable	546976217.9999406 ns/iter	564465600.000176 ns/iter	0.97
Schema_Frame_ISO_Language_Locations_To_JSON	114324322.39998889 ns/iter	116783899.39997943 ns/iter	0.98
Schema_Frame_Many_Resources_References	333640903.99999213 ns/iter	347342569.99990976 ns/iter	0.96
Schema_Bundle_Meta_2020_12	1455922.2676343515 ns/iter	1481273.9957798594 ns/iter	0.98
Schema_Format_ISO_Language_To_JSON	105963239.71430722 ns/iter	107248633.71423712 ns/iter	0.99
E2E_Compiler_adaptivecard	56169434.69230871 ns/iter	56396415.333324514 ns/iter	1.00
E2E_Compiler_ansible_meta	24890180.53571255 ns/iter	25140624.99999779 ns/iter	0.99
E2E_Compiler_aws_cdk	328013.2241215443 ns/iter	329246.50094160286 ns/iter	1.00
E2E_Compiler_babelrc	2303754.671052541 ns/iter	2324848.04318938 ns/iter	0.99
E2E_Compiler_clang_format	16217567.441860283 ns/iter	16393372.906979367 ns/iter	0.99
E2E_Compiler_cmake_presets	25293220.60714532 ns/iter	25515726.666669626 ns/iter	0.99
E2E_Compiler_code_climate	2303651.016447361 ns/iter	2321286.188741595 ns/iter	0.99
E2E_Compiler_cql2	12708990.67272818 ns/iter	12807021.127272576 ns/iter	0.99
E2E_Compiler_cspell	22519130.67741938 ns/iter	22767605.838709876 ns/iter	0.99
E2E_Compiler_cypress	3925268.0893856427 ns/iter	3972840.4147738996 ns/iter	0.99
E2E_Compiler_deno	7055893.383839055 ns/iter	7142504.765304656 ns/iter	0.99
E2E_Compiler_dependabot	3502989.432160516 ns/iter	3543010.4517760305 ns/iter	0.99
E2E_Compiler_draft_04	2420328.667819855 ns/iter	2453345.059648838 ns/iter	0.99
E2E_Compiler_fabric_mod	4233554.369697037 ns/iter	4301289.644171799 ns/iter	0.98
E2E_Compiler_geojson	19960954.400000576 ns/iter	20220510.48571874 ns/iter	0.99
E2E_Compiler_gitpod_configuration	4505780.74193521 ns/iter	4570402.15032708 ns/iter	0.99
E2E_Compiler_helm_chart_lock	617396.9876106164 ns/iter	627842.0625558258 ns/iter	0.98
E2E_Compiler_importmap	245136.5536842132 ns/iter	247506.6128005797 ns/iter	0.99
E2E_Compiler_jasmine	1211222.3182610094 ns/iter	1226979.257495336 ns/iter	0.99
E2E_Compiler_jshintrc	3874467.4088398493 ns/iter	3923983.780899444 ns/iter	0.99
E2E_Compiler_jsconfig	20012108.65714386 ns/iter	20059292.228571784 ns/iter	1.00
E2E_Compiler_krakend	136025638.80001527 ns/iter	138989140.80000395 ns/iter	0.98
E2E_Compiler_lazygit	29904475.521739777 ns/iter	30383112.173912313 ns/iter	0.98
E2E_Compiler_lerna	1427097.0858895616 ns/iter	1453277.0041490858 ns/iter	0.98
E2E_Compiler_nest_cli	6657307.7238098495 ns/iter	6745405.769230763 ns/iter	0.99
E2E_Compiler_omc	146078438.2000156 ns/iter	148421773.6000119 ns/iter	0.98
E2E_Compiler_omnisharp	5990051.205128857 ns/iter	6070100.982608141 ns/iter	0.99
E2E_Compiler_openapi	22654962.387091912 ns/iter	22933686.032259967 ns/iter	0.99
E2E_Compiler_pre_commit_hooks	4646032.490067505 ns/iter	4702220.483222357 ns/iter	0.99
E2E_Compiler_pulumi	3596866.635898084 ns/iter	3649127.942708219 ns/iter	0.99
E2E_Compiler_semantic_release	1372717.7788651928 ns/iter	1393579.7709164724 ns/iter	0.99
E2E_Compiler_stale	1392700.2738096379 ns/iter	1412064.179435348 ns/iter	0.99
E2E_Compiler_stylecop	5224669.223880755 ns/iter	5288566.646616968 ns/iter	0.99
E2E_Compiler_tmuxinator	1687463.336538669 ns/iter	1706695.7690418276 ns/iter	0.99
E2E_Compiler_ui5	46150937.86666572 ns/iter	46133997.86667287 ns/iter	1.00
E2E_Compiler_ui5_manifest	298244310.9999622 ns/iter	301239866.9999357 ns/iter	0.99
E2E_Compiler_unreal_engine_uproject	4111628.917647014 ns/iter	4143195.514792934 ns/iter	0.99
E2E_Compiler_users_array	781712.7480491381 ns/iter	788678.4029343693 ns/iter	0.99
E2E_Compiler_vercel	12084468.258618033 ns/iter	12177123.18965243 ns/iter	0.99
E2E_Compiler_yamllint	302955.88181818806 ns/iter	306314.42477108195 ns/iter	0.99
E2E_Evaluator_adaptivecard	26672.30198721302 ns/iter	27626.763702333472 ns/iter	0.97
E2E_Evaluator_ansible_meta	251812.20945457675 ns/iter	253007.72087211366 ns/iter	1.00
E2E_Evaluator_aws_cdk	54306.447152569075 ns/iter	54695.43234142684 ns/iter	0.99
E2E_Evaluator_babelrc	119371.07540089071 ns/iter	122263.83379263179 ns/iter	0.98
E2E_Evaluator_cerebrum_criminal_case	1046337.9370315353 ns/iter	1043225.1906202456 ns/iter	1.00
E2E_Evaluator_clang_format	121025.05510729666 ns/iter	120912.89241590592 ns/iter	1.00
E2E_Evaluator_cmake_presets	4421857.3773592515 ns/iter	4845717.048951215 ns/iter	0.91
E2E_Evaluator_code_climate	194274.8285946111 ns/iter	193283.30091188356 ns/iter	1.01
E2E_Evaluator_cql2	219412.5812151564 ns/iter	222073.29228346975 ns/iter	0.99
E2E_Evaluator_cspell	641947.0009208517 ns/iter	638736.6080587063 ns/iter	1.01
E2E_Evaluator_cypress	202848.99539304545 ns/iter	202611.93610870105 ns/iter	1.00
E2E_Evaluator_deno	329396.34640825033 ns/iter	335539.3880883814 ns/iter	0.98
E2E_Evaluator_dependabot	335955.3708353559 ns/iter	336742.62930622115 ns/iter	1.00
E2E_Evaluator_draft_04	8392794.83116647 ns/iter	10125030.27692359 ns/iter	0.83
E2E_Evaluator_fabric_mod	696582.1253792082 ns/iter	712212.5768057557 ns/iter	0.98
E2E_Evaluator_geojson	17101036.048782077 ns/iter	17688612.575000204 ns/iter	0.97
E2E_Evaluator_gitpod_configuration	245182.87291665314 ns/iter	247924.70342877653 ns/iter	0.99
E2E_Evaluator_helm_chart_lock	315840.13976563467 ns/iter	316729.6147913202 ns/iter	1.00
E2E_Evaluator_importmap	51262.821020383024 ns/iter	52923.411707684856 ns/iter	0.97
E2E_Evaluator_jasmine	114125.84439394531 ns/iter	115101.28966880865 ns/iter	0.99
E2E_Evaluator_jshintrc	1228021.4567900018 ns/iter	1231993.9735919076 ns/iter	1.00
E2E_Evaluator_jsconfig	445134.296485619 ns/iter	450757.8704297903 ns/iter	0.99
E2E_Evaluator_krakend	222486.96111285506 ns/iter	225457.9925445758 ns/iter	0.99
E2E_Evaluator_lazygit	153016.30794482492 ns/iter	160295.363161507 ns/iter	0.95
E2E_Evaluator_lerna	147296.8633592458 ns/iter	151411.33418803924 ns/iter	0.97
E2E_Evaluator_nest_cli	196134.93448560906 ns/iter	196368.1397758895 ns/iter	1.00
E2E_Evaluator_omc	19395.514395604063 ns/iter	19260.122316197325 ns/iter	1.01
E2E_Evaluator_omnisharp	625098.3580356109 ns/iter	625843.3949730097 ns/iter	1.00
E2E_Evaluator_openapi	9814367.643834325 ns/iter	10451587.930554576 ns/iter	0.94
E2E_Evaluator_pre_commit_hooks	501551.6280000156 ns/iter	501669.29343903647 ns/iter	1.00
E2E_Evaluator_pulumi	723786.1156186569 ns/iter	720205.2815040499 ns/iter	1.00
E2E_Evaluator_semantic_release	103421.88266747304 ns/iter	107570.06187565021 ns/iter	0.96
E2E_Evaluator_stale	181773.49000776283 ns/iter	161211.42269700163 ns/iter	1.13
E2E_Evaluator_stylecop	299918.41952055093 ns/iter	303970.88908223546 ns/iter	0.99
E2E_Evaluator_tmuxinator	101493.29605071247 ns/iter	102187.28454451932 ns/iter	0.99
E2E_Evaluator_ui5	553850.8290936914 ns/iter	561348.1735340407 ns/iter	0.99
E2E_Evaluator_ui5_manifest	2674967.8358784798 ns/iter	2642808.334600364 ns/iter	1.01
E2E_Evaluator_unreal_engine_uproject	455084.84705883317 ns/iter	461304.3617860162 ns/iter	0.99
E2E_Evaluator_users_array	573331.6828872687 ns/iter	573117.1932567529 ns/iter	1.00
E2E_Evaluator_vercel	326630.1545960729 ns/iter	328603.90832554566 ns/iter	0.99
E2E_Evaluator_yamllint	9623.986661742301 ns/iter	9542.377430151306 ns/iter	1.01
JSONLD_Catalog	63957766.63637001 ns/iter	66338878.60000414 ns/iter	0.96
Micro_Draft4_Meta_1_No_Callback	197.1047151055094 ns/iter	197.0632081850349 ns/iter	1.00
Micro_Draft4_Required_Properties	864.4206590653713 ns/iter	864.9368336864817 ns/iter	1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match	23.1620462760882 ns/iter	23.175976377846286 ns/iter	1.00
Micro_Draft4_Few_Optional_Properties_Minimal_Match	11.880003747940176 ns/iter	11.88368858156864 ns/iter	1.00
Micro_Draft4_Items_Schema	280.5746578513841 ns/iter	278.92044240291534 ns/iter	1.01
Micro_Draft4_Nested_Object	1.8164315145072567 ns/iter	1.867566397304767 ns/iter	0.97
Micro_Draft4_Properties_Triad_Optional	329.8961380909081 ns/iter	328.72436498336793 ns/iter	1.00
Micro_Draft4_Properties_Triad_Closed	270.7774794789572 ns/iter	268.8704878722048 ns/iter	1.01
Micro_Draft4_Properties_Triad_Required	345.2155257177422 ns/iter	345.67583804362744 ns/iter	1.00
Micro_Draft4_Properties_Closed	60.22266643454364 ns/iter	60.25350040095811 ns/iter	1.00
Micro_Draft4_Non_Recursive_Ref	14.374117995924076 ns/iter	14.39446408390468 ns/iter	1.00
Micro_Draft4_Pattern_Properties_True	146.34171802586147 ns/iter	146.45602634015418 ns/iter	1.00
Micro_Draft4_Ref_To_Single_Property	11.85618522493077 ns/iter	11.866921836653274 ns/iter	1.00
Micro_Draft4_Additional_Properties_Type	34.37327445189174 ns/iter	33.14225516043503 ns/iter	1.04
Micro_Draft4_Nested_Oneof	58.136270985279815 ns/iter	57.95409836748292 ns/iter	1.00
Micro_Draft4_Short_Enum	9.969948714811716 ns/iter	12.164217593571733 ns/iter	0.82
Micro_Draft4_Long_Enum	16.519025319663907 ns/iter	16.524297004729306 ns/iter	1.00
Micro_Draft4_Long_Enum_Short_Strings	9.967895549355958 ns/iter	12.16715134973265 ns/iter	0.82
Micro_Draft4_Type_Object	3.4615287266617454 ns/iter	3.4369565703540697 ns/iter	1.01
Micro_Draft4_Ref_Single_100	2360254.3074324834 ns/iter	2398185.6735390406 ns/iter	0.98
Micro_Draft4_Compile_Ref_Many_Nested	1714071.3504901151 ns/iter	1732507.7985075421 ns/iter	0.99
Micro_Draft4_Compile_Wrap	2327537.3189373137 ns/iter	2369424.9256753186 ns/iter	0.98
Micro_Draft6_Property_Names	126.98912705422414 ns/iter	127.2144406725819 ns/iter	1.00
Micro_Draft6_Compile_FHIR	14190756688.999954 ns/iter	14273714090.000113 ns/iter	0.99
Micro_Draft7_If_Then_Else	24.948877715365914 ns/iter	25.109282556021945 ns/iter	0.99
Micro_2019_09_Unevaluated_Properties	25.895647096724332 ns/iter	25.89799305532745 ns/iter	1.00
Micro_2019_09_Compile_Wrap	273452791.9999437 ns/iter	284082838.5000123 ns/iter	0.96
Micro_2020_12_Dynamic_Ref	708.5490833494107 ns/iter	707.2790399256307 ns/iter	1.00
Micro_2020_12_Dynamic_Ref_Single	3.4256771963033215 ns/iter	3.426633228101238 ns/iter	1.00
Micro_2020_12_Simple_Output_Mask	1072.8725235437273 ns/iter	1077.2604130525292 ns/iter	1.00
Micro_2020_12_Simple_Output_Annotations	109628.45407848 ns/iter	107855.93248428316 ns/iter	1.02
Micro_2020_12_Simple_Output_Annotation_Dropping	20397101.4857156 ns/iter	21119121.333330523 ns/iter	0.97
Micro_2020_12_Compile_NonCircular_Shared_Refs	978004.3245126329 ns/iter	987995.5375889569 ns/iter	0.99
Micro_2020_12_Exhaustive_Deep_Numeric	8193.407639390158 ns/iter	8281.848459762838 ns/iter	0.99
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	175630.6635023987 ns/iter	178684.4474688534 ns/iter	0.98
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	22498.9802936346 ns/iter	22620.312166921794 ns/iter	0.99
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	148.24875677237057 ns/iter	151.8112724774361 ns/iter	0.98
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4303.48447167073 ns/iter	4394.308278389137 ns/iter	0.98
Alterschema_Check_Readibility_ISO_Language_Set_3	364685125.5000456 ns/iter	372393235.9999935 ns/iter	0.98
Alterschema_Check_Readibility_OMC	82000440.37502608 ns/iter	85864674.62501445 ns/iter	0.95
Alterschema_Check_Readibility_KrakenD	1198309765.9999657 ns/iter	1217935540.9998608 ns/iter	0.98
Alterschema_Apply_Readibility_KrakenD	116722424197.00002 ns/iter	117158063317.99991 ns/iter	1.00
Alterschema_Check_Invalid_External_Refs	279555140.50006515 ns/iter	281810043.50005877 ns/iter	0.99

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/llvm)

Details

Benchmark suite	Current: ecedb9a	Previous: 4abcf44	Ratio
E2E_Evaluator_adaptivecard	118166 ns	117696 ns	1.00
E2E_Evaluator_ansible-meta	525263 ns	526878 ns	1.00
E2E_Evaluator_aws-cdk	149473 ns	153019 ns	0.98
E2E_Evaluator_babelrc	340311 ns	342512 ns	0.99
E2E_Evaluator_cerebrum-criminal-case	2456006 ns	2471551 ns	0.99
E2E_Evaluator_clang-format	261023 ns	263738 ns	0.99
E2E_Evaluator_cmake-presets	18376831 ns	17950981 ns	1.02
E2E_Evaluator_code-climate	512845 ns	509341 ns	1.01
E2E_Evaluator_cql2	1254786 ns	1188977 ns	1.06
E2E_Evaluator_cspell	1437860 ns	1472160 ns	0.98
E2E_Evaluator_cypress	763900 ns	772839 ns	0.99
E2E_Evaluator_deno	1011903 ns	1035905 ns	0.98
E2E_Evaluator_dependabot	1107920 ns	1104804 ns	1.00
E2E_Evaluator_draft-04	20303190 ns	20313904 ns	1.00
E2E_Evaluator_fabric-mod	2289010 ns	2285368 ns	1.00
E2E_Evaluator_geojson	21915398 ns	26242056 ns	0.84
E2E_Evaluator_gitpod-configuration	702268 ns	705839 ns	0.99
E2E_Evaluator_helm-chart-lock	987350 ns	1013688 ns	0.97
E2E_Evaluator_importmap	263112 ns	270692 ns	0.97
E2E_Evaluator_jasmine	289808 ns	298898 ns	0.97
E2E_Evaluator_jsconfig	1234003 ns	1237191 ns	1.00
E2E_Evaluator_jshintrc	2740194 ns	2800817 ns	0.98
E2E_Evaluator_krakend	674682 ns	675598 ns	1.00
E2E_Evaluator_lazygit	504134 ns	499923 ns	1.01
E2E_Evaluator_lerna	469862 ns	451292 ns	1.04
E2E_Evaluator_nest-cli	591262 ns	585494 ns	1.01
E2E_Evaluator_omc	99539 ns	96584 ns	1.03
E2E_Evaluator_omnisharp	1410287 ns	1401690 ns	1.01
E2E_Evaluator_openapi	23381046 ns	22577779 ns	1.04
E2E_Evaluator_pre-commit-hooks	2027381 ns	2000798 ns	1.01
E2E_Evaluator_pulumi	1881909 ns	1868107 ns	1.01
E2E_Evaluator_semantic-release	254070 ns	247093 ns	1.03
E2E_Evaluator_stale	395222 ns	392913 ns	1.01
E2E_Evaluator_stylecop	1210921 ns	1218471 ns	0.99
E2E_Evaluator_tmuxinator	229335 ns	228189 ns	1.01
E2E_Evaluator_ui5	2240091 ns	2235692 ns	1.00
E2E_Evaluator_ui5-manifest	10658033 ns	10526636 ns	1.01
E2E_Evaluator_unreal-engine-uproject	1516838 ns	1511024 ns	1.00
E2E_Evaluator_users-array	2875357 ns	2901520 ns	0.99
E2E_Evaluator_vercel	961129 ns	958136 ns	1.00
E2E_Evaluator_yamllint	25524 ns	25697 ns	0.99

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Details

Benchmark suite	Current: ecedb9a	Previous: 4abcf44	Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3	350031786.50003976 ns/iter	361982115.5000409 ns/iter	0.97
Alterschema_Check_Readibility_OMC	86353034.25000983 ns/iter	99091928.14286272 ns/iter	0.87
Alterschema_Check_Readibility_KrakenD	1255362552.9999409 ns/iter	1411719825.000091 ns/iter	0.89
Alterschema_Apply_Readibility_KrakenD	120261381413.99974 ns/iter	136635688453.00006 ns/iter	0.88
Alterschema_Check_Invalid_External_Refs	307902633.00002605 ns/iter	284678896.0000595 ns/iter	1.08
Micro_2020_12_Dynamic_Ref	858.5504626047255 ns/iter	825.3197522178807 ns/iter	1.04
Micro_2020_12_Dynamic_Ref_Single	4.683456943304513 ns/iter	4.589971460807352 ns/iter	1.02
Micro_2020_12_Simple_Output_Mask	1155.9095741161177 ns/iter	1103.300507606202 ns/iter	1.05
Micro_2020_12_Simple_Output_Annotations	116515.98798999263 ns/iter	102156.51929569997 ns/iter	1.14
Micro_2020_12_Simple_Output_Annotation_Dropping	18082527.33333295 ns/iter	15538911.266665107 ns/iter	1.16
Micro_2020_12_Compile_NonCircular_Shared_Refs	1088119.3534884048 ns/iter	1078893.9120372399 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric	8844.156412466447 ns/iter	8843.426458960608 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	173967.08024989057 ns/iter	164742.63754122434 ns/iter	1.06
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	25527.301463874766 ns/iter	26801.13686735424 ns/iter	0.95
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	153.56665006562162 ns/iter	161.95350084958108 ns/iter	0.95
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4803.092674953934 ns/iter	4603.008658812874 ns/iter	1.04
Micro_2019_09_Unevaluated_Properties	31.8136661743614 ns/iter	30.659594642162855 ns/iter	1.04
Micro_2019_09_Compile_Wrap	297632393.5000664 ns/iter	308445110.49997437 ns/iter	0.96
Micro_Draft7_If_Then_Else	24.697345541823275 ns/iter	25.255064461756845 ns/iter	0.98
Micro_Draft6_Property_Names	164.97404709035632 ns/iter	159.8137130185512 ns/iter	1.03
Micro_Draft6_Compile_FHIR	12861843469.999939 ns/iter	14239188093.999928 ns/iter	0.90
Micro_Draft4_Meta_1_No_Callback	180.15372187209098 ns/iter	184.20159742037725 ns/iter	0.98
Micro_Draft4_Required_Properties	889.6342815175367 ns/iter	905.6999028704915 ns/iter	0.98
Micro_Draft4_Many_Optional_Properties_Minimal_Match	21.712441622457092 ns/iter	22.175480177325213 ns/iter	0.98
Micro_Draft4_Few_Optional_Properties_Minimal_Match	16.223529495626508 ns/iter	16.202676871200172 ns/iter	1.00
Micro_Draft4_Items_Schema	324.4426815313721 ns/iter	296.61563141191056 ns/iter	1.09
Micro_Draft4_Nested_Object	2.1808567942988946 ns/iter	2.4618341321696695 ns/iter	0.89
Micro_Draft4_Properties_Triad_Optional	390.36865981603836 ns/iter	502.297168000041 ns/iter	0.78
Micro_Draft4_Properties_Triad_Closed	323.68429263952424 ns/iter	431.92023184495196 ns/iter	0.75
Micro_Draft4_Properties_Triad_Required	415.87682848718924 ns/iter	495.2453000079094 ns/iter	0.84
Micro_Draft4_Properties_Closed	66.36018969935193 ns/iter	65.01751253930946 ns/iter	1.02
Micro_Draft4_Non_Recursive_Ref	9.34089349881552 ns/iter	9.152069218725789 ns/iter	1.02
Micro_Draft4_Pattern_Properties_True	211.79934997820564 ns/iter	196.01496961699192 ns/iter	1.08
Micro_Draft4_Ref_To_Single_Property	16.517960939829383 ns/iter	16.198479884182962 ns/iter	1.02
Micro_Draft4_Additional_Properties_Type	14.318453707139048 ns/iter	15.142125177533963 ns/iter	0.95
Micro_Draft4_Nested_Oneof	64.76157478748519 ns/iter	65.08293145732472 ns/iter	1.00
Micro_Draft4_Short_Enum	14.664360613571093 ns/iter	14.558408155757313 ns/iter	1.01
Micro_Draft4_Long_Enum	13.406777087290813 ns/iter	13.018578010769465 ns/iter	1.03
Micro_Draft4_Long_Enum_Short_Strings	14.735263168815624 ns/iter	14.500889294582883 ns/iter	1.02
Micro_Draft4_Type_Object	5.005944209999598 ns/iter	4.9234812421459635 ns/iter	1.02
Micro_Draft4_Ref_Single_100	2468607.4260567296 ns/iter	2433289.097222118 ns/iter	1.01
Micro_Draft4_Compile_Ref_Many_Nested	1790335.8388746274 ns/iter	1803921.5386596008 ns/iter	0.99
Micro_Draft4_Compile_Wrap	2540300.3369566924 ns/iter	2563985.6131390072 ns/iter	0.99
JSONLD_Catalog	59488677.75000129 ns/iter	60132861.50000568 ns/iter	0.99
E2E_Compiler_adaptivecard	59879061.41666599 ns/iter	62622903.24999261 ns/iter	0.96
E2E_Compiler_ansible_meta	26938407.769228853 ns/iter	27782801.920002386 ns/iter	0.97
E2E_Compiler_aws_cdk	368176.5976768447 ns/iter	351824.50622824416 ns/iter	1.05
E2E_Compiler_babelrc	2479522.1660771966 ns/iter	2529589.714801564 ns/iter	0.98
E2E_Compiler_clang_format	17319367.67500315 ns/iter	17584152.25000363 ns/iter	0.98
E2E_Compiler_cmake_presets	26201555.888890114 ns/iter	27230208.269228432 ns/iter	0.96
E2E_Compiler_code_climate	2519237.620937916 ns/iter	2544255.4036362707 ns/iter	0.99
E2E_Compiler_cql2	13910008.360003302 ns/iter	14035799.539997242 ns/iter	0.99
E2E_Compiler_cspell	23336768.433334026 ns/iter	24141045.689655833 ns/iter	0.97
E2E_Compiler_cypress	4028686.12716681 ns/iter	4112518.1529410193 ns/iter	0.98
E2E_Compiler_deno	7612987.543478519 ns/iter	7785573.833333123 ns/iter	0.98
E2E_Compiler_dependabot	3770559.832431703 ns/iter	3847344.428571298 ns/iter	0.98
E2E_Compiler_draft_04	2685353.8352495967 ns/iter	2706501.7635656004 ns/iter	0.99
E2E_Compiler_fabric_mod	4587732.592105004 ns/iter	4725188.18000026 ns/iter	0.97
E2E_Compiler_geojson	21825966.87499938 ns/iter	22479438.54838248 ns/iter	0.97
E2E_Compiler_gitpod_configuration	4839392.089655215 ns/iter	4919308.104894349 ns/iter	0.98
E2E_Compiler_helm_chart_lock	667376.7926829514 ns/iter	639369.7186932412 ns/iter	1.04
E2E_Compiler_importmap	272229.13819876604 ns/iter	257265.5983156508 ns/iter	1.06
E2E_Compiler_jasmine	1318812.416510473 ns/iter	1329734.1650854186 ns/iter	0.99
E2E_Compiler_jshintrc	4116543.1941167563 ns/iter	4107200.600000236 ns/iter	1.00
E2E_Compiler_jsconfig	20797552.764707584 ns/iter	21426075.66667142 ns/iter	0.97
E2E_Compiler_krakend	135115774.80003327 ns/iter	139797852.80002943 ns/iter	0.97
E2E_Compiler_lazygit	31830818.59090593 ns/iter	33366740.571431194 ns/iter	0.95
E2E_Compiler_lerna	1551276.1507758326 ns/iter	1559291.3513514432 ns/iter	0.99
E2E_Compiler_nest_cli	7137774.724488198 ns/iter	7262089.873685048 ns/iter	0.98
E2E_Compiler_omc	157572312.50000814 ns/iter	166685809.99998996 ns/iter	0.95
E2E_Compiler_omnisharp	6379417.527271223 ns/iter	6472870.750001305 ns/iter	0.99
E2E_Compiler_openapi	25093726.892854255 ns/iter	25244294.750003908 ns/iter	0.99
E2E_Compiler_pre_commit_hooks	5035455.697841878 ns/iter	5091441.956203836 ns/iter	0.99
E2E_Compiler_pulumi	3906322.983145779 ns/iter	3956111.039772478 ns/iter	0.99
E2E_Compiler_semantic_release	1529814.791845642 ns/iter	1509333.0799139729 ns/iter	1.01
E2E_Compiler_stale	1493895.7510637804 ns/iter	1515990.069414124 ns/iter	0.99
E2E_Compiler_stylecop	5538396.428572389 ns/iter	5673621.2276430195 ns/iter	0.98
E2E_Compiler_tmuxinator	1855734.6366044502 ns/iter	1864890.696808477 ns/iter	1.00
E2E_Compiler_ui5	47435678.86666824 ns/iter	49672353.500000104 ns/iter	0.95
E2E_Compiler_ui5_manifest	307347753.9999203 ns/iter	324270645.5000644 ns/iter	0.95
E2E_Compiler_unreal_engine_uproject	4370134.249998614 ns/iter	4467190.617834562 ns/iter	0.98
E2E_Compiler_users_array	870507.4266171396 ns/iter	861889.7097170174 ns/iter	1.01
E2E_Compiler_vercel	12598889.696428323 ns/iter	12835496.870370325 ns/iter	0.98
E2E_Compiler_yamllint	341649.9300390795 ns/iter	325677.9976776745 ns/iter	1.05
E2E_Evaluator_adaptivecard	25735.705369416006 ns/iter	25489.25989235333 ns/iter	1.01
E2E_Evaluator_ansible_meta	286116.3575257659 ns/iter	261946.14339199377 ns/iter	1.09
E2E_Evaluator_aws_cdk	61857.61518719616 ns/iter	59531.0279858382 ns/iter	1.04
E2E_Evaluator_babelrc	116330.71384063212 ns/iter	99307.46177715893 ns/iter	1.17
E2E_Evaluator_cerebrum_criminal_case	1128364.929373772 ns/iter	1184610.2338984688 ns/iter	0.95
E2E_Evaluator_clang_format	110527.99067019457 ns/iter	97195.36398999124 ns/iter	1.14
E2E_Evaluator_cmake_presets	4671505.418918293 ns/iter	5101807.413043587 ns/iter	0.92
E2E_Evaluator_code_climate	228257.85001609745 ns/iter	199713.56457245207 ns/iter	1.14
E2E_Evaluator_cql2	225954.7604166535 ns/iter	208835.56276147586 ns/iter	1.08
E2E_Evaluator_cspell	616757.8000001509 ns/iter	578974.6677796931 ns/iter	1.07
E2E_Evaluator_cypress	188337.75501902695 ns/iter	156451.6617977614 ns/iter	1.20
E2E_Evaluator_deno	362382.29441878 ns/iter	296099.30180567416 ns/iter	1.22
E2E_Evaluator_dependabot	388054.37111111335 ns/iter	365957.0939809135 ns/iter	1.06
E2E_Evaluator_draft_04	8017084.666667935 ns/iter	10575207.377050007 ns/iter	0.76
E2E_Evaluator_fabric_mod	780018.7819800569 ns/iter	755404.9405941998 ns/iter	1.03
E2E_Evaluator_geojson	16991467.292682946 ns/iter	20206661.888892084 ns/iter	0.84
E2E_Evaluator_gitpod_configuration	268067.86419753527 ns/iter	239504.84769121447 ns/iter	1.12
E2E_Evaluator_helm_chart_lock	319291.48674590664 ns/iter	222120.02578983374 ns/iter	1.44
E2E_Evaluator_importmap	48993.121652362264 ns/iter	41162.543987752855 ns/iter	1.19
E2E_Evaluator_jasmine	126169.11923351152 ns/iter	119039.40319428839 ns/iter	1.06
E2E_Evaluator_jshintrc	1090726.623639074 ns/iter	1049516.400000054 ns/iter	1.04
E2E_Evaluator_jsconfig	438617.6205385304 ns/iter	405427.47004067036 ns/iter	1.08
E2E_Evaluator_krakend	219623.48011184053 ns/iter	197312.1472222298 ns/iter	1.11
E2E_Evaluator_lazygit	145367.60444080885 ns/iter	130698.47449740293 ns/iter	1.11
E2E_Evaluator_lerna	171744.96746364806 ns/iter	137081.1583432567 ns/iter	1.25
E2E_Evaluator_nest_cli	209636.10158821422 ns/iter	194639.47539615797 ns/iter	1.08
E2E_Evaluator_omc	18869.505789205105 ns/iter	18463.703883369453 ns/iter	1.02
E2E_Evaluator_omnisharp	635616.5547444136 ns/iter	550459.5712000082 ns/iter	1.15
E2E_Evaluator_openapi	10060008.234376028 ns/iter	13379489.939998167 ns/iter	0.75
E2E_Evaluator_pre_commit_hooks	553452.0284811246 ns/iter	498220.6929191512 ns/iter	1.11
E2E_Evaluator_pulumi	775915.5654565932 ns/iter	781361.6534091042 ns/iter	0.99
E2E_Evaluator_semantic_release	109849.21686747487 ns/iter	90746.03998430069 ns/iter	1.21
E2E_Evaluator_stale	173765.32805034038 ns/iter	172141.53594928922 ns/iter	1.01
E2E_Evaluator_stylecop	316320.2730576325 ns/iter	299246.8736431168 ns/iter	1.06
E2E_Evaluator_tmuxinator	110741.13805672468 ns/iter	98177.19465123561 ns/iter	1.13
E2E_Evaluator_ui5	588844.9890015615 ns/iter	559388.699278249 ns/iter	1.05
E2E_Evaluator_ui5_manifest	2969501.848739862 ns/iter	2905679.117154695 ns/iter	1.02
E2E_Evaluator_unreal_engine_uproject	497486.29083099286 ns/iter	459736.6228956303 ns/iter	1.08
E2E_Evaluator_users_array	654385.2950512535 ns/iter	689427.0480480209 ns/iter	0.95
E2E_Evaluator_vercel	336371.96201921755 ns/iter	283827.7866176874 ns/iter	1.19
E2E_Evaluator_yamllint	13076.897564153229 ns/iter	12343.150604430908 ns/iter	1.06
Schema_Format_ISO_Language_To_JSON	109916440.16663335 ns/iter	114855738.16662508 ns/iter	0.96
Schema_Bundle_Meta_2020_12	1722312.7592099486 ns/iter	1720137.6658503131 ns/iter	1.00
Schema_Frame_WoT_References	5029528.539998865 ns/iter	5203782.507463196 ns/iter	0.97
Schema_Frame_OMC_References	21170788.393936332 ns/iter	23603075.45161284 ns/iter	0.90
Schema_Frame_OMC_Locations	19550155.805556342 ns/iter	21577734.999993935 ns/iter	0.91
Schema_Frame_ISO_Language_Locations	102299242.57142946 ns/iter	106365193.00000405 ns/iter	0.96
Schema_Frame_KrakenD_References	37796086.210523516 ns/iter	42529810.29411358 ns/iter	0.89
Schema_Frame_KrakenD_Reachable	527247345.99996734 ns/iter	610679164.999965 ns/iter	0.86
Schema_Frame_ISO_Language_Locations_To_JSON	174285519.25002012 ns/iter	177104546.25000694 ns/iter	0.98
Schema_Frame_Many_Resources_References	370301889.9999506 ns/iter	382125141.9999499 ns/iter	0.97
Schema_Iterator_ISO_Language	3953380.6045196825 ns/iter	3798716.4615380284 ns/iter	1.04
Schema_Tracker_ISO_Language	5069055.289854459 ns/iter	5389127.523438119 ns/iter	0.94
Schema_Tracker_ISO_Language_To_JSON	26959141.192299705 ns/iter	26548997.53846306 ns/iter	1.02

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/gcc)

Details

Benchmark suite	Current: ecedb9a	Previous: 4abcf44	Ratio
E2E_Evaluator_adaptivecard	122650 ns	120136 ns	1.02
E2E_Evaluator_ansible-meta	525684 ns	545564 ns	0.96
E2E_Evaluator_aws-cdk	145015 ns	129323 ns	1.12
E2E_Evaluator_babelrc	336387 ns	345015 ns	0.97
E2E_Evaluator_cerebrum-criminal-case	2406218 ns	2685992 ns	0.90
E2E_Evaluator_clang-format	251638 ns	261966 ns	0.96
E2E_Evaluator_cmake-presets	17039567 ns	18562042 ns	0.92
E2E_Evaluator_code-climate	528020 ns	496459 ns	1.06
E2E_Evaluator_cql2	1294320 ns	1224948 ns	1.06
E2E_Evaluator_cspell	1486243 ns	1629292 ns	0.91
E2E_Evaluator_cypress	779345 ns	826197 ns	0.94
E2E_Evaluator_deno	1059124 ns	1072745 ns	0.99
E2E_Evaluator_dependabot	1123909 ns	1138175 ns	0.99
E2E_Evaluator_draft-04	20349019 ns	21911960 ns	0.93
E2E_Evaluator_fabric-mod	2333979 ns	2476255 ns	0.94
E2E_Evaluator_geojson	22785042 ns	25734733 ns	0.89
E2E_Evaluator_gitpod-configuration	713164 ns	726427 ns	0.98
E2E_Evaluator_helm-chart-lock	1013146 ns	996111 ns	1.02
E2E_Evaluator_importmap	265788 ns	261385 ns	1.02
E2E_Evaluator_jasmine	298692 ns	281708 ns	1.06
E2E_Evaluator_jsconfig	1239243 ns	1489071 ns	0.83
E2E_Evaluator_jshintrc	2734212 ns	2869081 ns	0.95
E2E_Evaluator_krakend	679165 ns	650496 ns	1.04
E2E_Evaluator_lazygit	501075 ns	459901 ns	1.09
E2E_Evaluator_lerna	472979 ns	446110 ns	1.06
E2E_Evaluator_nest-cli	607562 ns	607235 ns	1.00
E2E_Evaluator_omc	100272 ns	96836 ns	1.04
E2E_Evaluator_omnisharp	1422194 ns	1470251 ns	0.97
E2E_Evaluator_openapi	23634443 ns	25701388 ns	0.92
E2E_Evaluator_pre-commit-hooks	2007581 ns	2082040 ns	0.96
E2E_Evaluator_pulumi	1891095 ns	2049915 ns	0.92
E2E_Evaluator_semantic-release	251060 ns	223850 ns	1.12
E2E_Evaluator_stale	406312 ns	373641 ns	1.09
E2E_Evaluator_stylecop	1148150 ns	1199769 ns	0.96
E2E_Evaluator_tmuxinator	228443 ns	220655 ns	1.04
E2E_Evaluator_ui5	2171664 ns	2219983 ns	0.98
E2E_Evaluator_ui5-manifest	10935186 ns	10782033 ns	1.01
E2E_Evaluator_unreal-engine-uproject	1504592 ns	1616442 ns	0.93
E2E_Evaluator_users-array	3052431 ns	2902147 ns	1.05
E2E_Evaluator_vercel	952970 ns	1057806 ns	0.90
E2E_Evaluator_yamllint	26432 ns	23896 ns	1.11

This comment was automatically generated by workflow using github-action-benchmark.