Add many more Draft 3 trace tests

[jviotti]

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

[cubic-dev-ai]

No issues found across 1 file

[augmentcode]

🤖 Augment PR Summary

Summary: This PR significantly expands the Draft-03 evaluator trace suite to cover more keywords and edge cases.

Changes:

• Adds `pattern` cases (match, mismatch, and ignored-on-non-string behavior).
• Adds extensive `patternProperties` coverage, including nested patternProperties and interactions with `additionalProperties`.
• Adds array keyword coverage for `items` (schema + tuple forms), `additionalItems`, and `uniqueItems`.
• Adds string length constraints (`minLength`, `maxLength`) including combined type+length “bounded” fast paths.
• Adds array size constraints (`minItems`, `maxItems`) including bounded fast paths.
• Adds numeric bounds (`minimum`/`maximum`) plus `exclusiveMinimum`/`exclusiveMaximum`, including very large integer values.
• Adds metadata/annotation-only and `format: uri` cases to ensure these remain non-asserting in this trace suite.

Technical Notes: New cases include expected traces for both fast and exhaustive modes (or empty traces when the keyword is intentionally ignored for the instance type).

_{🤖 Was this summary useful? React with 👍 or 👎}

[augmentcode]

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

[github-actions]

Benchmark (linux/llvm)

Details

Benchmark suite	Current: 6c8a118	Previous: 9ded71e	Ratio
E2E_Compiler_adaptivecard	64430061.666674495 ns/iter	62817419.4444379 ns/iter	1.03
E2E_Compiler_ansible_meta	29602406.1249985 ns/iter	29201386.583333526 ns/iter	1.01
E2E_Compiler_aws_cdk	396289.0788876155 ns/iter	386606.35927154665 ns/iter	1.03
E2E_Compiler_babelrc	2685671.4790874873 ns/iter	2673889.524163605 ns/iter	1.00
E2E_Compiler_clang_format	18884170.513514176 ns/iter	18592287.89473826 ns/iter	1.02
E2E_Compiler_cmake_presets	28472867.086955614 ns/iter	25953876.29629739 ns/iter	1.10
E2E_Compiler_code_climate	2688482.532566731 ns/iter	2619794.367041159 ns/iter	1.03
E2E_Compiler_cql2	13483472.326922853 ns/iter	12922243.777777735 ns/iter	1.04
E2E_Compiler_cspell	23236069.413793176 ns/iter	22958669.400001477 ns/iter	1.01
E2E_Compiler_cypress	4004465.434285781 ns/iter	4008340.789772676 ns/iter	1.00
E2E_Compiler_deno	7927564.784090825 ns/iter	7765829.033333679 ns/iter	1.02
E2E_Compiler_dependabot	4019122.55172362 ns/iter	4020655.545454459 ns/iter	1.00
E2E_Compiler_draft_04	2748004.4000002653 ns/iter	2703755.0000000806 ns/iter	1.02
E2E_Compiler_fabric_mod	4875013.368055489 ns/iter	4814891.882758808 ns/iter	1.01
E2E_Compiler_geojson	22351440.258064266 ns/iter	22088720.343749203 ns/iter	1.01
E2E_Compiler_gitpod_configuration	5018239.12949633 ns/iter	4947009.099290758 ns/iter	1.01
E2E_Compiler_helm_chart_lock	727165.7995847218 ns/iter	716097.4928570813 ns/iter	1.02
E2E_Compiler_importmap	296623.6731748852 ns/iter	289364.83340225636 ns/iter	1.03
E2E_Compiler_jasmine	1401212.1084336406 ns/iter	1376891.325443802 ns/iter	1.02
E2E_Compiler_jshintrc	4477814.852564075 ns/iter	4426727.679245078 ns/iter	1.01
E2E_Compiler_jsconfig	22495563.483868953 ns/iter	21995732.375000186 ns/iter	1.02
E2E_Compiler_krakend	142268247.39998847 ns/iter	140925172.3999887 ns/iter	1.01
E2E_Compiler_lazygit	33938298.14285709 ns/iter	33413637.190473568 ns/iter	1.02
E2E_Compiler_lerna	1648178.9481129793 ns/iter	1628716.9907190874 ns/iter	1.01
E2E_Compiler_nest_cli	7636145.260868904 ns/iter	7665936.204301043 ns/iter	1.00
E2E_Compiler_omc	155418638.250012 ns/iter	155028318.0000065 ns/iter	1.00
E2E_Compiler_omnisharp	6907164.019802585 ns/iter	6802082.766990212 ns/iter	1.02
E2E_Compiler_openapi	25419898.96296518 ns/iter	25006098.0357156 ns/iter	1.02
E2E_Compiler_pre_commit_hooks	5444529.187499825 ns/iter	5361162.0687027825 ns/iter	1.02
E2E_Compiler_pulumi	4116425.4352940377 ns/iter	4161328.251461915 ns/iter	0.99
E2E_Compiler_semantic_release	1599787.7254005303 ns/iter	1586189.7239819698 ns/iter	1.01
E2E_Compiler_stale	1594509.7454546571 ns/iter	1568116.8520180336 ns/iter	1.02
E2E_Compiler_stylecop	6258377.339285915 ns/iter	6234036.625000629 ns/iter	1.00
E2E_Compiler_tmuxinator	1972591.707386264 ns/iter	1954949.8851542273 ns/iter	1.01
E2E_Compiler_ui5	47287752.53333121 ns/iter	47377142.93333587 ns/iter	1.00
E2E_Compiler_ui5_manifest	316958356.49998116 ns/iter	316427215.5000276 ns/iter	1.00
E2E_Compiler_unreal_engine_uproject	4714928.24324302 ns/iter	4616095.556290978 ns/iter	1.02
E2E_Compiler_users_array	804572.902522941 ns/iter	813189.3752886482 ns/iter	0.99
E2E_Compiler_vercel	12687854.41818016 ns/iter	12533029.982143212 ns/iter	1.01
E2E_Compiler_yamllint	362133.9824107843 ns/iter	351877.1814047224 ns/iter	1.03
E2E_Evaluator_adaptivecard	24549.16425709689 ns/iter	24575.97049744197 ns/iter	1.00
E2E_Evaluator_ansible_meta	223985.97624397083 ns/iter	236025.03278690152 ns/iter	0.95
E2E_Evaluator_aws_cdk	50080.33458619858 ns/iter	50100.02067871947 ns/iter	1.00
E2E_Evaluator_babelrc	108079.04715275425 ns/iter	106139.51434356465 ns/iter	1.02
E2E_Evaluator_cerebrum_criminal_case	941563.3893441709 ns/iter	935615.8236092778 ns/iter	1.01
E2E_Evaluator_clang_format	121469.82500427969 ns/iter	122120.25876811087 ns/iter	0.99
E2E_Evaluator_cmake_presets	4121697.3040931327 ns/iter	4153553.7878789087 ns/iter	0.99
E2E_Evaluator_code_climate	176485.74191919653 ns/iter	174658.524399498 ns/iter	1.01
E2E_Evaluator_cql2	214622.69900805503 ns/iter	221895.8615819149 ns/iter	0.97
E2E_Evaluator_cspell	546855.8875693429 ns/iter	557390.3229166815 ns/iter	0.98
E2E_Evaluator_cypress	188913.09696639318 ns/iter	191120.02139760513 ns/iter	0.99
E2E_Evaluator_deno	317734.3479036552 ns/iter	314452.62247300305 ns/iter	1.01
E2E_Evaluator_dependabot	311831.16963491 ns/iter	318402.067865167 ns/iter	0.98
E2E_Evaluator_draft_04	7134071.841584622 ns/iter	7346567.734041981 ns/iter	0.97
E2E_Evaluator_fabric_mod	687992.4112512178 ns/iter	694712.4610837034 ns/iter	0.99
E2E_Evaluator_geojson	15828225.454545086 ns/iter	16394442.372093497 ns/iter	0.97
E2E_Evaluator_gitpod_configuration	223186.63191355433 ns/iter	225535.22360843472 ns/iter	0.99
E2E_Evaluator_helm_chart_lock	335174.37846890127 ns/iter	343635.0861056491 ns/iter	0.98
E2E_Evaluator_importmap	47497.5087313944 ns/iter	45960.07496379792 ns/iter	1.03
E2E_Evaluator_jasmine	103951.43225233722 ns/iter	105172.21717624838 ns/iter	0.99
E2E_Evaluator_jshintrc	1189625.0392491398 ns/iter	1199950.5420239132 ns/iter	0.99
E2E_Evaluator_jsconfig	419728.4074955193 ns/iter	420931.018203874 ns/iter	1.00
E2E_Evaluator_krakend	203792.3703165651 ns/iter	206183.11485088998 ns/iter	0.99
E2E_Evaluator_lazygit	144913.99652324824 ns/iter	148605.65099113263 ns/iter	0.98
E2E_Evaluator_lerna	137338.66280894988 ns/iter	141975.29044716386 ns/iter	0.97
E2E_Evaluator_nest_cli	173318.5758784049 ns/iter	176398.33374690262 ns/iter	0.98
E2E_Evaluator_omc	17866.949121303438 ns/iter	18012.99820195377 ns/iter	0.99
E2E_Evaluator_omnisharp	614509.5353095246 ns/iter	610457.7833333112 ns/iter	1.01
E2E_Evaluator_openapi	9389489.388889652 ns/iter	9680123.52631538 ns/iter	0.97
E2E_Evaluator_pre_commit_hooks	472827.901226219 ns/iter	469144.15930392785 ns/iter	1.01
E2E_Evaluator_pulumi	666499.9288389435 ns/iter	674376.6757263467 ns/iter	0.99
E2E_Evaluator_semantic_release	96027.43489183502 ns/iter	96095.04434651772 ns/iter	1.00
E2E_Evaluator_stale	145801.31344520333 ns/iter	147933.25106021576 ns/iter	0.99
E2E_Evaluator_stylecop	281709.89838053903 ns/iter	278481.7324455474 ns/iter	1.01
E2E_Evaluator_tmuxinator	95051.75824025943 ns/iter	96274.92598594383 ns/iter	0.99
E2E_Evaluator_ui5	499240.5920397761 ns/iter	495529.1913043548 ns/iter	1.01
E2E_Evaluator_ui5_manifest	2451913.2394366707 ns/iter	2470581.352112754 ns/iter	0.99
E2E_Evaluator_unreal_engine_uproject	417701.28477218334 ns/iter	423297.65471119893 ns/iter	0.99
E2E_Evaluator_users_array	539728.4671756423 ns/iter	537777.5304212415 ns/iter	1.00
E2E_Evaluator_vercel	304629.37462367356 ns/iter	310363.65972224466 ns/iter	0.98
E2E_Evaluator_yamllint	8085.448046683405 ns/iter	8002.529577270347 ns/iter	1.01
Micro_Draft4_Meta_1_No_Callback	187.92006223821545 ns/iter	187.68923086613657 ns/iter	1.00
Micro_Draft4_Required_Properties	796.006595468452 ns/iter	817.4725885553615 ns/iter	0.97
Micro_Draft4_Many_Optional_Properties_Minimal_Match	20.885869075835174 ns/iter	24.406491518388602 ns/iter	0.86
Micro_Draft4_Few_Optional_Properties_Minimal_Match	10.892565261046208 ns/iter	10.905270422856157 ns/iter	1.00
Micro_Draft4_Items_Schema	290.6717402936082 ns/iter	299.27406112486767 ns/iter	0.97
Micro_Draft4_Nested_Object	1.8195669584058922 ns/iter	1.778627510848145 ns/iter	1.02
Micro_Draft4_Properties_Triad_Optional	315.13451304607423 ns/iter	313.064876318494 ns/iter	1.01
Micro_Draft4_Properties_Triad_Closed	259.18244512408575 ns/iter	258.42314226599393 ns/iter	1.00
Micro_Draft4_Properties_Triad_Required	330.8981529415674 ns/iter	330.4427914856007 ns/iter	1.00
Micro_Draft4_Properties_Closed	58.15652387315687 ns/iter	55.4349631393387 ns/iter	1.05
Micro_Draft4_Non_Recursive_Ref	12.503297770134596 ns/iter	12.385173017952283 ns/iter	1.01
Micro_Draft4_Pattern_Properties_True	149.75830818231304 ns/iter	153.1978712221085 ns/iter	0.98
Micro_Draft4_Ref_To_Single_Property	10.897888587040173 ns/iter	10.907979625169462 ns/iter	1.00
Micro_Draft4_Additional_Properties_Type	22.0337258402007 ns/iter	22.460411177450833 ns/iter	0.98
Micro_Draft4_Nested_Oneof	57.91958816838343 ns/iter	57.946304260441615 ns/iter	1.00
Micro_Draft4_Short_Enum	12.064233459008678 ns/iter	14.017956133737032 ns/iter	0.86
Micro_Draft4_Long_Enum	14.032678422281638 ns/iter	14.338973744930723 ns/iter	0.98
Micro_Draft4_Long_Enum_Short_Strings	11.833547334450127 ns/iter	14.029403326146396 ns/iter	0.84
Micro_Draft4_Type_Object	3.549121575961705 ns/iter	3.4230718058208054 ns/iter	1.04
Micro_Draft4_Ref_Single_100	2410149.1821305947 ns/iter	2401960.5836176053 ns/iter	1.00
Micro_Draft4_Compile_Ref_Many_Nested	1744407.745635706 ns/iter	1732217.8980099754 ns/iter	1.01
Micro_Draft4_Compile_Wrap	2415235.0206898926 ns/iter	2381663.812286467 ns/iter	1.01
Micro_Draft6_Property_Names	517.714712562609 ns/iter	118.92972762471233 ns/iter	4.35
Micro_Draft6_Compile_FHIR	15474468441.999989 ns/iter	14527092512.999956 ns/iter	1.07
Micro_Draft7_If_Then_Else	23.37557695680538 ns/iter	23.356186257237802 ns/iter	1.00
Micro_2019_09_Unevaluated_Properties	36.69601302036939 ns/iter	29.595111628472836 ns/iter	1.24
Micro_2019_09_Compile_Wrap	297126665.0000075 ns/iter	297191445.99999934 ns/iter	1.00
Micro_2020_12_Dynamic_Ref	225.82291359081933 ns/iter	224.31468398960362 ns/iter	1.01
Micro_2020_12_Dynamic_Ref_Single	3.4253639907351072 ns/iter	3.4680743235994176 ns/iter	0.99
Micro_2020_12_Simple_Output_Mask	1072.777189835151 ns/iter	1063.3235489941185 ns/iter	1.01
Micro_2020_12_Simple_Output_Annotations	104588.37109317935 ns/iter	108698.50450588968 ns/iter	0.96
Micro_2020_12_Compile_NonCircular_Shared_Refs	1136041.1553398042 ns/iter	1109379.1240064772 ns/iter	1.02
Micro_2020_12_Exhaustive_Deep_Numeric	8232.1268053057 ns/iter	8215.161096899774 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	178412.74227064993 ns/iter	175129.63115978337 ns/iter	1.02
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	22436.271943824413 ns/iter	22523.848646032955 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	157.94798603228338 ns/iter	145.00229789016882 ns/iter	1.09
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4368.72265811501 ns/iter	4278.60743297813 ns/iter	1.02
Alterschema_Check_Readibility_ISO_Language_Set_3	362737433.999996 ns/iter	349465903.99999875 ns/iter	1.04
Alterschema_Check_Readibility_OMC	89747294.37500173 ns/iter	86707433.62500843 ns/iter	1.04
Alterschema_Check_Readibility_KrakenD	1258216092.9999874 ns/iter	1211370455.9999406 ns/iter	1.04
Alterschema_Apply_Readibility_KrakenD	122381975258.00002 ns/iter	119061376232.99992 ns/iter	1.03
Alterschema_Check_Invalid_External_Refs	308628244.0000332 ns/iter	299436482.0000328 ns/iter	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/llvm)

Details

Benchmark suite	Current: 6c8a118	Previous: 9ded71e	Ratio
E2E_Evaluator_adaptivecard	121016 ns	123403 ns	0.98
E2E_Evaluator_ansible-meta	534818 ns	527888 ns	1.01
E2E_Evaluator_aws-cdk	139872 ns	145676 ns	0.96
E2E_Evaluator_babelrc	326633 ns	338243 ns	0.97
E2E_Evaluator_cerebrum-criminal-case	2521691 ns	2561156 ns	0.98
E2E_Evaluator_clang-format	258597 ns	266700 ns	0.97
E2E_Evaluator_cmake-presets	18560394 ns	19276152 ns	0.96
E2E_Evaluator_code-climate	502623 ns	515837 ns	0.97
E2E_Evaluator_cql2	1272994 ns	1241534 ns	1.03
E2E_Evaluator_cspell	1508245 ns	1591680 ns	0.95
E2E_Evaluator_cypress	790163 ns	820655 ns	0.96
E2E_Evaluator_deno	1098440 ns	1093186 ns	1.00
E2E_Evaluator_dependabot	1206835 ns	1184536 ns	1.02
E2E_Evaluator_draft-04	24441825 ns	28855884 ns	0.85
E2E_Evaluator_fabric-mod	2370434 ns	2491580 ns	0.95
E2E_Evaluator_geojson	20682145 ns	20507404 ns	1.01
E2E_Evaluator_gitpod-configuration	716954 ns	734046 ns	0.98
E2E_Evaluator_helm-chart-lock	1001804 ns	982574 ns	1.02
E2E_Evaluator_importmap	269336 ns	266960 ns	1.01
E2E_Evaluator_jasmine	291182 ns	301494 ns	0.97
E2E_Evaluator_jsconfig	1253385 ns	1263868 ns	0.99
E2E_Evaluator_jshintrc	2723604 ns	2773360 ns	0.98
E2E_Evaluator_krakend	683258 ns	694482 ns	0.98
E2E_Evaluator_lazygit	515036 ns	512893 ns	1.00
E2E_Evaluator_lerna	503941 ns	477853 ns	1.05
E2E_Evaluator_nest-cli	602579 ns	608288 ns	0.99
E2E_Evaluator_omc	93430 ns	90500 ns	1.03
E2E_Evaluator_omnisharp	1401562 ns	1422524 ns	0.99
E2E_Evaluator_openapi	22532595 ns	27023010 ns	0.83
E2E_Evaluator_pre-commit-hooks	2033622 ns	2064331 ns	0.99
E2E_Evaluator_pulumi	1905153 ns	1952313 ns	0.98
E2E_Evaluator_semantic-release	258601 ns	258020 ns	1.00
E2E_Evaluator_stale	409336 ns	402331 ns	1.02
E2E_Evaluator_stylecop	1288450 ns	1260401 ns	1.02
E2E_Evaluator_tmuxinator	230861 ns	245116 ns	0.94
E2E_Evaluator_ui5	2411351 ns	2340281 ns	1.03
E2E_Evaluator_ui5-manifest	14156322 ns	13965777 ns	1.01
E2E_Evaluator_unreal-engine-uproject	1572825 ns	1576690 ns	1.00
E2E_Evaluator_users-array	2632512 ns	2829969 ns	0.93
E2E_Evaluator_vercel	1019941 ns	983395 ns	1.04
E2E_Evaluator_yamllint	26859 ns	26045 ns	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (macos/llvm)

Details

Benchmark suite	Current: 6c8a118	Previous: 5b9baeb	Ratio
E2E_Compiler_adaptivecard	66339983.3000085 ns/iter	62967054.199998535 ns/iter	1.05
E2E_Compiler_ansible_meta	23037900.28571484 ns/iter	24992126.55555783 ns/iter	0.92
E2E_Compiler_aws_cdk	257990.3961708656 ns/iter	278832.73319994257 ns/iter	0.93
E2E_Compiler_babelrc	2050825.3323175556 ns/iter	2226353.9756841334 ns/iter	0.92
E2E_Compiler_clang_format	13624357.843136573 ns/iter	17589115.85365817 ns/iter	0.77
E2E_Compiler_cmake_presets	23600451.400003903 ns/iter	28717357.954550687 ns/iter	0.82
E2E_Compiler_code_climate	2142737.3711044993 ns/iter	2257842.2538228845 ns/iter	0.95
E2E_Compiler_cql2	10483884.328357194 ns/iter	12087670.258618597 ns/iter	0.87
E2E_Compiler_cspell	17607192.699995268 ns/iter	20315457.16667122 ns/iter	0.87
E2E_Compiler_cypress	3244417.0511627267 ns/iter	3538757.224489751 ns/iter	0.92
E2E_Compiler_deno	6048988.146552613 ns/iter	6691861.374998955 ns/iter	0.90
E2E_Compiler_dependabot	3566632.7014216166 ns/iter	3616464.743590069 ns/iter	0.99
E2E_Compiler_draft_04	2173733.5122699253 ns/iter	2000694.560224054 ns/iter	1.09
E2E_Compiler_fabric_mod	3358307.2378641837 ns/iter	3648070.394736255 ns/iter	0.92
E2E_Compiler_geojson	20197371.42856814 ns/iter	22870110.1935463 ns/iter	0.88
E2E_Compiler_gitpod_configuration	3713076.2751318975 ns/iter	4663070.660818018 ns/iter	0.80
E2E_Compiler_helm_chart_lock	481538.37138921325 ns/iter	612434.3220338501 ns/iter	0.79
E2E_Compiler_importmap	222740.65318768338 ns/iter	233056.98800548937 ns/iter	0.96
E2E_Compiler_jasmine	970044.307573383 ns/iter	1064273.085585665 ns/iter	0.91
E2E_Compiler_jshintrc	2916220.780082831 ns/iter	3240054.1474649077 ns/iter	0.90
E2E_Compiler_jsconfig	17374901.692304637 ns/iter	18926844.59459348 ns/iter	0.92
E2E_Compiler_krakend	117665180.50001197 ns/iter	132881333.20002088 ns/iter	0.89
E2E_Compiler_lazygit	29061647.54166222 ns/iter	36525554.90909683 ns/iter	0.80
E2E_Compiler_lerna	1449744.0482143376 ns/iter	1310431.6754223264 ns/iter	1.11
E2E_Compiler_nest_cli	6295285.1941760145 ns/iter	6127060.14151129 ns/iter	1.03
E2E_Compiler_omc	147794708.2000355 ns/iter	183717583.2500293 ns/iter	0.80
E2E_Compiler_omnisharp	5353653.648436207 ns/iter	5898135.416667098 ns/iter	0.91
E2E_Compiler_openapi	19482959.49999748 ns/iter	22423104.187495824 ns/iter	0.87
E2E_Compiler_pre_commit_hooks	3814809.9358288147 ns/iter	4739772.794117497 ns/iter	0.80
E2E_Compiler_pulumi	2971597.865546434 ns/iter	4456082.973913157 ns/iter	0.67
E2E_Compiler_semantic_release	1138726.9984226392 ns/iter	1729135.8931297094 ns/iter	0.66
E2E_Compiler_stale	1119244.716323307 ns/iter	1653318.541300694 ns/iter	0.68
E2E_Compiler_stylecop	5016341.250000096 ns/iter	5559220.507692631 ns/iter	0.90
E2E_Compiler_tmuxinator	1388996.7885376895 ns/iter	1501849.8755363727 ns/iter	0.92
E2E_Compiler_ui5	47778216.66666568 ns/iter	55908440.916671984 ns/iter	0.85
E2E_Compiler_ui5_manifest	295104000.00003755 ns/iter	305402166.5000164 ns/iter	0.97
E2E_Compiler_unreal_engine_uproject	3804897.8100563767 ns/iter	3705127.6178010358 ns/iter	1.03
E2E_Compiler_users_array	689519.8993021523 ns/iter	753671.7265048627 ns/iter	0.91
E2E_Compiler_vercel	11100542.312497908 ns/iter	11928088.199999819 ns/iter	0.93
E2E_Compiler_yamllint	228626.3827200549 ns/iter	253000.3336971814 ns/iter	0.90
E2E_Evaluator_adaptivecard	16729.874248365722 ns/iter	18379.167512563054 ns/iter	0.91
E2E_Evaluator_ansible_meta	147267.48233581884 ns/iter	179524.96512441637 ns/iter	0.82
E2E_Evaluator_aws_cdk	31388.739186829076 ns/iter	36077.3268162503 ns/iter	0.87
E2E_Evaluator_babelrc	71346.90274212166 ns/iter	77296.87939637378 ns/iter	0.92
E2E_Evaluator_cerebrum_criminal_case	571173.1261043493 ns/iter	639605.1836733472 ns/iter	0.89
E2E_Evaluator_clang_format	87461.4393789909 ns/iter	92634.9689382824 ns/iter	0.94
E2E_Evaluator_cmake_presets	2920692.0124996332 ns/iter	3165465.742222295 ns/iter	0.92
E2E_Evaluator_code_climate	122867.5524225963 ns/iter	123248.01183647763 ns/iter	1.00
E2E_Evaluator_cql2	133720.667856349 ns/iter	140785.09740911558 ns/iter	0.95
E2E_Evaluator_cspell	343224.165439383 ns/iter	374087.05357142544 ns/iter	0.92
E2E_Evaluator_cypress	124526.2898602721 ns/iter	133419.78340314442 ns/iter	0.93
E2E_Evaluator_deno	198368.91497177642 ns/iter	209610.77431079038 ns/iter	0.95
E2E_Evaluator_dependabot	208977.2873839032 ns/iter	226068.15266194506 ns/iter	0.92
E2E_Evaluator_draft_04	4510227.0320518445 ns/iter	5588929.417911853 ns/iter	0.81
E2E_Evaluator_fabric_mod	423055.98251965473 ns/iter	547956.3347548652 ns/iter	0.77
E2E_Evaluator_geojson	10399078.056335883 ns/iter	11712120.833332544 ns/iter	0.89
E2E_Evaluator_gitpod_configuration	141763.139204535 ns/iter	176873.07844069685 ns/iter	0.80
E2E_Evaluator_helm_chart_lock	203363.59847820122 ns/iter	221989.92800705833 ns/iter	0.92
E2E_Evaluator_importmap	28038.496931540085 ns/iter	30926.06672919867 ns/iter	0.91
E2E_Evaluator_jasmine	72935.55336379082 ns/iter	78584.81894922948 ns/iter	0.93
E2E_Evaluator_jshintrc	862125.202670055 ns/iter	937461.2068964944 ns/iter	0.92
E2E_Evaluator_jsconfig	272239.901094585 ns/iter	294357.21050232055 ns/iter	0.92
E2E_Evaluator_krakend	116490.71452365558 ns/iter	123448.37941512887 ns/iter	0.94
E2E_Evaluator_lazygit	82138.61092028466 ns/iter	114796.74323930028 ns/iter	0.72
E2E_Evaluator_lerna	103203.82421872646 ns/iter	125986.30781332254 ns/iter	0.82
E2E_Evaluator_nest_cli	111819.10456061573 ns/iter	119751.58589633617 ns/iter	0.93
E2E_Evaluator_omc	12329.04947189933 ns/iter	12700.542781239355 ns/iter	0.97
E2E_Evaluator_omnisharp	430099.42653443024 ns/iter	428900.7898550524 ns/iter	1.00
E2E_Evaluator_openapi	4872463.925372059 ns/iter	5630019.287037967 ns/iter	0.87
E2E_Evaluator_pre_commit_hooks	301145.89649215445 ns/iter	326226.64844826754 ns/iter	0.92
E2E_Evaluator_pulumi	466056.2417655226 ns/iter	490826.46229745355 ns/iter	0.95
E2E_Evaluator_semantic_release	63134.214285697075 ns/iter	67588.4735780177 ns/iter	0.93
E2E_Evaluator_stale	100512.80504130351 ns/iter	107636.23859922717 ns/iter	0.93
E2E_Evaluator_stylecop	163668.2578273256 ns/iter	196107.4610340506 ns/iter	0.83
E2E_Evaluator_tmuxinator	68768.41987928428 ns/iter	77198.292022497 ns/iter	0.89
E2E_Evaluator_ui5	315373.01842325873 ns/iter	323468.4094887229 ns/iter	0.97
E2E_Evaluator_ui5_manifest	1448501.3027343284 ns/iter	1510346.7847529624 ns/iter	0.96
E2E_Evaluator_unreal_engine_uproject	346884.38472695294 ns/iter	304030.9438841942 ns/iter	1.14
E2E_Evaluator_users_array	419180.4970096048 ns/iter	414454.54999996076 ns/iter	1.01
E2E_Evaluator_vercel	205433.12179102236 ns/iter	216734.26211001657 ns/iter	0.95
E2E_Evaluator_yamllint	5403.017183610398 ns/iter	5911.472787462726 ns/iter	0.91
Micro_Draft4_Meta_1_No_Callback	119.07387930977961 ns/iter	127.50304149159403 ns/iter	0.93
Micro_Draft4_Required_Properties	573.470833135522 ns/iter	627.6103587556738 ns/iter	0.91
Micro_Draft4_Many_Optional_Properties_Minimal_Match	14.45908728934165 ns/iter	15.85327065605186 ns/iter	0.91
Micro_Draft4_Few_Optional_Properties_Minimal_Match	6.573748959579323 ns/iter	8.654368180162516 ns/iter	0.76
Micro_Draft4_Items_Schema	245.0876444667458 ns/iter	291.72714355704164 ns/iter	0.84
Micro_Draft4_Nested_Object	0.635273590036768 ns/iter	0.7021223525163867 ns/iter	0.90
Micro_Draft4_Properties_Triad_Optional	194.68120716200568 ns/iter	207.76356069255792 ns/iter	0.94
Micro_Draft4_Properties_Triad_Closed	172.36707854667 ns/iter	169.9623363023481 ns/iter	1.01
Micro_Draft4_Properties_Triad_Required	210.66461518040478 ns/iter	209.79534244851027 ns/iter	1.00
Micro_Draft4_Properties_Closed	34.60038868717181 ns/iter	39.27069830253191 ns/iter	0.88
Micro_Draft4_Non_Recursive_Ref	11.741773432945273 ns/iter	12.922476825134272 ns/iter	0.91
Micro_Draft4_Pattern_Properties_True	125.63233394836273 ns/iter	150.81469061330142 ns/iter	0.83
Micro_Draft4_Ref_To_Single_Property	6.542589311867093 ns/iter	7.091794243633563 ns/iter	0.92
Micro_Draft4_Additional_Properties_Type	23.62943261713967 ns/iter	25.704423237578442 ns/iter	0.92
Micro_Draft4_Nested_Oneof	37.49064902691598 ns/iter	39.971949908574395 ns/iter	0.94
Micro_Draft4_Short_Enum	4.7347701388865815 ns/iter	5.317375829999946 ns/iter	0.89
Micro_Draft4_Long_Enum	9.337785233110154 ns/iter	11.314080377307263 ns/iter	0.83
Micro_Draft4_Long_Enum_Short_Strings	5.827347526350519 ns/iter	7.6232937567469214 ns/iter	0.76
Micro_Draft4_Type_Object	2.033073248448512 ns/iter	2.6495869269357133 ns/iter	0.77
Micro_Draft4_Ref_Single_100	1659292.7687222196 ns/iter	1702131.8922303764 ns/iter	0.97
Micro_Draft4_Compile_Ref_Many_Nested	1334843.1324110474 ns/iter	1267800.2245683137 ns/iter	1.05
Micro_Draft4_Compile_Wrap	1838466.580475646 ns/iter	2090386.6484148486 ns/iter	0.88
Micro_Draft6_Property_Names	87.1962196401346 ns/iter	96.50666317873645 ns/iter	0.90
Micro_Draft6_Compile_FHIR	7043525499.99976 ns/iter	11746992666.000097 ns/iter	0.60
Micro_Draft7_If_Then_Else	15.797268638863322 ns/iter	16.935294020418066 ns/iter	0.93
Micro_2019_09_Unevaluated_Properties	25.882768707653977 ns/iter	26.352535382769716 ns/iter	0.98
Micro_2019_09_Compile_Wrap	264494833.33332562 ns/iter	349885145.5000249 ns/iter	0.76
Micro_2020_12_Dynamic_Ref	173.02451220498506 ns/iter	183.29227492447393 ns/iter	0.94
Micro_2020_12_Dynamic_Ref_Single	2.008681964016288 ns/iter	2.1560857715110986 ns/iter	0.93
Micro_2020_12_Simple_Output_Mask	731.28885544531 ns/iter	874.1770331592718 ns/iter	0.84
Micro_2020_12_Simple_Output_Annotations	78808.7887515755 ns/iter	101830.9218377201 ns/iter	0.77
Micro_2020_12_Compile_NonCircular_Shared_Refs	734616.0212315099 ns/iter	842676.7299864177 ns/iter	0.87
Micro_2020_12_Exhaustive_Deep_Numeric	5063.7225211094765 ns/iter	5288.046262663957 ns/iter	0.96
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	108201.72265445438 ns/iter	120964.86148256547 ns/iter	0.89
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	13291.086804630326 ns/iter	19204.073371333863 ns/iter	0.69
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	86.23368269163996 ns/iter	107.432183764256 ns/iter	0.80
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4624.673732877508 ns/iter	5078.347920000397 ns/iter	0.91
Alterschema_Check_Readibility_ISO_Language_Set_3	211133902.6667641 ns/iter	284459430.6666295 ns/iter	0.74
Alterschema_Check_Readibility_OMC	51942702.35714222 ns/iter	63763996.18180916 ns/iter	0.81
Alterschema_Check_Readibility_KrakenD	554005707.9997495 ns/iter	687956624.9999698 ns/iter	0.81
Alterschema_Apply_Readibility_KrakenD	59647672125.0001 ns/iter	74778475584.00003 ns/iter	0.80
Alterschema_Check_Invalid_External_Refs	174803489.75004745 ns/iter	192426447.74999464 ns/iter	0.91

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (macos/llvm)

Details

Benchmark suite	Current: 6c8a118	Previous: 5b9baeb	Ratio
E2E_Evaluator_adaptivecard	94832 ns	126974 ns	0.75
E2E_Evaluator_ansible-meta	359980 ns	450745 ns	0.80
E2E_Evaluator_aws-cdk	123819 ns	110079 ns	1.12
E2E_Evaluator_babelrc	246780 ns	245125 ns	1.01
E2E_Evaluator_cerebrum-criminal-case	1653234 ns	1546770 ns	1.07
E2E_Evaluator_clang-format	164560 ns	182640 ns	0.90
E2E_Evaluator_cmake-presets	10600443 ns	16716193 ns	0.63
E2E_Evaluator_code-climate	339852 ns	417987 ns	0.81
E2E_Evaluator_cql2	862243 ns	1111457 ns	0.78
E2E_Evaluator_cspell	970412 ns	1357816 ns	0.71
E2E_Evaluator_cypress	509548 ns	766261 ns	0.66
E2E_Evaluator_deno	699710 ns	887605 ns	0.79
E2E_Evaluator_dependabot	707085 ns	881709 ns	0.80
E2E_Evaluator_draft-04	16807554 ns	19023313 ns	0.88
E2E_Evaluator_fabric-mod	1364202 ns	2189162 ns	0.62
E2E_Evaluator_geojson	13819502 ns	16426160 ns	0.84
E2E_Evaluator_gitpod-configuration	456978 ns	674183 ns	0.68
E2E_Evaluator_helm-chart-lock	793664 ns	1031394 ns	0.77
E2E_Evaluator_importmap	196776 ns	231199 ns	0.85
E2E_Evaluator_jasmine	199874 ns	240705 ns	0.83
E2E_Evaluator_jsconfig	837613 ns	1061393 ns	0.79
E2E_Evaluator_jshintrc	1856265 ns	2221366 ns	0.84
E2E_Evaluator_krakend	420242 ns	465359 ns	0.90
E2E_Evaluator_lazygit	260329 ns	325640 ns	0.80
E2E_Evaluator_lerna	298525 ns	434064 ns	0.69
E2E_Evaluator_nest-cli	388095 ns	558700 ns	0.69
E2E_Evaluator_omc	65439 ns	76718 ns	0.85
E2E_Evaluator_omnisharp	911087 ns	1021763 ns	0.89
E2E_Evaluator_openapi	15036936 ns	16915298 ns	0.89
E2E_Evaluator_pre-commit-hooks	1272352 ns	1385574 ns	0.92
E2E_Evaluator_pulumi	1291594 ns	1580227 ns	0.82
E2E_Evaluator_semantic-release	167114 ns	191236 ns	0.87
E2E_Evaluator_stale	262956 ns	343256 ns	0.77
E2E_Evaluator_stylecop	687839 ns	982906 ns	0.70
E2E_Evaluator_tmuxinator	152669 ns	169810 ns	0.90
E2E_Evaluator_ui5	1538350 ns	1667945 ns	0.92
E2E_Evaluator_ui5-manifest	7636297 ns	8743959 ns	0.87
E2E_Evaluator_unreal-engine-uproject	1111907 ns	1265510 ns	0.88
E2E_Evaluator_users-array	1757079 ns	2247534 ns	0.78
E2E_Evaluator_vercel	684503 ns	833511 ns	0.82
E2E_Evaluator_yamllint	22825 ns	30361 ns	0.75

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Details

Benchmark suite	Current: 6c8a118	Previous: 5b9baeb	Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3	399737542.50002 ns/iter	321090483.49991554 ns/iter	1.24
Alterschema_Check_Readibility_OMC	110818432.5714449 ns/iter	100379991.5714418 ns/iter	1.10
Alterschema_Check_Readibility_KrakenD	1433401421.9998608 ns/iter	1594982646.0000622 ns/iter	0.90
Alterschema_Apply_Readibility_KrakenD	154753790965.00024 ns/iter	154364211557.0001 ns/iter	1.00
Alterschema_Check_Invalid_External_Refs	312871472.00009716 ns/iter	253438748.66666737 ns/iter	1.23
Micro_2020_12_Dynamic_Ref	281.7089331783502 ns/iter	272.53150469091474 ns/iter	1.03
Micro_2020_12_Dynamic_Ref_Single	4.22495410001585 ns/iter	3.699487853644915 ns/iter	1.14
Micro_2020_12_Simple_Output_Mask	1136.1073244316647 ns/iter	1030.8474491151262 ns/iter	1.10
Micro_2020_12_Simple_Output_Annotations	102579.10822122407 ns/iter	108075.58053016219 ns/iter	0.95
Micro_2020_12_Compile_NonCircular_Shared_Refs	1207311.4982699752 ns/iter	1108604.717908116 ns/iter	1.09
Micro_2020_12_Exhaustive_Deep_Numeric	8134.4809703334595 ns/iter	8764.691730730854 ns/iter	0.93
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	170680.10311282115 ns/iter	142930.58340200418 ns/iter	1.19
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	26665.489205065503 ns/iter	24386.764509041648 ns/iter	1.09
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	139.12593552625478 ns/iter	141.97370798848021 ns/iter	0.98
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4525.296008530626 ns/iter	4635.135607884758 ns/iter	0.98
Micro_2019_09_Unevaluated_Properties	29.242889580340815 ns/iter	25.20016042665127 ns/iter	1.16
Micro_2019_09_Compile_Wrap	363524656.99997085 ns/iter	284162339.4999715 ns/iter	1.28
Micro_Draft7_If_Then_Else	25.209200495901424 ns/iter	22.253133349095126 ns/iter	1.13
Micro_Draft6_Property_Names	150.97563665475332 ns/iter	147.25222185747677 ns/iter	1.03
Micro_Draft6_Compile_FHIR	17020249033.000027 ns/iter	17073635365.999962 ns/iter	1.00
Micro_Draft4_Meta_1_No_Callback	173.53447546903035 ns/iter	174.4712092653931 ns/iter	0.99
Micro_Draft4_Required_Properties	845.8410654247258 ns/iter	775.9396331665087 ns/iter	1.09
Micro_Draft4_Many_Optional_Properties_Minimal_Match	21.128165952476945 ns/iter	23.8661736063631 ns/iter	0.89
Micro_Draft4_Few_Optional_Properties_Minimal_Match	12.670904550016674 ns/iter	11.544879121317528 ns/iter	1.10
Micro_Draft4_Items_Schema	315.7493553121724 ns/iter	284.9958679204262 ns/iter	1.11
Micro_Draft4_Nested_Object	2.463592872535874 ns/iter	1.7298614715505787 ns/iter	1.42
Micro_Draft4_Properties_Triad_Optional	411.828285122929 ns/iter	329.7948005793451 ns/iter	1.25
Micro_Draft4_Properties_Triad_Closed	363.50669218992385 ns/iter	269.40895109625853 ns/iter	1.35
Micro_Draft4_Properties_Triad_Required	486.92168946275814 ns/iter	351.1322936420523 ns/iter	1.39
Micro_Draft4_Properties_Closed	62.39704881531482 ns/iter	65.61301366190654 ns/iter	0.95
Micro_Draft4_Non_Recursive_Ref	8.916048821201569 ns/iter	8.652049605573225 ns/iter	1.03
Micro_Draft4_Pattern_Properties_True	196.42651821510182 ns/iter	181.2478651455686 ns/iter	1.08
Micro_Draft4_Ref_To_Single_Property	13.02626927082046 ns/iter	11.468601398122944 ns/iter	1.14
Micro_Draft4_Additional_Properties_Type	15.063506355880573 ns/iter	12.978034934050296 ns/iter	1.16
Micro_Draft4_Nested_Oneof	67.84984466235899 ns/iter	54.25353913341098 ns/iter	1.25
Micro_Draft4_Short_Enum	14.78547463444942 ns/iter	10.736412187761836 ns/iter	1.38
Micro_Draft4_Long_Enum	14.441565232141162 ns/iter	13.690285319820875 ns/iter	1.05
Micro_Draft4_Long_Enum_Short_Strings	14.833056440620213 ns/iter	10.673479943045276 ns/iter	1.39
Micro_Draft4_Type_Object	4.571680368794658 ns/iter	3.919728982205219 ns/iter	1.17
Micro_Draft4_Ref_Single_100	2526475.9964027023 ns/iter	2276074.6123777735 ns/iter	1.11
Micro_Draft4_Compile_Ref_Many_Nested	1860491.0638294825 ns/iter	1686442.086747227 ns/iter	1.10
Micro_Draft4_Compile_Wrap	2616108.8951318157 ns/iter	2362400.663299439 ns/iter	1.11
E2E_Compiler_adaptivecard	76301444.8000149 ns/iter	63891184.99999892 ns/iter	1.19
E2E_Compiler_ansible_meta	32014690.13636556 ns/iter	27115485.23076929 ns/iter	1.18
E2E_Compiler_aws_cdk	407102.98835860926 ns/iter	372152.25544335926 ns/iter	1.09
E2E_Compiler_babelrc	2848805.821138636 ns/iter	2554817.050179322 ns/iter	1.12
E2E_Compiler_clang_format	20615157.294120014 ns/iter	17672534.897440363 ns/iter	1.17
E2E_Compiler_cmake_presets	29517054.916662272 ns/iter	25738317.000003815 ns/iter	1.15
E2E_Compiler_code_climate	2889341.2603302514 ns/iter	2581396.7095595393 ns/iter	1.12
E2E_Compiler_cql2	14767367.083332298 ns/iter	13168037.49056628 ns/iter	1.12
E2E_Compiler_cspell	26023944.67857039 ns/iter	22376095.74193254 ns/iter	1.16
E2E_Compiler_cypress	4299534.623456049 ns/iter	3823418.3715835293 ns/iter	1.12
E2E_Compiler_deno	8527126.903614027 ns/iter	7370706.189474157 ns/iter	1.16
E2E_Compiler_dependabot	4361914.068749684 ns/iter	3775046.081081372 ns/iter	1.16
E2E_Compiler_draft_04	2991608.8893621257 ns/iter	2692647.2153849527 ns/iter	1.11
E2E_Compiler_fabric_mod	5262903.699247517 ns/iter	4688297.519999954 ns/iter	1.12
E2E_Compiler_geojson	25331312.42856663 ns/iter	22233928.968752537 ns/iter	1.14
E2E_Compiler_gitpod_configuration	5452226.472869355 ns/iter	4802400.496550788 ns/iter	1.14
E2E_Compiler_helm_chart_lock	740899.1613246606 ns/iter	660279.3355326417 ns/iter	1.12
E2E_Compiler_importmap	303854.02953954856 ns/iter	279113.8164631618 ns/iter	1.09
E2E_Compiler_jasmine	1480621.1175213375 ns/iter	1345591.4176245579 ns/iter	1.10
E2E_Compiler_jshintrc	4783377.589040805 ns/iter	4170920.8750005257 ns/iter	1.15
E2E_Compiler_jsconfig	23819477.93103258 ns/iter	20405800.529408008 ns/iter	1.17
E2E_Compiler_krakend	150136980.00002477 ns/iter	137395543.00000235 ns/iter	1.09
E2E_Compiler_lazygit	37679012.84210271 ns/iter	32792993.28571705 ns/iter	1.15
E2E_Compiler_lerna	1776769.6259541262 ns/iter	1578114.483069899 ns/iter	1.13
E2E_Compiler_nest_cli	8244012.270586823 ns/iter	7178309.19387668 ns/iter	1.15
E2E_Compiler_omc	193992297.9999551 ns/iter	155154340.25002152 ns/iter	1.25
E2E_Compiler_omnisharp	7411848.361700921 ns/iter	6382353.954545165 ns/iter	1.16
E2E_Compiler_openapi	28029105.960004017 ns/iter	24743870.321434055 ns/iter	1.13
E2E_Compiler_pre_commit_hooks	5900975.386553267 ns/iter	5067890.963767939 ns/iter	1.16
E2E_Compiler_pulumi	4477944.67307625 ns/iter	3969178.0738644926 ns/iter	1.13
E2E_Compiler_semantic_release	1733204.3895783918 ns/iter	1570154.765100511 ns/iter	1.10
E2E_Compiler_stale	1699611.7602908935 ns/iter	1520106.6298701547 ns/iter	1.12
E2E_Compiler_stylecop	6551513.849056494 ns/iter	5528373.7355378335 ns/iter	1.19
E2E_Compiler_tmuxinator	2127339.5243906355 ns/iter	1902990.8852460554 ns/iter	1.12
E2E_Compiler_ui5	55233795.85713428 ns/iter	50710981.20001806 ns/iter	1.09
E2E_Compiler_ui5_manifest	367069628.49996215 ns/iter	295698454.99997884 ns/iter	1.24
E2E_Compiler_unreal_engine_uproject	5095604.673912298 ns/iter	4464000.89240457 ns/iter	1.14
E2E_Compiler_users_array	864317.9689443059 ns/iter	815661.875291418 ns/iter	1.06
E2E_Compiler_vercel	13762578.769230388 ns/iter	12003376.931033926 ns/iter	1.15
E2E_Compiler_yamllint	368958.5255397335 ns/iter	341780.0133070596 ns/iter	1.08
E2E_Evaluator_adaptivecard	23453.972540274506 ns/iter	22471.178137650466 ns/iter	1.04
E2E_Evaluator_ansible_meta	229383.81000674816 ns/iter	216356.96780188428 ns/iter	1.06
E2E_Evaluator_aws_cdk	43359.50561097914 ns/iter	44669.064667050996 ns/iter	0.97
E2E_Evaluator_babelrc	85844.59445427079 ns/iter	91865.0889530189 ns/iter	0.93
E2E_Evaluator_cerebrum_criminal_case	1059848.945454412 ns/iter	1071087.8841463893 ns/iter	0.99
E2E_Evaluator_clang_format	98424.22018479866 ns/iter	99140.08142672153 ns/iter	0.99
E2E_Evaluator_cmake_presets	6205106.551401641 ns/iter	4789778.123287997 ns/iter	1.30
E2E_Evaluator_code_climate	165410.3562365246 ns/iter	197795.3056027064 ns/iter	0.84
E2E_Evaluator_cql2	203215.86235053968 ns/iter	189037.65706525015 ns/iter	1.08
E2E_Evaluator_cspell	514892.9450224373 ns/iter	535233.8434382204 ns/iter	0.96
E2E_Evaluator_cypress	142630.54213657312 ns/iter	159292.3950785973 ns/iter	0.90
E2E_Evaluator_deno	275181.40041755483 ns/iter	345896.6393120015 ns/iter	0.80
E2E_Evaluator_dependabot	334184.78329353145 ns/iter	352603.0655571881 ns/iter	0.95
E2E_Evaluator_draft_04	9029871.678570718 ns/iter	7021453.927835836 ns/iter	1.29
E2E_Evaluator_fabric_mod	716102.117400454 ns/iter	717036.306418193 ns/iter	1.00
E2E_Evaluator_geojson	18768954.56757051 ns/iter	16699401.499998938 ns/iter	1.12
E2E_Evaluator_gitpod_configuration	232564.38042346804 ns/iter	241832.13432319055 ns/iter	0.96
E2E_Evaluator_helm_chart_lock	209112.94231936004 ns/iter	350460.282153536 ns/iter	0.60
E2E_Evaluator_importmap	39171.439647885236 ns/iter	30230.00687438297 ns/iter	1.30
E2E_Evaluator_jasmine	102893.86590876715 ns/iter	107547.54164105536 ns/iter	0.96
E2E_Evaluator_jshintrc	1011605.2774567262 ns/iter	1056307.5015016084 ns/iter	0.96
E2E_Evaluator_jsconfig	397727.60257132637 ns/iter	363556.3761755818 ns/iter	1.09
E2E_Evaluator_krakend	185415.64908561387 ns/iter	172791.68865370785 ns/iter	1.07
E2E_Evaluator_lazygit	124975.61711789512 ns/iter	115834.18195539914 ns/iter	1.08
E2E_Evaluator_lerna	122192.45219640313 ns/iter	172991.8803545029 ns/iter	0.71
E2E_Evaluator_nest_cli	179124.51229511024 ns/iter	190830.97676962966 ns/iter	0.94
E2E_Evaluator_omc	18317.051357852328 ns/iter	18300.10142845797 ns/iter	1.00
E2E_Evaluator_omnisharp	519802.6373134903 ns/iter	568810.0343137666 ns/iter	0.91
E2E_Evaluator_openapi	13070714.277777944 ns/iter	9413426.565215822 ns/iter	1.39
E2E_Evaluator_pre_commit_hooks	465747.13599996665 ns/iter	517546.3457804481 ns/iter	0.90
E2E_Evaluator_pulumi	718761.1271974684 ns/iter	745519.5165067564 ns/iter	0.96
E2E_Evaluator_semantic_release	85607.42261534765 ns/iter	85374.34191264957 ns/iter	1.00
E2E_Evaluator_stale	150738.99289254224 ns/iter	153637.02407006398 ns/iter	0.98
E2E_Evaluator_stylecop	287985.8067020831 ns/iter	280140.1506192493 ns/iter	1.03
E2E_Evaluator_tmuxinator	86528.13993045338 ns/iter	88344.21707470188 ns/iter	0.98
E2E_Evaluator_ui5	525908.8654291814 ns/iter	484837.8726513001 ns/iter	1.08
E2E_Evaluator_ui5_manifest	3590095.7450973927 ns/iter	2634341.249071284 ns/iter	1.36
E2E_Evaluator_unreal_engine_uproject	434345.55174572504 ns/iter	443726.2501588044 ns/iter	0.98
E2E_Evaluator_users_array	646592.2754821561 ns/iter	635840.2911736562 ns/iter	1.02
E2E_Evaluator_vercel	281141.2207357834 ns/iter	343137.3000000031 ns/iter	0.82
E2E_Evaluator_yamllint	9184.16299675293 ns/iter	8870.446782145946 ns/iter	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/gcc)

Details

Benchmark suite	Current: 6c8a118	Previous: 5b9baeb	Ratio
E2E_Evaluator_adaptivecard	123914 ns	114688 ns	1.08
E2E_Evaluator_ansible-meta	557063 ns	528603 ns	1.05
E2E_Evaluator_aws-cdk	129152 ns	146749 ns	0.88
E2E_Evaluator_babelrc	320646 ns	457604 ns	0.70
E2E_Evaluator_cerebrum-criminal-case	2863840 ns	2731368 ns	1.05
E2E_Evaluator_clang-format	273937 ns	327084 ns	0.84
E2E_Evaluator_cmake-presets	19466688 ns	18728192 ns	1.04
E2E_Evaluator_code-climate	511657 ns	536827 ns	0.95
E2E_Evaluator_cql2	1270470 ns	1209702 ns	1.05
E2E_Evaluator_cspell	1927837 ns	1791023 ns	1.08
E2E_Evaluator_cypress	914579 ns	996070 ns	0.92
E2E_Evaluator_deno	1252816 ns	1141248 ns	1.10
E2E_Evaluator_dependabot	1360552 ns	1170227 ns	1.16
E2E_Evaluator_draft-04	31286515 ns	23493654 ns	1.33
E2E_Evaluator_fabric-mod	3006769 ns	2380023 ns	1.26
E2E_Evaluator_geojson	21474059 ns	25607098 ns	0.84
E2E_Evaluator_gitpod-configuration	773685 ns	795454 ns	0.97
E2E_Evaluator_helm-chart-lock	1001627 ns	1057825 ns	0.95
E2E_Evaluator_importmap	285491 ns	321087 ns	0.89
E2E_Evaluator_jasmine	294067 ns	335445 ns	0.88
E2E_Evaluator_jsconfig	1541629 ns	1613831 ns	0.96
E2E_Evaluator_jshintrc	3006340 ns	3039842 ns	0.99
E2E_Evaluator_krakend	663903 ns	627214 ns	1.06
E2E_Evaluator_lazygit	480007 ns	497056 ns	0.97
E2E_Evaluator_lerna	465856 ns	473022 ns	0.98
E2E_Evaluator_nest-cli	649052 ns	690831 ns	0.94
E2E_Evaluator_omc	93296 ns	85443 ns	1.09
E2E_Evaluator_omnisharp	1577951 ns	1522607 ns	1.04
E2E_Evaluator_openapi	28035627 ns	22942805 ns	1.22
E2E_Evaluator_pre-commit-hooks	2207887 ns	2088913 ns	1.06
E2E_Evaluator_pulumi	2214429 ns	2146153 ns	1.03
E2E_Evaluator_semantic-release	231013 ns	291424 ns	0.79
E2E_Evaluator_stale	394501 ns	436470 ns	0.90
E2E_Evaluator_stylecop	1237472 ns	1269622 ns	0.97
E2E_Evaluator_tmuxinator	219336 ns	288884 ns	0.76
E2E_Evaluator_ui5	2369773 ns	2179398 ns	1.09
E2E_Evaluator_ui5-manifest	12752490 ns	9897538 ns	1.29
E2E_Evaluator_unreal-engine-uproject	1682645 ns	1703687 ns	0.99
E2E_Evaluator_users-array	2446636 ns	2652703 ns	0.92
E2E_Evaluator_vercel	1079278 ns	1099856 ns	0.98
E2E_Evaluator_yamllint	24590 ns	27283 ns	0.90

This comment was automatically generated by workflow using github-action-benchmark.