Implement disallow for Draft 3

[jviotti]

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

[augmentcode]

🤖 Augment PR Summary

Summary: Adds full compiler support for Draft 3’s disallow keyword.

Changes:

• Introduces a helper to map Draft 3 type strings into the internal ValueTypes bitset.
• Compiles disallow for both string and array forms, including support for embedded subschemas via LogicalNot.
• Special-cases "any" to always fail validation, matching Draft 3 semantics.
• Enables the previously-blacklisted Draft 3 official-suite tests for disallow.

_{🤖 Was this summary useful? React with 👍 or 👎}

[augmentcode]

Review completed. 1 suggestion posted.

Comment augment review to trigger a new review at any time.

[github-actions]

Benchmark (linux/llvm)

Details

Benchmark suite	Current: d6a7781	Previous: cb26a0b	Ratio
E2E_Compiler_adaptivecard	70079053.87500557 ns/iter	65822376.99999244 ns/iter	1.06
E2E_Compiler_ansible_meta	30011792.173913028 ns/iter	29441992.333332222 ns/iter	1.02
E2E_Compiler_aws_cdk	373879.226063846 ns/iter	389892.62986270344 ns/iter	0.96
E2E_Compiler_babelrc	2587946.2333334773 ns/iter	2693342.905303098 ns/iter	0.96
E2E_Compiler_clang_format	18627869.184208043 ns/iter	18823131.594595492 ns/iter	0.99
E2E_Compiler_cmake_presets	26232181.96296656 ns/iter	26548559.230766736 ns/iter	0.99
E2E_Compiler_code_climate	2628393.700374477 ns/iter	2664955.996183276 ns/iter	0.99
E2E_Compiler_cql2	13045466.113206906 ns/iter	13271585.54716952 ns/iter	0.98
E2E_Compiler_cspell	23146835.666667208 ns/iter	23585312.266667794 ns/iter	0.98
E2E_Compiler_cypress	3962777.813559618 ns/iter	4047864.4011628595 ns/iter	0.98
E2E_Compiler_deno	7785514.899999019 ns/iter	7949088.409090295 ns/iter	0.98
E2E_Compiler_dependabot	4010790.619318527 ns/iter	4051781.236994088 ns/iter	0.99
E2E_Compiler_draft_04	2730293.1959998203 ns/iter	2755971.854330656 ns/iter	0.99
E2E_Compiler_fabric_mod	4824917.924137763 ns/iter	4897149.601398885 ns/iter	0.99
E2E_Compiler_geojson	22580539.193548307 ns/iter	22681029.193548847 ns/iter	1.00
E2E_Compiler_gitpod_configuration	4957295.659574547 ns/iter	5027719.978417846 ns/iter	0.99
E2E_Compiler_helm_chart_lock	685829.5583905734 ns/iter	722656.424557695 ns/iter	0.95
E2E_Compiler_importmap	277112.27024888835 ns/iter	293977.57281147694 ns/iter	0.94
E2E_Compiler_jasmine	1371266.1076319257 ns/iter	1401715.306613283 ns/iter	0.98
E2E_Compiler_jshintrc	4399780.446541307 ns/iter	4471299.833333648 ns/iter	0.98
E2E_Compiler_jsconfig	22394503.433330707 ns/iter	22735939.967740323 ns/iter	0.98
E2E_Compiler_krakend	150783571.59998176 ns/iter	151367130.39998993 ns/iter	1.00
E2E_Compiler_lazygit	34800132.50000411 ns/iter	34620336.89999657 ns/iter	1.01
E2E_Compiler_lerna	1598874.0390804228 ns/iter	1658061.3578201667 ns/iter	0.96
E2E_Compiler_nest_cli	7558731.666665974 ns/iter	7658546.804347936 ns/iter	0.99
E2E_Compiler_omc	178599615.4999907 ns/iter	170194888.50002062 ns/iter	1.05
E2E_Compiler_omnisharp	6823719.147058793 ns/iter	6952153.90000044 ns/iter	0.98
E2E_Compiler_openapi	25448775.40740934 ns/iter	25852425.444440994 ns/iter	0.98
E2E_Compiler_pre_commit_hooks	5353329.5114507275 ns/iter	5467942.581395449 ns/iter	0.98
E2E_Compiler_pulumi	4087650.6453490797 ns/iter	4154139.810651209 ns/iter	0.98
E2E_Compiler_semantic_release	1576606.5900900352 ns/iter	1609693.8068967157 ns/iter	0.98
E2E_Compiler_stale	1559853.3266218558 ns/iter	1600570.4965675261 ns/iter	0.97
E2E_Compiler_stylecop	6253062.61261292 ns/iter	6279085.142857355 ns/iter	1.00
E2E_Compiler_tmuxinator	1930930.972375552 ns/iter	1989311.3210226365 ns/iter	0.97
E2E_Compiler_ui5	50010031.28571873 ns/iter	50378557.899989575 ns/iter	0.99
E2E_Compiler_ui5_manifest	341515188.5000114 ns/iter	331826413.99997693 ns/iter	1.03
E2E_Compiler_unreal_engine_uproject	4660045.620000043 ns/iter	4834766.270270442 ns/iter	0.96
E2E_Compiler_users_array	762121.110262057 ns/iter	810889.3189252409 ns/iter	0.94
E2E_Compiler_vercel	12513480.107143339 ns/iter	12970955.745454788 ns/iter	0.96
E2E_Compiler_yamllint	338143.43463580497 ns/iter	359838.97850557946 ns/iter	0.94
E2E_Evaluator_adaptivecard	23813.170716640096 ns/iter	26268.899072095785 ns/iter	0.91
E2E_Evaluator_ansible_meta	206814.1368098179 ns/iter	230045.04414206208 ns/iter	0.90
E2E_Evaluator_aws_cdk	42204.21003762702 ns/iter	49617.23543569664 ns/iter	0.85
E2E_Evaluator_babelrc	85096.10551849897 ns/iter	106758.74604131746 ns/iter	0.80
E2E_Evaluator_cerebrum_criminal_case	1002892.0416666714 ns/iter	964503.7468706843 ns/iter	1.04
E2E_Evaluator_clang_format	115478.52813424982 ns/iter	121186.94860297485 ns/iter	0.95
E2E_Evaluator_cmake_presets	5491811.0661153775 ns/iter	4283392.517857281 ns/iter	1.28
E2E_Evaluator_code_climate	154772.919565715 ns/iter	178329.54755191438 ns/iter	0.87
E2E_Evaluator_cql2	180299.59850437567 ns/iter	221529.73390420887 ns/iter	0.81
E2E_Evaluator_cspell	544381.33563756 ns/iter	556047.817675117 ns/iter	0.98
E2E_Evaluator_cypress	165792.5153974605 ns/iter	191289.29168930874 ns/iter	0.87
E2E_Evaluator_deno	247834.77591624684 ns/iter	313135.5087956899 ns/iter	0.79
E2E_Evaluator_dependabot	296444.30660981964 ns/iter	318549.69216922217 ns/iter	0.93
E2E_Evaluator_draft_04	10169732.842856709 ns/iter	8678823.285714814 ns/iter	1.17
E2E_Evaluator_fabric_mod	643966.8373162611 ns/iter	685915.7301740617 ns/iter	0.94
E2E_Evaluator_geojson	19129655.076921947 ns/iter	15893912.068179362 ns/iter	1.20
E2E_Evaluator_gitpod_configuration	197507.5243593376 ns/iter	226770.4640416479 ns/iter	0.87
E2E_Evaluator_helm_chart_lock	240005.98269164763 ns/iter	349893.9613095106 ns/iter	0.69
E2E_Evaluator_importmap	40138.28917387383 ns/iter	47521.75460983168 ns/iter	0.84
E2E_Evaluator_jasmine	104451.35036694176 ns/iter	104285.75204764576 ns/iter	1.00
E2E_Evaluator_jshintrc	1203062.2186978557 ns/iter	1188767.933560447 ns/iter	1.01
E2E_Evaluator_jsconfig	397309.9184136002 ns/iter	420734.78247735294 ns/iter	0.94
E2E_Evaluator_krakend	174870.27736316592 ns/iter	206975.00717702904 ns/iter	0.84
E2E_Evaluator_lazygit	120155.46711781934 ns/iter	150767.892360369 ns/iter	0.80
E2E_Evaluator_lerna	107321.22628976338 ns/iter	137183.46543597142 ns/iter	0.78
E2E_Evaluator_nest_cli	166110.11926606286 ns/iter	180730.1260945772 ns/iter	0.92
E2E_Evaluator_omc	16932.29197364351 ns/iter	18656.557642745403 ns/iter	0.91
E2E_Evaluator_omnisharp	558721.9488818094 ns/iter	620784.6221441518 ns/iter	0.90
E2E_Evaluator_openapi	13570981.884616736 ns/iter	9471039.727272555 ns/iter	1.43
E2E_Evaluator_pre_commit_hooks	457205.5331147537 ns/iter	467233.7406915065 ns/iter	0.98
E2E_Evaluator_pulumi	657411.3956562468 ns/iter	651366.9888991923 ns/iter	1.01
E2E_Evaluator_semantic_release	77103.64683110692 ns/iter	95484.66102157172 ns/iter	0.81
E2E_Evaluator_stale	141926.94461413217 ns/iter	145326.34865262258 ns/iter	0.98
E2E_Evaluator_stylecop	257067.07619396035 ns/iter	278849.71291867306 ns/iter	0.92
E2E_Evaluator_tmuxinator	80187.28723405047 ns/iter	95071.94761128105 ns/iter	0.84
E2E_Evaluator_ui5	460248.1539465735 ns/iter	493535.6728571248 ns/iter	0.93
E2E_Evaluator_ui5_manifest	2442125.8758863574 ns/iter	2479252.427046133 ns/iter	0.99
E2E_Evaluator_unreal_engine_uproject	406880.6276780102 ns/iter	413676.5895117484 ns/iter	0.98
E2E_Evaluator_users_array	540383.6130769307 ns/iter	541951.9251134181 ns/iter	1.00
E2E_Evaluator_vercel	241308.01071554102 ns/iter	300475.153179195 ns/iter	0.80
E2E_Evaluator_yamllint	8084.980380382854 ns/iter	8059.6341741426595 ns/iter	1.00
Micro_Draft4_Meta_1_No_Callback	192.46383406010233 ns/iter	189.8613195601531 ns/iter	1.01
Micro_Draft4_Required_Properties	860.2960040663148 ns/iter	798.7954950719826 ns/iter	1.08
Micro_Draft4_Many_Optional_Properties_Minimal_Match	23.771141883316744 ns/iter	20.921720357314108 ns/iter	1.14
Micro_Draft4_Few_Optional_Properties_Minimal_Match	10.657503821937478 ns/iter	10.896222455118874 ns/iter	0.98
Micro_Draft4_Items_Schema	263.20349467196434 ns/iter	296.3420263400309 ns/iter	0.89
Micro_Draft4_Nested_Object	1.4081653579162554 ns/iter	1.81626001687566 ns/iter	0.78
Micro_Draft4_Properties_Triad_Optional	316.77114231545403 ns/iter	313.26910871429897 ns/iter	1.01
Micro_Draft4_Properties_Triad_Closed	262.0776793502567 ns/iter	258.77774579176156 ns/iter	1.01
Micro_Draft4_Properties_Triad_Required	330.40002290670037 ns/iter	330.2851894958121 ns/iter	1.00
Micro_Draft4_Properties_Closed	59.32076171019119 ns/iter	55.01432047895395 ns/iter	1.08
Micro_Draft4_Non_Recursive_Ref	14.7690313147296 ns/iter	12.471679589609211 ns/iter	1.18
Micro_Draft4_Pattern_Properties_True	145.93262294630003 ns/iter	153.54605360666156 ns/iter	0.95
Micro_Draft4_Ref_To_Single_Property	10.648581020216493 ns/iter	10.899055223451159 ns/iter	0.98
Micro_Draft4_Additional_Properties_Type	30.624774838498073 ns/iter	22.02563833283742 ns/iter	1.39
Micro_Draft4_Nested_Oneof	54.393343230270055 ns/iter	58.125263138995145 ns/iter	0.94
Micro_Draft4_Short_Enum	14.066154310121883 ns/iter	11.904810657699715 ns/iter	1.18
Micro_Draft4_Long_Enum	13.028347182285927 ns/iter	14.023919982839207 ns/iter	0.93
Micro_Draft4_Long_Enum_Short_Strings	14.059927124101069 ns/iter	11.837467928065449 ns/iter	1.19
Micro_Draft4_Type_Object	3.517660141278683 ns/iter	3.427785535573821 ns/iter	1.03
Micro_Draft4_Ref_Single_100	2327583.6966668824 ns/iter	2402662.9006851786 ns/iter	0.97
Micro_Draft4_Compile_Ref_Many_Nested	1708786.9364303914 ns/iter	1746635.7388059634 ns/iter	0.98
Micro_Draft4_Compile_Wrap	2364110.6790538947 ns/iter	2427775.8442906165 ns/iter	0.97
Micro_Draft6_Property_Names	115.20369200407525 ns/iter	119.13052658970854 ns/iter	0.97
Micro_Draft6_Compile_FHIR	19795250565.999935 ns/iter	13976366923 ns/iter	1.42
Micro_Draft7_If_Then_Else	23.70813221688768 ns/iter	23.362121589024266 ns/iter	1.01
Micro_2019_09_Unevaluated_Properties	26.097063246565128 ns/iter	28.37754066893456 ns/iter	0.92
Micro_2019_09_Compile_Wrap	353300492.0000167 ns/iter	304901179.500007 ns/iter	1.16
Micro_2020_12_Dynamic_Ref	224.24665163958707 ns/iter	227.39525947739907 ns/iter	0.99
Micro_2020_12_Dynamic_Ref_Single	3.5223466300610626 ns/iter	3.426018622408489 ns/iter	1.03
Micro_2020_12_Simple_Output_Mask	1018.761687779464 ns/iter	1064.9749588858815 ns/iter	0.96
Micro_2020_12_Simple_Output_Annotations	95273.93010239549 ns/iter	107731.44449619882 ns/iter	0.88
Micro_2020_12_Compile_NonCircular_Shared_Refs	1077093.2832817954 ns/iter	1126539.5925927048 ns/iter	0.96
Micro_2020_12_Exhaustive_Deep_Numeric	8496.217712355035 ns/iter	8299.253259993655 ns/iter	1.02
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	168301.33422008064 ns/iter	175561.8428571557 ns/iter	0.96
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	22945.662668913443 ns/iter	22528.48005913303 ns/iter	1.02
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	148.9248808406616 ns/iter	141.84513539774514 ns/iter	1.05
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	3995.539088282901 ns/iter	4277.337513634937 ns/iter	0.93
Alterschema_Check_Readibility_ISO_Language_Set_3	382305849.4999714 ns/iter	364877341.50000507 ns/iter	1.05
Alterschema_Check_Readibility_OMC	93942923.71429661 ns/iter	86098465.49998678 ns/iter	1.09
Alterschema_Check_Readibility_KrakenD	1420725652.9999769 ns/iter	1189812890.999974 ns/iter	1.19
Alterschema_Apply_Readibility_KrakenD	133901503437.00009 ns/iter	120229655442.00008 ns/iter	1.11
Alterschema_Check_Invalid_External_Refs	281545217.9999814 ns/iter	302083502.00001633 ns/iter	0.93

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/llvm)

Details

Benchmark suite	Current: d6a7781	Previous: cb26a0b	Ratio
E2E_Evaluator_adaptivecard	118485 ns	118440 ns	1.00
E2E_Evaluator_ansible-meta	576001 ns	524182 ns	1.10
E2E_Evaluator_aws-cdk	130273 ns	139064 ns	0.94
E2E_Evaluator_babelrc	339944 ns	320371 ns	1.06
E2E_Evaluator_cerebrum-criminal-case	2795930 ns	2540048 ns	1.10
E2E_Evaluator_clang-format	307894 ns	254618 ns	1.21
E2E_Evaluator_cmake-presets	20308146 ns	17353817 ns	1.17
E2E_Evaluator_code-climate	509990 ns	514518 ns	0.99
E2E_Evaluator_cql2	1265478 ns	1252774 ns	1.01
E2E_Evaluator_cspell	1732779 ns	1475415 ns	1.17
E2E_Evaluator_cypress	916728 ns	762346 ns	1.20
E2E_Evaluator_deno	1169514 ns	1045483 ns	1.12
E2E_Evaluator_dependabot	1237990 ns	1161215 ns	1.07
E2E_Evaluator_draft-04	31532552 ns	19758247 ns	1.60
E2E_Evaluator_fabric-mod	2846447 ns	2367581 ns	1.20
E2E_Evaluator_geojson	22271344 ns	24014185 ns	0.93
E2E_Evaluator_gitpod-configuration	788342 ns	707557 ns	1.11
E2E_Evaluator_helm-chart-lock	1008204 ns	1043199 ns	0.97
E2E_Evaluator_importmap	269286 ns	265296 ns	1.02
E2E_Evaluator_jasmine	286184 ns	299329 ns	0.96
E2E_Evaluator_jsconfig	1584687 ns	1214780 ns	1.30
E2E_Evaluator_jshintrc	3113099 ns	2696455 ns	1.15
E2E_Evaluator_krakend	655618 ns	672017 ns	0.98
E2E_Evaluator_lazygit	495956 ns	502460 ns	0.99
E2E_Evaluator_lerna	484149 ns	459600 ns	1.05
E2E_Evaluator_nest-cli	639187 ns	579755 ns	1.10
E2E_Evaluator_omc	92810 ns	93876 ns	0.99
E2E_Evaluator_omnisharp	1580333 ns	1415205 ns	1.12
E2E_Evaluator_openapi	28954838 ns	22259548 ns	1.30
E2E_Evaluator_pre-commit-hooks	2189616 ns	1970753 ns	1.11
E2E_Evaluator_pulumi	2156505 ns	1901319 ns	1.13
E2E_Evaluator_semantic-release	243176 ns	253894 ns	0.96
E2E_Evaluator_stale	395560 ns	408313 ns	0.97
E2E_Evaluator_stylecop	1290975 ns	1253742 ns	1.03
E2E_Evaluator_tmuxinator	222006 ns	223515 ns	0.99
E2E_Evaluator_ui5	2263183 ns	2340103 ns	0.97
E2E_Evaluator_ui5-manifest	12457671 ns	10382025 ns	1.20
E2E_Evaluator_unreal-engine-uproject	1662627 ns	1533620 ns	1.08
E2E_Evaluator_users-array	2499747 ns	2546735 ns	0.98
E2E_Evaluator_vercel	1018441 ns	987858 ns	1.03
E2E_Evaluator_yamllint	24508 ns	25715 ns	0.95

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (macos/llvm)

Details

Benchmark suite	Current: d6a7781	Previous: cb26a0b	Ratio
E2E_Compiler_adaptivecard	97805402.66668443 ns/iter	68338322.87499319 ns/iter	1.43
E2E_Compiler_ansible_meta	35700112.500001065 ns/iter	28302267.241381995 ns/iter	1.26
E2E_Compiler_aws_cdk	452718.27290080226 ns/iter	288585.9473023972 ns/iter	1.57
E2E_Compiler_babelrc	3006389.478764592 ns/iter	2270966.2961783665 ns/iter	1.32
E2E_Compiler_clang_format	25017668.178577423 ns/iter	15352899.312498873 ns/iter	1.63
E2E_Compiler_cmake_presets	41108083.33333201 ns/iter	26597418.222220566 ns/iter	1.55
E2E_Compiler_code_climate	3479527.217742147 ns/iter	2414040.416666694 ns/iter	1.44
E2E_Compiler_cql2	23027947.3235321 ns/iter	12135017.081967086 ns/iter	1.90
E2E_Compiler_cspell	34437535.05263502 ns/iter	20343311.361108996 ns/iter	1.69
E2E_Compiler_cypress	5968014.563105825 ns/iter	3720426.0947365393 ns/iter	1.60
E2E_Compiler_deno	12069350.746267093 ns/iter	6705532.243477532 ns/iter	1.80
E2E_Compiler_dependabot	5685851.0472448245 ns/iter	3630898.8112244946 ns/iter	1.57
E2E_Compiler_draft_04	3142771.247524089 ns/iter	2015816.3623594656 ns/iter	1.56
E2E_Compiler_fabric_mod	5619257.079999898 ns/iter	4424200.897297801 ns/iter	1.27
E2E_Compiler_geojson	35433897.72726807 ns/iter	27579483.870967593 ns/iter	1.28
E2E_Compiler_gitpod_configuration	6239145.642201522 ns/iter	4236533.885542015 ns/iter	1.47
E2E_Compiler_helm_chart_lock	763847.291718146 ns/iter	553397.6126657086 ns/iter	1.38
E2E_Compiler_importmap	257416.42489623875 ns/iter	221890.9731199892 ns/iter	1.16
E2E_Compiler_jasmine	1496175.1930233603 ns/iter	1094055.9787234296 ns/iter	1.37
E2E_Compiler_jshintrc	5419874.44736797 ns/iter	3326332.754629338 ns/iter	1.63
E2E_Compiler_jsconfig	30035126.826078344 ns/iter	19096423.076922663 ns/iter	1.57
E2E_Compiler_krakend	205830972.33331195 ns/iter	149568323.00001112 ns/iter	1.38
E2E_Compiler_lazygit	48605642.85715035 ns/iter	35255825.00000155 ns/iter	1.38
E2E_Compiler_lerna	1965229.2321981925 ns/iter	1394931.2144213626 ns/iter	1.41
E2E_Compiler_nest_cli	9790482.674157174 ns/iter	6387090.2719294885 ns/iter	1.53
E2E_Compiler_omc	265678596.99995705 ns/iter	194698614.49999827 ns/iter	1.36
E2E_Compiler_omnisharp	8868427.77333489 ns/iter	6492957.589285554 ns/iter	1.37
E2E_Compiler_openapi	34119373.09090263 ns/iter	23192902.787879135 ns/iter	1.47
E2E_Compiler_pre_commit_hooks	6028622.983871129 ns/iter	4640532.379518532 ns/iter	1.30
E2E_Compiler_pulumi	3999174.941177042 ns/iter	3703470.849765469 ns/iter	1.08
E2E_Compiler_semantic_release	1735017.231308609 ns/iter	1271875.0000000729 ns/iter	1.36
E2E_Compiler_stale	2052285.7142859483 ns/iter	1284318.195501715 ns/iter	1.60
E2E_Compiler_stylecop	9462211.000001075 ns/iter	5635343.29710101 ns/iter	1.68
E2E_Compiler_tmuxinator	2324825.216911777 ns/iter	1569380.1556886581 ns/iter	1.48
E2E_Compiler_ui5	80737516.59999289 ns/iter	56185477.53846752 ns/iter	1.44
E2E_Compiler_ui5_manifest	526146082.9999578 ns/iter	318071874.9999869 ns/iter	1.65
E2E_Compiler_unreal_engine_uproject	5759041.669291294 ns/iter	3900681.081080546 ns/iter	1.48
E2E_Compiler_users_array	1301665.025590682 ns/iter	768491.0330330343 ns/iter	1.69
E2E_Compiler_vercel	18729090.064513706 ns/iter	11979279.564515779 ns/iter	1.56
E2E_Compiler_yamllint	415287.3101550691 ns/iter	288810.898672286 ns/iter	1.44
E2E_Evaluator_adaptivecard	24542.419827162506 ns/iter	18239.031933132974 ns/iter	1.35
E2E_Evaluator_ansible_meta	232149.03967170088 ns/iter	163883.52854217833 ns/iter	1.42
E2E_Evaluator_aws_cdk	53581.97499999733 ns/iter	34004.096944853954 ns/iter	1.58
E2E_Evaluator_babelrc	117049.68967847973 ns/iter	75982.84163081148 ns/iter	1.54
E2E_Evaluator_cerebrum_criminal_case	1071840.511204597 ns/iter	621676.7842494075 ns/iter	1.72
E2E_Evaluator_clang_format	138614.28571430588 ns/iter	103202.02403987505 ns/iter	1.34
E2E_Evaluator_cmake_presets	4910182.086614727 ns/iter	3495812.701923084 ns/iter	1.40
E2E_Evaluator_code_climate	205532.82967032396 ns/iter	126968.84929844261 ns/iter	1.62
E2E_Evaluator_cql2	242695.39930554313 ns/iter	144901.01367147133 ns/iter	1.67
E2E_Evaluator_cspell	600291.368839505 ns/iter	398099.7631734789 ns/iter	1.51
E2E_Evaluator_cypress	202773.1237081477 ns/iter	148747.9969573837 ns/iter	1.36
E2E_Evaluator_deno	334925.9103976971 ns/iter	216883.65697674226 ns/iter	1.54
E2E_Evaluator_dependabot	354581.4423939516 ns/iter	232245.45527672253 ns/iter	1.53
E2E_Evaluator_draft_04	7962297.673077937 ns/iter	5445627.080000577 ns/iter	1.46
E2E_Evaluator_fabric_mod	705720.5508884714 ns/iter	476395.40642075054 ns/iter	1.48
E2E_Evaluator_geojson	15952665.589746827 ns/iter	11003791.661538834 ns/iter	1.45
E2E_Evaluator_gitpod_configuration	227104.9612205852 ns/iter	169925.79300763638 ns/iter	1.34
E2E_Evaluator_helm_chart_lock	317414.4313984906 ns/iter	211147.8513315693 ns/iter	1.50
E2E_Evaluator_importmap	43052.32041499899 ns/iter	34026.85523237919 ns/iter	1.27
E2E_Evaluator_jasmine	110828.85216176927 ns/iter	85182.83197631271 ns/iter	1.30
E2E_Evaluator_jshintrc	1332515.810276947 ns/iter	945651.5306122246 ns/iter	1.41
E2E_Evaluator_jsconfig	484803.4733124317 ns/iter	295662.1706792726 ns/iter	1.64
E2E_Evaluator_krakend	231828.64595287602 ns/iter	131233.0060273909 ns/iter	1.77
E2E_Evaluator_lazygit	158185.08399109248 ns/iter	96669.59032861129 ns/iter	1.64
E2E_Evaluator_lerna	179295.52687638171 ns/iter	109621.89816916114 ns/iter	1.64
E2E_Evaluator_nest_cli	207226.25764569294 ns/iter	121657.40746171426 ns/iter	1.70
E2E_Evaluator_omc	21019.58216435897 ns/iter	13101.931545846546 ns/iter	1.60
E2E_Evaluator_omnisharp	667946.3292469364 ns/iter	415641.4711191456 ns/iter	1.61
E2E_Evaluator_openapi	9497708.954544386 ns/iter	5855006.1874997895 ns/iter	1.62
E2E_Evaluator_pre_commit_hooks	546625.58300015 ns/iter	325460.3647444891 ns/iter	1.68
E2E_Evaluator_pulumi	764103.7416934812 ns/iter	501852.8645833619 ns/iter	1.52
E2E_Evaluator_semantic_release	99794.80451128876 ns/iter	68550.12449373797 ns/iter	1.46
E2E_Evaluator_stale	152363.7435172456 ns/iter	106982.41138945463 ns/iter	1.42
E2E_Evaluator_stylecop	271093.0767894692 ns/iter	176974.83584759608 ns/iter	1.53
E2E_Evaluator_tmuxinator	112309.1987620211 ns/iter	73744.73258828286 ns/iter	1.52
E2E_Evaluator_ui5	547058.7305070922 ns/iter	386332.2411820757 ns/iter	1.42
E2E_Evaluator_ui5_manifest	2510452.577405764 ns/iter	1655928.4934497478 ns/iter	1.52
E2E_Evaluator_unreal_engine_uproject	474105.3118279172 ns/iter	326740.8845286195 ns/iter	1.45
E2E_Evaluator_users_array	608115.9440388465 ns/iter	460077.2760844515 ns/iter	1.32
E2E_Evaluator_vercel	342448.727775377 ns/iter	228468.31079402452 ns/iter	1.50
E2E_Evaluator_yamllint	8141.162417636038 ns/iter	5813.890415769198 ns/iter	1.40
Micro_Draft4_Meta_1_No_Callback	202.37165277271174 ns/iter	134.815993749686 ns/iter	1.50
Micro_Draft4_Required_Properties	946.0546999567757 ns/iter	641.7540907062495 ns/iter	1.47
Micro_Draft4_Many_Optional_Properties_Minimal_Match	23.451752129432872 ns/iter	15.341454763145347 ns/iter	1.53
Micro_Draft4_Few_Optional_Properties_Minimal_Match	9.703788352343635 ns/iter	7.193445776471353 ns/iter	1.35
Micro_Draft4_Items_Schema	333.67040843576945 ns/iter	266.2250735666611 ns/iter	1.25
Micro_Draft4_Nested_Object	0.8851200272527922 ns/iter	0.7358298507603662 ns/iter	1.20
Micro_Draft4_Properties_Triad_Optional	312.4424421858979 ns/iter	235.64341279175997 ns/iter	1.33
Micro_Draft4_Properties_Triad_Closed	247.29765104294776 ns/iter	178.233341854501 ns/iter	1.39
Micro_Draft4_Properties_Triad_Required	301.1721906157747 ns/iter	222.1040344804673 ns/iter	1.36
Micro_Draft4_Properties_Closed	49.19283535023946 ns/iter	40.61111656776903 ns/iter	1.21
Micro_Draft4_Non_Recursive_Ref	15.512919247049028 ns/iter	16.34263960393837 ns/iter	0.95
Micro_Draft4_Pattern_Properties_True	183.77632256914833 ns/iter	149.33423752177737 ns/iter	1.23
Micro_Draft4_Ref_To_Single_Property	9.406189075405873 ns/iter	7.161429226481343 ns/iter	1.31
Micro_Draft4_Additional_Properties_Type	31.48331136468686 ns/iter	25.297935888875163 ns/iter	1.24
Micro_Draft4_Nested_Oneof	67.96032496373039 ns/iter	40.102683087589334 ns/iter	1.69
Micro_Draft4_Short_Enum	6.73278490268095 ns/iter	4.749713477625283 ns/iter	1.42
Micro_Draft4_Long_Enum	13.14213176230178 ns/iter	9.78097370642221 ns/iter	1.34
Micro_Draft4_Long_Enum_Short_Strings	7.329238455974219 ns/iter	6.160311932198394 ns/iter	1.19
Micro_Draft4_Type_Object	2.7729840584514998 ns/iter	2.1894469252181996 ns/iter	1.27
Micro_Draft4_Ref_Single_100	2522224.569852771 ns/iter	1750885.4430380329 ns/iter	1.44
Micro_Draft4_Compile_Ref_Many_Nested	1732993.4145079746 ns/iter	1311433.8710802842 ns/iter	1.32
Micro_Draft4_Compile_Wrap	2903165.76724214 ns/iter	2017807.755043344 ns/iter	1.44
Micro_Draft6_Property_Names	148.07524101516725 ns/iter	94.06306707694289 ns/iter	1.57
Micro_Draft6_Compile_FHIR	21609029834.00001 ns/iter	9212910041.999975 ns/iter	2.35
Micro_Draft7_If_Then_Else	24.72362057692566 ns/iter	17.25613966657504 ns/iter	1.43
Micro_2019_09_Unevaluated_Properties	41.22028775763773 ns/iter	27.182707414557804 ns/iter	1.52
Micro_2019_09_Compile_Wrap	451272749.9999301 ns/iter	298485979.00002 ns/iter	1.51
Micro_2020_12_Dynamic_Ref	303.67265400895616 ns/iter	186.18281916695832 ns/iter	1.63
Micro_2020_12_Dynamic_Ref_Single	3.176672583575162 ns/iter	2.1889231304922787 ns/iter	1.45
Micro_2020_12_Simple_Output_Mask	1201.7655586713397 ns/iter	792.4440109594273 ns/iter	1.52
Micro_2020_12_Simple_Output_Annotations	123321.66672642554 ns/iter	85856.35799901623 ns/iter	1.44
Micro_2020_12_Compile_NonCircular_Shared_Refs	1479432.1503132342 ns/iter	818545.9123223815 ns/iter	1.81
Micro_2020_12_Exhaustive_Deep_Numeric	7558.981298775059 ns/iter	5410.988029437842 ns/iter	1.40
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	180107.55427926517 ns/iter	118656.28189857863 ns/iter	1.52
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	27689.831403907512 ns/iter	14592.240910501054 ns/iter	1.90
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	141.45844555505604 ns/iter	94.91806318391063 ns/iter	1.49
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	7258.404756089486 ns/iter	4911.249429825773 ns/iter	1.48
Alterschema_Check_Readibility_ISO_Language_Set_3	368295312.50009495 ns/iter	237501722.33333918 ns/iter	1.55
Alterschema_Check_Readibility_OMC	100685724.00001585 ns/iter	59472736.16666848 ns/iter	1.69
Alterschema_Check_Readibility_KrakenD	1699988249.999933 ns/iter	653616166.0000062 ns/iter	2.60
Alterschema_Apply_Readibility_KrakenD	92271783542.00009 ns/iter	62071039500.00021 ns/iter	1.49
Alterschema_Check_Invalid_External_Refs	236410736.00000104 ns/iter	161925593.75002703 ns/iter	1.46

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (macos/llvm)

Details

Benchmark suite	Current: d6a7781	Previous: cb26a0b	Ratio
E2E_Evaluator_adaptivecard	161037 ns	92693 ns	1.74
E2E_Evaluator_ansible-meta	546164 ns	340147 ns	1.61
E2E_Evaluator_aws-cdk	165097 ns	108316 ns	1.52
E2E_Evaluator_babelrc	457544 ns	255210 ns	1.79
E2E_Evaluator_cerebrum-criminal-case	2637265 ns	1545265 ns	1.71
E2E_Evaluator_clang-format	299901 ns	167456 ns	1.79
E2E_Evaluator_cmake-presets	22946236 ns	12176198 ns	1.88
E2E_Evaluator_code-climate	609888 ns	393244 ns	1.55
E2E_Evaluator_cql2	1814275 ns	1000409 ns	1.81
E2E_Evaluator_cspell	3012784 ns	1207506 ns	2.50
E2E_Evaluator_cypress	1312376 ns	550704 ns	2.38
E2E_Evaluator_deno	2096641 ns	715271 ns	2.93
E2E_Evaluator_dependabot	2351535 ns	724831 ns	3.24
E2E_Evaluator_draft-04	31186972 ns	14926706 ns	2.09
E2E_Evaluator_fabric-mod	3333862 ns	1295769 ns	2.57
E2E_Evaluator_geojson	21759331 ns	14027392 ns	1.55
E2E_Evaluator_gitpod-configuration	852166 ns	453982 ns	1.88
E2E_Evaluator_helm-chart-lock	982065 ns	795569 ns	1.23
E2E_Evaluator_importmap	304920 ns	196200 ns	1.55
E2E_Evaluator_jasmine	311577 ns	198751 ns	1.57
E2E_Evaluator_jsconfig	1108326 ns	896026 ns	1.24
E2E_Evaluator_jshintrc	2988483 ns	2128333 ns	1.40
E2E_Evaluator_krakend	492453 ns	402885 ns	1.22
E2E_Evaluator_lazygit	406599 ns	253670 ns	1.60
E2E_Evaluator_lerna	387610 ns	294167 ns	1.32
E2E_Evaluator_nest-cli	590221 ns	411879 ns	1.43
E2E_Evaluator_omc	92723 ns	68974 ns	1.34
E2E_Evaluator_omnisharp	1538573 ns	965711 ns	1.59
E2E_Evaluator_openapi	24286087 ns	15351117 ns	1.58
E2E_Evaluator_pre-commit-hooks	2296733 ns	1304577 ns	1.76
E2E_Evaluator_pulumi	2094059 ns	1360069 ns	1.54
E2E_Evaluator_semantic-release	235522 ns	179026 ns	1.32
E2E_Evaluator_stale	393689 ns	278375 ns	1.41
E2E_Evaluator_stylecop	1282600 ns	699811 ns	1.83
E2E_Evaluator_tmuxinator	223092 ns	157685 ns	1.41
E2E_Evaluator_ui5	2090152 ns	1487892 ns	1.40
E2E_Evaluator_ui5-manifest	11691849 ns	9459540 ns	1.24
E2E_Evaluator_unreal-engine-uproject	1371993 ns	1147625 ns	1.20
E2E_Evaluator_users-array	2614799 ns	1835737 ns	1.42
E2E_Evaluator_vercel	1163770 ns	756498 ns	1.54
E2E_Evaluator_yamllint	28328 ns	22913 ns	1.24

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Details

Benchmark suite	Current: d6a7781	Previous: cb26a0b	Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3	387890178.50001526 ns/iter	375173863.99997574 ns/iter	1.03
Alterschema_Check_Readibility_OMC	107017569.7142791 ns/iter	98633907.85715507 ns/iter	1.08
Alterschema_Check_Readibility_KrakenD	1550495110.9999182 ns/iter	1342730494.0000794 ns/iter	1.15
Alterschema_Apply_Readibility_KrakenD	141212464276.99997 ns/iter	139466719425.00006 ns/iter	1.01
Alterschema_Check_Invalid_External_Refs	312958934.9999833 ns/iter	353032600.0000059 ns/iter	0.89
Micro_2020_12_Dynamic_Ref	258.62666286733264 ns/iter	261.2685304537304 ns/iter	0.99
Micro_2020_12_Dynamic_Ref_Single	4.219694605311794 ns/iter	4.735270287916898 ns/iter	0.89
Micro_2020_12_Simple_Output_Mask	1128.6259357817212 ns/iter	1181.0105226277067 ns/iter	0.96
Micro_2020_12_Simple_Output_Annotations	106998.11355081311 ns/iter	116693.26428088556 ns/iter	0.92
Micro_2020_12_Compile_NonCircular_Shared_Refs	1192260.0374786814 ns/iter	1268416.0943059376 ns/iter	0.94
Micro_2020_12_Exhaustive_Deep_Numeric	7822.356307658098 ns/iter	8421.922105713425 ns/iter	0.93
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	168026.2770624923 ns/iter	168499.5633198029 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	26087.420443952 ns/iter	26711.42844533807 ns/iter	0.98
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	134.58003225571125 ns/iter	141.5110305557251 ns/iter	0.95
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4628.771602834832 ns/iter	4956.247622774227 ns/iter	0.93
Micro_2019_09_Unevaluated_Properties	28.61203808821513 ns/iter	28.96499412758599 ns/iter	0.99
Micro_2019_09_Compile_Wrap	344483054.4999604 ns/iter	333878503.50004554 ns/iter	1.03
Micro_Draft7_If_Then_Else	25.113936625370513 ns/iter	25.59448585799214 ns/iter	0.98
Micro_Draft6_Property_Names	144.03152913749136 ns/iter	151.8272721627398 ns/iter	0.95
Micro_Draft6_Compile_FHIR	16812854486.000105 ns/iter	14735110960.999918 ns/iter	1.14
Micro_Draft4_Meta_1_No_Callback	174.10722625029155 ns/iter	165.7389021883355 ns/iter	1.05
Micro_Draft4_Required_Properties	808.4596223148235 ns/iter	853.2061766837093 ns/iter	0.95
Micro_Draft4_Many_Optional_Properties_Minimal_Match	21.134246771336514 ns/iter	20.28251798112198 ns/iter	1.04
Micro_Draft4_Few_Optional_Properties_Minimal_Match	13.021323019984312 ns/iter	13.103601881495162 ns/iter	0.99
Micro_Draft4_Items_Schema	316.5530418187231 ns/iter	347.92122121157695 ns/iter	0.91
Micro_Draft4_Nested_Object	1.7582481391198213 ns/iter	1.8691215251902438 ns/iter	0.94
Micro_Draft4_Properties_Triad_Optional	454.3023584733368 ns/iter	438.977922911653 ns/iter	1.03
Micro_Draft4_Properties_Triad_Closed	385.7222964116763 ns/iter	319.7564663776535 ns/iter	1.21
Micro_Draft4_Properties_Triad_Required	422.2392074447702 ns/iter	403.5879116942409 ns/iter	1.05
Micro_Draft4_Properties_Closed	62.372190484997084 ns/iter	62.130974918483304 ns/iter	1.00
Micro_Draft4_Non_Recursive_Ref	8.828759245348108 ns/iter	9.655682204094907 ns/iter	0.91
Micro_Draft4_Pattern_Properties_True	187.54173746531887 ns/iter	218.20220103757126 ns/iter	0.86
Micro_Draft4_Ref_To_Single_Property	12.659302836604944 ns/iter	13.093527958004998 ns/iter	0.97
Micro_Draft4_Additional_Properties_Type	14.86351172546588 ns/iter	15.572105793378062 ns/iter	0.95
Micro_Draft4_Nested_Oneof	65.45263225950559 ns/iter	65.67046121057092 ns/iter	1.00
Micro_Draft4_Short_Enum	14.775151319297274 ns/iter	14.726598508581644 ns/iter	1.00
Micro_Draft4_Long_Enum	14.777255193674517 ns/iter	14.04796746149048 ns/iter	1.05
Micro_Draft4_Long_Enum_Short_Strings	14.76462584370994 ns/iter	14.692437842946923 ns/iter	1.00
Micro_Draft4_Type_Object	4.221312871997217 ns/iter	4.688136462288865 ns/iter	0.90
Micro_Draft4_Ref_Single_100	2537067.625898541 ns/iter	2519544.0251796725 ns/iter	1.01
Micro_Draft4_Compile_Ref_Many_Nested	1849295.955026411 ns/iter	1831754.9999995464 ns/iter	1.01
Micro_Draft4_Compile_Wrap	2590746.2177117625 ns/iter	2586053.6518520247 ns/iter	1.00
E2E_Compiler_adaptivecard	73097535.20000868 ns/iter	68980715.2000185 ns/iter	1.06
E2E_Compiler_ansible_meta	31333487.454544827 ns/iter	30748036.608696092 ns/iter	1.02
E2E_Compiler_aws_cdk	403575.7083812313 ns/iter	424290.9793438484 ns/iter	0.95
E2E_Compiler_babelrc	2799699.660000442 ns/iter	2792753.1999994246 ns/iter	1.00
E2E_Compiler_clang_format	20047009.571427613 ns/iter	19870976.48571502 ns/iter	1.01
E2E_Compiler_cmake_presets	28590509.239993483 ns/iter	27809828.919998836 ns/iter	1.03
E2E_Compiler_code_climate	2839526.2032514377 ns/iter	2817376.5081302873 ns/iter	1.01
E2E_Compiler_cql2	14437301.208332086 ns/iter	14317158.346937839 ns/iter	1.01
E2E_Compiler_cspell	24776196.285716064 ns/iter	24330470.67857582 ns/iter	1.02
E2E_Compiler_cypress	4259286.987803535 ns/iter	4143100.425149449 ns/iter	1.03
E2E_Compiler_deno	8332478.940474175 ns/iter	8296461.941175521 ns/iter	1.00
E2E_Compiler_dependabot	4266411.408536896 ns/iter	4245937.084847769 ns/iter	1.00
E2E_Compiler_draft_04	2939015.6638651243 ns/iter	2969730.0472107134 ns/iter	0.99
E2E_Compiler_fabric_mod	5232935.721804274 ns/iter	5211041.02238754 ns/iter	1.00
E2E_Compiler_geojson	24794573.35713927 ns/iter	24401276.344829526 ns/iter	1.02
E2E_Compiler_gitpod_configuration	5368697.007633141 ns/iter	5338569.6287874095 ns/iter	1.01
E2E_Compiler_helm_chart_lock	752663.8029352268 ns/iter	764780.8904710677 ns/iter	0.98
E2E_Compiler_importmap	297790.9187925658 ns/iter	315925.4364791295 ns/iter	0.94
E2E_Compiler_jasmine	1460235.5176711117 ns/iter	1496667.522198442 ns/iter	0.98
E2E_Compiler_jshintrc	4666969.228188257 ns/iter	4739250.328767624 ns/iter	0.98
E2E_Compiler_jsconfig	23880392.13333286 ns/iter	23550160.533333536 ns/iter	1.01
E2E_Compiler_krakend	151170234.19998077 ns/iter	153033628.39999864 ns/iter	0.99
E2E_Compiler_lazygit	38375544.526316896 ns/iter	36455529.89473799 ns/iter	1.05
E2E_Compiler_lerna	1728231.1086417416 ns/iter	1768592.2817260372 ns/iter	0.98
E2E_Compiler_nest_cli	8097883.977009995 ns/iter	8127941.850575397 ns/iter	1.00
E2E_Compiler_omc	179602019.50000966 ns/iter	172213756.25001657 ns/iter	1.04
E2E_Compiler_omnisharp	7284413.760416442 ns/iter	7262846.87628969 ns/iter	1.00
E2E_Compiler_openapi	27750325.360002536 ns/iter	27164383.769226894 ns/iter	1.02
E2E_Compiler_pre_commit_hooks	5765201.3500008555 ns/iter	5723370.655737497 ns/iter	1.01
E2E_Compiler_pulumi	4392738.176100283 ns/iter	4400617.487341393 ns/iter	1.00
E2E_Compiler_semantic_release	1713128.144254365 ns/iter	1711716.842364493 ns/iter	1.00
E2E_Compiler_stale	1663277.3007160923 ns/iter	1685079.3100961535 ns/iter	0.99
E2E_Compiler_stylecop	6379580.672726413 ns/iter	6363704.900001142 ns/iter	1.00
E2E_Compiler_tmuxinator	2112625.6066066627 ns/iter	2129596.419453096 ns/iter	0.99
E2E_Compiler_ui5	52818332.30768685 ns/iter	51019135.2999982 ns/iter	1.04
E2E_Compiler_ui5_manifest	347016240.0000163 ns/iter	339173661.5000127 ns/iter	1.02
E2E_Compiler_unreal_engine_uproject	4950186.598590898 ns/iter	4969799.6737595145 ns/iter	1.00
E2E_Compiler_users_array	862965.8181817525 ns/iter	884841.7726129806 ns/iter	0.98
E2E_Compiler_vercel	13428076.788460867 ns/iter	13260568.943395518 ns/iter	1.01
E2E_Compiler_yamllint	362758.1097308152 ns/iter	381827.9334787573 ns/iter	0.95
E2E_Evaluator_adaptivecard	23217.685924365604 ns/iter	23326.942899999874 ns/iter	1.00
E2E_Evaluator_ansible_meta	223754.67611466305 ns/iter	246068.7811068584 ns/iter	0.91
E2E_Evaluator_aws_cdk	45396.979880779756 ns/iter	52329.445464806115 ns/iter	0.87
E2E_Evaluator_babelrc	83950.02379796411 ns/iter	106113.32986366855 ns/iter	0.79
E2E_Evaluator_cerebrum_criminal_case	1073598.2176655729 ns/iter	1030618.4823009134 ns/iter	1.04
E2E_Evaluator_clang_format	92853.91225437172 ns/iter	102666.65384049618 ns/iter	0.90
E2E_Evaluator_cmake_presets	6088055.901784628 ns/iter	4785465.797201961 ns/iter	1.27
E2E_Evaluator_code_climate	166654.35808580625 ns/iter	193422.02514287367 ns/iter	0.86
E2E_Evaluator_cql2	200767.77911648832 ns/iter	217947.91875196257 ns/iter	0.92
E2E_Evaluator_cspell	507927.7428361203 ns/iter	537852.6656416794 ns/iter	0.94
E2E_Evaluator_cypress	134490.755818439 ns/iter	175171.17781118993 ns/iter	0.77
E2E_Evaluator_deno	296694.92524083727 ns/iter	343015.4552491678 ns/iter	0.86
E2E_Evaluator_dependabot	333976.52192565094 ns/iter	366329.16373958247 ns/iter	0.91
E2E_Evaluator_draft_04	8639617.775000375 ns/iter	8019866.393259067 ns/iter	1.08
E2E_Evaluator_fabric_mod	709621.7817258645 ns/iter	757803.9183895998 ns/iter	0.94
E2E_Evaluator_geojson	18087475.121951796 ns/iter	15846572.844444988 ns/iter	1.14
E2E_Evaluator_gitpod_configuration	219737.1789407613 ns/iter	253518.53280460864 ns/iter	0.87
E2E_Evaluator_helm_chart_lock	206820.5352993447 ns/iter	310014.58908935264 ns/iter	0.67
E2E_Evaluator_importmap	40029.32740767215 ns/iter	48834.7001522072 ns/iter	0.82
E2E_Evaluator_jasmine	100908.57682875039 ns/iter	119061.68832714284 ns/iter	0.85
E2E_Evaluator_jshintrc	985381.2112678369 ns/iter	1048281.753048949 ns/iter	0.94
E2E_Evaluator_jsconfig	361906.73460943135 ns/iter	399496.9309360905 ns/iter	0.91
E2E_Evaluator_krakend	179014.06925061598 ns/iter	207115.34758871936 ns/iter	0.86
E2E_Evaluator_lazygit	121050.24804990934 ns/iter	131587.8527571683 ns/iter	0.92
E2E_Evaluator_lerna	133351.93937646944 ns/iter	149942.59319148617 ns/iter	0.89
E2E_Evaluator_nest_cli	177605.56491679273 ns/iter	194125.48737649503 ns/iter	0.91
E2E_Evaluator_omc	18474.538746257134 ns/iter	18755.80513282713 ns/iter	0.99
E2E_Evaluator_omnisharp	504292.0881923577 ns/iter	548974.3840063169 ns/iter	0.92
E2E_Evaluator_openapi	12111770.896549858 ns/iter	11121089.00000308 ns/iter	1.09
E2E_Evaluator_pre_commit_hooks	466803.23673738417 ns/iter	516183.3757623027 ns/iter	0.90
E2E_Evaluator_pulumi	703310.3775719379 ns/iter	733587.5519411246 ns/iter	0.96
E2E_Evaluator_semantic_release	85178.19189451936 ns/iter	104294.11907963184 ns/iter	0.82
E2E_Evaluator_stale	146302.27483791846 ns/iter	153918.73801706452 ns/iter	0.95
E2E_Evaluator_stylecop	282312.003658473 ns/iter	310262.42434638215 ns/iter	0.91
E2E_Evaluator_tmuxinator	86355.83823348008 ns/iter	106396.69349570115 ns/iter	0.81
E2E_Evaluator_ui5	497390.8855932076 ns/iter	540890.057857775 ns/iter	0.92
E2E_Evaluator_ui5_manifest	2715874.629343822 ns/iter	2878878.4538152823 ns/iter	0.94
E2E_Evaluator_unreal_engine_uproject	434608.5926387883 ns/iter	471764.96598626877 ns/iter	0.92
E2E_Evaluator_users_array	640095.7318436747 ns/iter	611344.7393200431 ns/iter	1.05
E2E_Evaluator_vercel	252860.4865759774 ns/iter	306605.1312554585 ns/iter	0.82
E2E_Evaluator_yamllint	9236.807659485657 ns/iter	11373.793291803602 ns/iter	0.81

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/gcc)

Details

Benchmark suite	Current: d6a7781	Previous: cb26a0b	Ratio
E2E_Evaluator_adaptivecard	117666 ns	118697 ns	0.99
E2E_Evaluator_ansible-meta	551550 ns	528563 ns	1.04
E2E_Evaluator_aws-cdk	133395 ns	140350 ns	0.95
E2E_Evaluator_babelrc	314096 ns	328323 ns	0.96
E2E_Evaluator_cerebrum-criminal-case	2778890 ns	2502607 ns	1.11
E2E_Evaluator_clang-format	259645 ns	269471 ns	0.96
E2E_Evaluator_cmake-presets	19314583 ns	19917635 ns	0.97
E2E_Evaluator_code-climate	495710 ns	510475 ns	0.97
E2E_Evaluator_cql2	1266121 ns	1239219 ns	1.02
E2E_Evaluator_cspell	1643804 ns	1495523 ns	1.10
E2E_Evaluator_cypress	869406 ns	779344 ns	1.12
E2E_Evaluator_deno	1164371 ns	1105282 ns	1.05
E2E_Evaluator_dependabot	1287091 ns	1118333 ns	1.15
E2E_Evaluator_draft-04	29308815 ns	27563693 ns	1.06
E2E_Evaluator_fabric-mod	2542398 ns	2377986 ns	1.07
E2E_Evaluator_geojson	20378617 ns	20786684 ns	0.98
E2E_Evaluator_gitpod-configuration	733368 ns	722667 ns	1.01
E2E_Evaluator_helm-chart-lock	1056831 ns	1006837 ns	1.05
E2E_Evaluator_importmap	266713 ns	267025 ns	1.00
E2E_Evaluator_jasmine	281222 ns	308211 ns	0.91
E2E_Evaluator_jsconfig	1460802 ns	1250200 ns	1.17
E2E_Evaluator_jshintrc	2916180 ns	2820384 ns	1.03
E2E_Evaluator_krakend	632691 ns	673183 ns	0.94
E2E_Evaluator_lazygit	470502 ns	504998 ns	0.93
E2E_Evaluator_lerna	539541 ns	474197 ns	1.14
E2E_Evaluator_nest-cli	613241 ns	595732 ns	1.03
E2E_Evaluator_omc	90707 ns	92369 ns	0.98
E2E_Evaluator_omnisharp	1490398 ns	1399209 ns	1.07
E2E_Evaluator_openapi	26931255 ns	26660575 ns	1.01
E2E_Evaluator_pre-commit-hooks	2131416 ns	2056098 ns	1.04
E2E_Evaluator_pulumi	2036561 ns	1904403 ns	1.07
E2E_Evaluator_semantic-release	225539 ns	253622 ns	0.89
E2E_Evaluator_stale	381441 ns	391218 ns	0.98
E2E_Evaluator_stylecop	1268635 ns	1262636 ns	1.00
E2E_Evaluator_tmuxinator	216566 ns	228285 ns	0.95
E2E_Evaluator_ui5	2303505 ns	2354461 ns	0.98
E2E_Evaluator_ui5-manifest	11314000 ns	11955078 ns	0.95
E2E_Evaluator_unreal-engine-uproject	1590870 ns	1509153 ns	1.05
E2E_Evaluator_users-array	2466154 ns	2453246 ns	1.01
E2E_Evaluator_vercel	987387 ns	992247 ns	1.00
E2E_Evaluator_yamllint	24493 ns	26083 ns	0.94

This comment was automatically generated by workflow using github-action-benchmark.