Skip to content

Support Draft 3 required#779

Merged
jviotti merged 1 commit intomainfrom
draft3-required
May 5, 2026
Merged

Support Draft 3 required#779
jviotti merged 1 commit intomainfrom
draft3-required

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented May 5, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 4 files

@augmentcode
Copy link
Copy Markdown

augmentcode Bot commented May 5, 2026

🤖 Augment PR Summary

Summary: This PR adds support for JSON Schema Draft 3’s legacy per-property required boolean and wires it into the compiler/evaluator pipeline.

Changes:

  • Extend required_properties() to detect Draft 3 required properties by scanning properties.*.required: true.
  • Introduce compile_required_assertions() to centralize the instruction generation for required-property checks (including fast-path optimizations).
  • Update Draft 3 properties compilation to emit the required-property assertions when Draft 3 vocabularies are in use.
  • Refactor Draft 4 required compilation to reuse compile_required_assertions() rather than duplicating the logic.
  • Enable more Draft 3 JSON Schema Official Suite test groups by reducing the skip list (keeping disallow excluded).

Technical Notes: Required-property checks are compiled into AssertionDefines* instructions, with strict vs non-strict variants chosen based on whether the schema explicitly declares type: "object" and on fast-validation mode optimizations.

🤖 Was this summary useful? React with 👍 or 👎

Copy link
Copy Markdown

@augmentcode augmentcode Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 1 suggestion posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

"http://json-schema.org/draft-03/schema#",
// TODO: Enable all tests
{"disallow", "enum", "extends", "required"});
{"disallow"});
Copy link
Copy Markdown

@augmentcode augmentcode Bot May 5, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

At test/evaluator/officialsuite.cc:423, this drops the Draft 3 skip list from { "disallow", "enum", "extends", "required" } to just { "disallow" }, enabling enum and extends tests in addition to the new required coverage. If this PR is meant to focus only on Draft 3 required, it may be worth confirming those additional groups are expected to pass as part of this change set.

Severity: low

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

@jviotti jviotti merged commit 61341bd into main May 5, 2026
15 checks passed
@jviotti jviotti deleted the draft3-required branch May 5, 2026 15:00
Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: fcba3fe Previous: db399b3 Ratio
E2E_Compiler_adaptivecard 63970461.33333283 ns/iter 63187683.44445087 ns/iter 1.01
E2E_Compiler_ansible_meta 28580491.416666593 ns/iter 29124560.291667953 ns/iter 0.98
E2E_Compiler_aws_cdk 381491.7427635188 ns/iter 383626.3657331099 ns/iter 0.99
E2E_Compiler_babelrc 2580367.232472342 ns/iter 2602491.4052046123 ns/iter 0.99
E2E_Compiler_clang_format 18550957.710526984 ns/iter 18489796.40540718 ns/iter 1.00
E2E_Compiler_cmake_presets 26051397.888889167 ns/iter 25719177.444443632 ns/iter 1.01
E2E_Compiler_code_climate 2614187.1635686466 ns/iter 2607711.988763655 ns/iter 1.00
E2E_Compiler_cql2 12955931.796297036 ns/iter 12866393.222223165 ns/iter 1.01
E2E_Compiler_cspell 22794233.935483575 ns/iter 22860802.967744026 ns/iter 1.00
E2E_Compiler_cypress 3958789.9435031237 ns/iter 3960738.09604537 ns/iter 1.00
E2E_Compiler_deno 7733769.406593557 ns/iter 7739840.644444484 ns/iter 1.00
E2E_Compiler_dependabot 3980974.728813245 ns/iter 3967401.0909090447 ns/iter 1.00
E2E_Compiler_draft_04 2681169.7011494306 ns/iter 2685050.632183768 ns/iter 1.00
E2E_Compiler_fabric_mod 4772977.938775394 ns/iter 4779189.863013814 ns/iter 1.00
E2E_Compiler_geojson 22057998.78124992 ns/iter 22078395.937501937 ns/iter 1.00
E2E_Compiler_gitpod_configuration 4910058.880281994 ns/iter 4898713.706293992 ns/iter 1.00
E2E_Compiler_helm_chart_lock 711164.3853955098 ns/iter 719619.5555556044 ns/iter 0.99
E2E_Compiler_importmap 288550.60883935454 ns/iter 286915.68924464803 ns/iter 1.01
E2E_Compiler_jasmine 1366942.9685039383 ns/iter 1369464.7265625193 ns/iter 1.00
E2E_Compiler_jshintrc 4363246.459627347 ns/iter 4363057.037267026 ns/iter 1.00
E2E_Compiler_jsconfig 22219756.28124895 ns/iter 21975576.906250183 ns/iter 1.01
E2E_Compiler_krakend 155464318.50000885 ns/iter 138563351.8000077 ns/iter 1.12
E2E_Compiler_lazygit 33663201.52380944 ns/iter 33337425.095239617 ns/iter 1.01
E2E_Compiler_lerna 1619881.2609698772 ns/iter 1622063.5542727448 ns/iter 1.00
E2E_Compiler_nest_cli 7481972.860214912 ns/iter 7477021.010639089 ns/iter 1.00
E2E_Compiler_omc 161713704.50001633 ns/iter 154782765.79999602 ns/iter 1.04
E2E_Compiler_omnisharp 6764340.384616109 ns/iter 6783243.378641353 ns/iter 1.00
E2E_Compiler_openapi 24788199.857141532 ns/iter 24949794.85714209 ns/iter 0.99
E2E_Compiler_pre_commit_hooks 5304402.320311929 ns/iter 5331638.480916316 ns/iter 0.99
E2E_Compiler_pulumi 4050915.8128649653 ns/iter 4054382.7919077687 ns/iter 1.00
E2E_Compiler_semantic_release 1574701.6711710382 ns/iter 1571949.096629151 ns/iter 1.00
E2E_Compiler_stale 1558129.6607142088 ns/iter 1562422.8129176125 ns/iter 1.00
E2E_Compiler_stylecop 6185771.415929175 ns/iter 6137334.622806385 ns/iter 1.01
E2E_Compiler_tmuxinator 1939137.9639888867 ns/iter 1947890.7999999565 ns/iter 1.00
E2E_Compiler_ui5 47712498.53333757 ns/iter 46800811.66666999 ns/iter 1.02
E2E_Compiler_ui5_manifest 326315464.9999933 ns/iter 311724202.99998295 ns/iter 1.05
E2E_Compiler_unreal_engine_uproject 4600677.940789852 ns/iter 4609048.61184169 ns/iter 1.00
E2E_Compiler_users_array 799810.7608695099 ns/iter 798763.8737084222 ns/iter 1.00
E2E_Compiler_vercel 12501789.107143883 ns/iter 12473273.053572597 ns/iter 1.00
E2E_Compiler_yamllint 349349.19970047544 ns/iter 352092.5637818921 ns/iter 0.99
E2E_Evaluator_adaptivecard 24544.497557060447 ns/iter 24190.552185180706 ns/iter 1.01
E2E_Evaluator_ansible_meta 231463.27086768014 ns/iter 224119.6303148352 ns/iter 1.03
E2E_Evaluator_aws_cdk 50964.85438925595 ns/iter 50027.69129475485 ns/iter 1.02
E2E_Evaluator_babelrc 106636.36573584846 ns/iter 104538.65822785017 ns/iter 1.02
E2E_Evaluator_cerebrum_criminal_case 942987.6635639016 ns/iter 942138.7346666659 ns/iter 1.00
E2E_Evaluator_clang_format 121818.75429372095 ns/iter 121170.20546523762 ns/iter 1.01
E2E_Evaluator_cmake_presets 4144272.491124376 ns/iter 4085868.186046772 ns/iter 1.01
E2E_Evaluator_code_climate 176131.05730082098 ns/iter 175356.50357232252 ns/iter 1.00
E2E_Evaluator_cql2 217548.08338518828 ns/iter 215939.42129632743 ns/iter 1.01
E2E_Evaluator_cspell 556813.21355397 ns/iter 564011.3445575179 ns/iter 0.99
E2E_Evaluator_cypress 189661.96352334533 ns/iter 189462.12469766117 ns/iter 1.00
E2E_Evaluator_deno 315773.772055539 ns/iter 308362.4864628859 ns/iter 1.02
E2E_Evaluator_dependabot 310926.51805618586 ns/iter 309288.3308304231 ns/iter 1.01
E2E_Evaluator_draft_04 7804112.045455078 ns/iter 7355762.440860788 ns/iter 1.06
E2E_Evaluator_fabric_mod 695797.255381588 ns/iter 681186.1875607298 ns/iter 1.02
E2E_Evaluator_geojson 16321896.340909606 ns/iter 16514184.069766872 ns/iter 0.99
E2E_Evaluator_gitpod_configuration 228447.42171392372 ns/iter 222840.9231505409 ns/iter 1.03
E2E_Evaluator_helm_chart_lock 338857.04824563337 ns/iter 335726.9169435474 ns/iter 1.01
E2E_Evaluator_importmap 46774.423894703665 ns/iter 45540.781960417225 ns/iter 1.03
E2E_Evaluator_jasmine 104958.66771300178 ns/iter 103398.47949080376 ns/iter 1.02
E2E_Evaluator_jshintrc 1225342.2044673979 ns/iter 1196623.8153846485 ns/iter 1.02
E2E_Evaluator_jsconfig 416335.09827281034 ns/iter 414221.67476300884 ns/iter 1.01
E2E_Evaluator_krakend 202965.85789167334 ns/iter 199395.52243123806 ns/iter 1.02
E2E_Evaluator_lazygit 150613.53665312924 ns/iter 146005.62437604438 ns/iter 1.03
E2E_Evaluator_lerna 146146.006828067 ns/iter 136333.28205625262 ns/iter 1.07
E2E_Evaluator_nest_cli 175208.470248576 ns/iter 173165.21650246868 ns/iter 1.01
E2E_Evaluator_omc 17915.048454599564 ns/iter 17804.274408491834 ns/iter 1.01
E2E_Evaluator_omnisharp 619745.8826125589 ns/iter 615408.9398953934 ns/iter 1.01
E2E_Evaluator_openapi 11117244.43939355 ns/iter 8638644.461538473 ns/iter 1.29
E2E_Evaluator_pre_commit_hooks 486262.9911923739 ns/iter 467783.8360106923 ns/iter 1.04
E2E_Evaluator_pulumi 682206.0478049113 ns/iter 657835.1964452798 ns/iter 1.04
E2E_Evaluator_semantic_release 95371.82036093471 ns/iter 95384.39310067873 ns/iter 1.00
E2E_Evaluator_stale 148204.95135362912 ns/iter 146212.6877837366 ns/iter 1.01
E2E_Evaluator_stylecop 284143.3563402958 ns/iter 277913.46770334966 ns/iter 1.02
E2E_Evaluator_tmuxinator 100889.58288237413 ns/iter 98881.9654735011 ns/iter 1.02
E2E_Evaluator_ui5 505333.2794224535 ns/iter 500210.51731450355 ns/iter 1.01
E2E_Evaluator_ui5_manifest 2645445.7673609336 ns/iter 2400748.6034485013 ns/iter 1.10
E2E_Evaluator_unreal_engine_uproject 421104.0162162662 ns/iter 420322.0188235397 ns/iter 1.00
E2E_Evaluator_users_array 536299.6606260112 ns/iter 528528.4134542488 ns/iter 1.01
E2E_Evaluator_vercel 335073.5981930929 ns/iter 314749.8840579692 ns/iter 1.06
E2E_Evaluator_yamllint 8060.621535072146 ns/iter 7972.376768569614 ns/iter 1.01
Micro_Draft4_Meta_1_No_Callback 193.97848678276046 ns/iter 189.88904349156326 ns/iter 1.02
Micro_Draft4_Required_Properties 791.7599363599063 ns/iter 792.2665233387856 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 20.843930299535696 ns/iter 20.9204412496013 ns/iter 1.00
Micro_Draft4_Few_Optional_Properties_Minimal_Match 10.94627450463925 ns/iter 10.894783111014322 ns/iter 1.00
Micro_Draft4_Items_Schema 297.3550562483592 ns/iter 297.0954567727397 ns/iter 1.00
Micro_Draft4_Nested_Object 1.8279308092117017 ns/iter 1.7619126089713655 ns/iter 1.04
Micro_Draft4_Properties_Triad_Optional 319.26197986884097 ns/iter 315.5315634752951 ns/iter 1.01
Micro_Draft4_Properties_Triad_Closed 260.8882032280937 ns/iter 259.99322791815996 ns/iter 1.00
Micro_Draft4_Properties_Triad_Required 331.77434845946004 ns/iter 329.6939463381538 ns/iter 1.01
Micro_Draft4_Properties_Closed 54.95485827635564 ns/iter 54.81013750750529 ns/iter 1.00
Micro_Draft4_Non_Recursive_Ref 12.418478054539358 ns/iter 12.167170191602123 ns/iter 1.02
Micro_Draft4_Pattern_Properties_True 149.77997345908616 ns/iter 149.78368111830392 ns/iter 1.00
Micro_Draft4_Ref_To_Single_Property 10.902890408054702 ns/iter 10.901099350564094 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 21.986409126043338 ns/iter 22.108317360492347 ns/iter 0.99
Micro_Draft4_Nested_Oneof 58.15597430487506 ns/iter 57.90420327332692 ns/iter 1.00
Micro_Draft4_Short_Enum 11.836133594842366 ns/iter 14.027008538698675 ns/iter 0.84
Micro_Draft4_Long_Enum 14.036052234957175 ns/iter 13.846449005080876 ns/iter 1.01
Micro_Draft4_Long_Enum_Short_Strings 11.841988994549643 ns/iter 14.023437210048842 ns/iter 0.84
Micro_Draft4_Type_Object 3.42498693997635 ns/iter 3.4243759564025114 ns/iter 1.00
Micro_Draft4_Ref_Single_100 2382267.7619046327 ns/iter 2383406.558219078 ns/iter 1.00
Micro_Draft4_Compile_Ref_Many_Nested 1717072.1842751084 ns/iter 1734318.3168319198 ns/iter 0.99
Micro_Draft4_Compile_Wrap 2385204.722033943 ns/iter 2385567.0853241314 ns/iter 1.00
Micro_Draft6_Property_Names 513.485344089986 ns/iter 118.89764890561861 ns/iter 4.32
Micro_Draft6_Compile_FHIR 15987627573.99993 ns/iter 14161750965.00001 ns/iter 1.13
Micro_Draft7_If_Then_Else 23.74365823037704 ns/iter 24.454457606131022 ns/iter 0.97
Micro_2019_09_Unevaluated_Properties 29.0792205290669 ns/iter 29.001318695216558 ns/iter 1.00
Micro_2019_09_Compile_Wrap 316634591.00002456 ns/iter 293470304.49997646 ns/iter 1.08
Micro_2020_12_Dynamic_Ref 225.73933857745394 ns/iter 225.67336833795025 ns/iter 1.00
Micro_2020_12_Dynamic_Ref_Single 3.4246170200877604 ns/iter 3.423708603594908 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 1073.236958840966 ns/iter 1069.803872569133 ns/iter 1.00
Micro_2020_12_Simple_Output_Annotations 101541.75719502874 ns/iter 113031.73714100562 ns/iter 0.90
Micro_2020_12_Compile_NonCircular_Shared_Refs 1106473.8943218081 ns/iter 1109401.1442155924 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric 8262.030002124975 ns/iter 8130.430445113568 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 172264.81288570337 ns/iter 176226.27490039528 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 22110.71442996461 ns/iter 22343.753063236294 ns/iter 0.99
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 142.8368537271767 ns/iter 140.5639227394202 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4266.823236048807 ns/iter 4358.431287576898 ns/iter 0.98
Alterschema_Check_Readibility_ISO_Language_Set_3 371544867.50000614 ns/iter 351740350.99998945 ns/iter 1.06
Alterschema_Check_Readibility_OMC 89436733.71428369 ns/iter 85813081.75000402 ns/iter 1.04
Alterschema_Check_Readibility_KrakenD 1261634341.9999793 ns/iter 1194456556.9999669 ns/iter 1.06
Alterschema_Apply_Readibility_KrakenD 122155836288.00005 ns/iter 119726677440 ns/iter 1.02
Alterschema_Check_Invalid_External_Refs 309523246.0000261 ns/iter 310560019.50003064 ns/iter 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: fcba3fe Previous: db399b3 Ratio
E2E_Evaluator_adaptivecard 116870 ns 117803 ns 0.99
E2E_Evaluator_ansible-meta 523133 ns 517719 ns 1.01
E2E_Evaluator_aws-cdk 145161 ns 139936 ns 1.04
E2E_Evaluator_babelrc 333930 ns 319443 ns 1.05
E2E_Evaluator_cerebrum-criminal-case 2457344 ns 2441817 ns 1.01
E2E_Evaluator_clang-format 269183 ns 266723 ns 1.01
E2E_Evaluator_cmake-presets 18190350 ns 17075222 ns 1.07
E2E_Evaluator_code-climate 500735 ns 497124 ns 1.01
E2E_Evaluator_cql2 1228412 ns 1237233 ns 0.99
E2E_Evaluator_cspell 1542572 ns 1465373 ns 1.05
E2E_Evaluator_cypress 803147 ns 755412 ns 1.06
E2E_Evaluator_deno 1087098 ns 1049375 ns 1.04
E2E_Evaluator_dependabot 1212239 ns 1198121 ns 1.01
E2E_Evaluator_draft-04 27104719 ns 20053436 ns 1.35
E2E_Evaluator_fabric-mod 2402022 ns 2275553 ns 1.06
E2E_Evaluator_geojson 19553080 ns 21384384 ns 0.91
E2E_Evaluator_gitpod-configuration 727350 ns 705669 ns 1.03
E2E_Evaluator_helm-chart-lock 990653 ns 1018500 ns 0.97
E2E_Evaluator_importmap 269287 ns 263924 ns 1.02
E2E_Evaluator_jasmine 293824 ns 298979 ns 0.98
E2E_Evaluator_jsconfig 1251684 ns 1224708 ns 1.02
E2E_Evaluator_jshintrc 2721631 ns 2696703 ns 1.01
E2E_Evaluator_krakend 666516 ns 672111 ns 0.99
E2E_Evaluator_lazygit 502140 ns 499805 ns 1.00
E2E_Evaluator_lerna 474266 ns 449976 ns 1.05
E2E_Evaluator_nest-cli 596928 ns 584987 ns 1.02
E2E_Evaluator_omc 91993 ns 90379 ns 1.02
E2E_Evaluator_omnisharp 1406518 ns 1403956 ns 1.00
E2E_Evaluator_openapi 25766597 ns 21895851 ns 1.18
E2E_Evaluator_pre-commit-hooks 2029095 ns 2004230 ns 1.01
E2E_Evaluator_pulumi 1876255 ns 1914476 ns 0.98
E2E_Evaluator_semantic-release 246444 ns 252283 ns 0.98
E2E_Evaluator_stale 400129 ns 395090 ns 1.01
E2E_Evaluator_stylecop 1233974 ns 1241595 ns 0.99
E2E_Evaluator_tmuxinator 219650 ns 225780 ns 0.97
E2E_Evaluator_ui5 2393924 ns 2256566 ns 1.06
E2E_Evaluator_ui5-manifest 10658463 ns 9922462 ns 1.07
E2E_Evaluator_unreal-engine-uproject 1528438 ns 1477682 ns 1.03
E2E_Evaluator_users-array 2498228 ns 2682850 ns 0.93
E2E_Evaluator_vercel 997161 ns 990044 ns 1.01
E2E_Evaluator_yamllint 25563 ns 25294 ns 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: fcba3fe Previous: 6e06923 Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 367166966.0000134 ns/iter 357807862.49995345 ns/iter 1.03
Alterschema_Check_Readibility_OMC 98738192.4285923 ns/iter 95664064.14286835 ns/iter 1.03
Alterschema_Check_Readibility_KrakenD 1362799247.0001118 ns/iter 1267264401.9999096 ns/iter 1.08
Alterschema_Apply_Readibility_KrakenD 125526740567.00017 ns/iter 123929876401 ns/iter 1.01
Alterschema_Check_Invalid_External_Refs 339028935.50009596 ns/iter 344601890.5000301 ns/iter 0.98
Micro_2020_12_Dynamic_Ref 264.872771020802 ns/iter 262.39076960725254 ns/iter 1.01
Micro_2020_12_Dynamic_Ref_Single 4.672272064932007 ns/iter 4.9804775462496975 ns/iter 0.94
Micro_2020_12_Simple_Output_Mask 1153.3331415337277 ns/iter 1153.7161878884717 ns/iter 1.00
Micro_2020_12_Simple_Output_Annotations 113972.45987092663 ns/iter 117955.74898987888 ns/iter 0.97
Micro_2020_12_Compile_NonCircular_Shared_Refs 1227877.4101221098 ns/iter 1253096.1639928499 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric 8446.033576679118 ns/iter 8332.173802171312 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 166085.36996938707 ns/iter 167421.22662132484 ns/iter 0.99
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 25688.80815687691 ns/iter 25414.446016863392 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 129.9668883994995 ns/iter 135.81001733354827 ns/iter 0.96
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4744.919941952714 ns/iter 4956.095736581898 ns/iter 0.96
Micro_2019_09_Unevaluated_Properties 34.406918025335315 ns/iter 29.07286605847728 ns/iter 1.18
Micro_2019_09_Compile_Wrap 334101349.49997425 ns/iter 309345474.9999864 ns/iter 1.08
Micro_Draft7_If_Then_Else 24.90043022028916 ns/iter 25.22608925972553 ns/iter 0.99
Micro_Draft6_Property_Names 141.53837402979337 ns/iter 150.12192785870445 ns/iter 0.94
Micro_Draft6_Compile_FHIR 14113703098.99985 ns/iter 13725919429.000214 ns/iter 1.03
Micro_Draft4_Meta_1_No_Callback 172.27189383969326 ns/iter 166.40168832011682 ns/iter 1.04
Micro_Draft4_Required_Properties 850.8796797201418 ns/iter 818.0645104742074 ns/iter 1.04
Micro_Draft4_Many_Optional_Properties_Minimal_Match 20.946521055808706 ns/iter 20.303951518207068 ns/iter 1.03
Micro_Draft4_Few_Optional_Properties_Minimal_Match 12.808324601941788 ns/iter 13.122404800987026 ns/iter 0.98
Micro_Draft4_Items_Schema 344.3260156099546 ns/iter 353.1840957699434 ns/iter 0.97
Micro_Draft4_Nested_Object 2.1991152004349246 ns/iter 1.8692624736077608 ns/iter 1.18
Micro_Draft4_Properties_Triad_Optional 446.2308910247312 ns/iter 369.26554582735315 ns/iter 1.21
Micro_Draft4_Properties_Triad_Closed 365.51986613977147 ns/iter 301.7968846385369 ns/iter 1.21
Micro_Draft4_Properties_Triad_Required 537.0485369999187 ns/iter 388.4601693929616 ns/iter 1.38
Micro_Draft4_Properties_Closed 63.305931792940285 ns/iter 61.76011376290802 ns/iter 1.03
Micro_Draft4_Non_Recursive_Ref 9.700217610221845 ns/iter 9.653365722144828 ns/iter 1.00
Micro_Draft4_Pattern_Properties_True 209.98342601855666 ns/iter 215.95872304004075 ns/iter 0.97
Micro_Draft4_Ref_To_Single_Property 13.60585606829238 ns/iter 13.082522314845598 ns/iter 1.04
Micro_Draft4_Additional_Properties_Type 14.885164994263636 ns/iter 14.939267323502209 ns/iter 1.00
Micro_Draft4_Nested_Oneof 67.93246660513226 ns/iter 66.1582196854805 ns/iter 1.03
Micro_Draft4_Short_Enum 14.680053362093446 ns/iter 14.643845884894303 ns/iter 1.00
Micro_Draft4_Long_Enum 14.448638022472961 ns/iter 14.3408779222765 ns/iter 1.01
Micro_Draft4_Long_Enum_Short_Strings 14.708802554981817 ns/iter 14.64178307640036 ns/iter 1.00
Micro_Draft4_Type_Object 4.667921705200353 ns/iter 4.982300668637871 ns/iter 0.94
Micro_Draft4_Ref_Single_100 2524781.5869560316 ns/iter 2568893.7399268188 ns/iter 0.98
Micro_Draft4_Compile_Ref_Many_Nested 1845179.198952963 ns/iter 1859157.2686171061 ns/iter 0.99
Micro_Draft4_Compile_Wrap 2604383.774073708 ns/iter 2655141.0561800646 ns/iter 0.98
E2E_Compiler_adaptivecard 69837381.49999681 ns/iter 66828652.10000273 ns/iter 1.05
E2E_Compiler_ansible_meta 30718213.565221403 ns/iter 30727694.00000652 ns/iter 1.00
E2E_Compiler_aws_cdk 427701.27383871574 ns/iter 438963.0627351544 ns/iter 0.97
E2E_Compiler_babelrc 2825173.324000389 ns/iter 2871951.921810655 ns/iter 0.98
E2E_Compiler_clang_format 19923129.94444016 ns/iter 20101347.799995244 ns/iter 0.99
E2E_Compiler_cmake_presets 27714409.119998887 ns/iter 27744319.35999928 ns/iter 1.00
E2E_Compiler_code_climate 2849434.23983764 ns/iter 2888252.545454439 ns/iter 0.99
E2E_Compiler_cql2 14215603.48979497 ns/iter 14343680.530610258 ns/iter 0.99
E2E_Compiler_cspell 24328726.310347427 ns/iter 24456436.06896236 ns/iter 0.99
E2E_Compiler_cypress 4214872.664669839 ns/iter 4262178.9634154085 ns/iter 0.99
E2E_Compiler_deno 8316275.670588712 ns/iter 8417421.987952003 ns/iter 0.99
E2E_Compiler_dependabot 4248064.212121487 ns/iter 4329468.590061291 ns/iter 0.98
E2E_Compiler_draft_04 2964275.3220335147 ns/iter 3039644.543103601 ns/iter 0.98
E2E_Compiler_fabric_mod 5215141.599999832 ns/iter 5312396.886362572 ns/iter 0.98
E2E_Compiler_geojson 24252662.82758959 ns/iter 24472374.724139407 ns/iter 0.99
E2E_Compiler_gitpod_configuration 5323979.765152712 ns/iter 5425963.790697612 ns/iter 0.98
E2E_Compiler_helm_chart_lock 766655.903825282 ns/iter 780092.8285075795 ns/iter 0.98
E2E_Compiler_importmap 318052.2496576778 ns/iter 325796.081860443 ns/iter 0.98
E2E_Compiler_jasmine 1489391.0963598932 ns/iter 1528439.2785089724 ns/iter 0.97
E2E_Compiler_jshintrc 4759931.489795489 ns/iter 4870366.8391611315 ns/iter 0.98
E2E_Compiler_jsconfig 23395521.41379813 ns/iter 23765543.724141087 ns/iter 0.98
E2E_Compiler_krakend 148012406.39999378 ns/iter 144994680.20003405 ns/iter 1.02
E2E_Compiler_lazygit 35712754.57894492 ns/iter 36371423.89474272 ns/iter 0.98
E2E_Compiler_lerna 1771889.9314718442 ns/iter 1824868.255208519 ns/iter 0.97
E2E_Compiler_nest_cli 8096806.942527716 ns/iter 8203580.686046184 ns/iter 0.99
E2E_Compiler_omc 171166816.5000333 ns/iter 165532684.5000218 ns/iter 1.03
E2E_Compiler_omnisharp 7262584.701031545 ns/iter 7386144.308510027 ns/iter 0.98
E2E_Compiler_openapi 27328521.230769042 ns/iter 27453926.119997047 ns/iter 1.00
E2E_Compiler_pre_commit_hooks 5758751.573770511 ns/iter 5866528.338983545 ns/iter 0.98
E2E_Compiler_pulumi 4409382.93548448 ns/iter 4540138.929033058 ns/iter 0.97
E2E_Compiler_semantic_release 1725192.2014743588 ns/iter 1765660.2929295416 ns/iter 0.98
E2E_Compiler_stale 1685192.3590365914 ns/iter 1723400.4345678885 ns/iter 0.98
E2E_Compiler_stylecop 6356783.825688772 ns/iter 6461948.394496317 ns/iter 0.98
E2E_Compiler_tmuxinator 2153717.883435829 ns/iter 2183562.57812502 ns/iter 0.99
E2E_Compiler_ui5 50936120.1000047 ns/iter 49615900.64286675 ns/iter 1.03
E2E_Compiler_ui5_manifest 341317630.9999244 ns/iter 325754268.99995816 ns/iter 1.05
E2E_Compiler_unreal_engine_uproject 4988931.312056515 ns/iter 5083565.905796723 ns/iter 0.98
E2E_Compiler_users_array 889281.8814627179 ns/iter 900622.5354838651 ns/iter 0.99
E2E_Compiler_vercel 13284882.433961958 ns/iter 13449533.250003207 ns/iter 0.99
E2E_Compiler_yamllint 389882.5780121763 ns/iter 400672.99026352604 ns/iter 0.97
E2E_Evaluator_adaptivecard 23519.494511883706 ns/iter 23881.834802865626 ns/iter 0.98
E2E_Evaluator_ansible_meta 252971.20153345147 ns/iter 256071.92813515262 ns/iter 0.99
E2E_Evaluator_aws_cdk 51965.12860294433 ns/iter 51210.537517159326 ns/iter 1.01
E2E_Evaluator_babelrc 104279.85553554475 ns/iter 106417.80731889585 ns/iter 0.98
E2E_Evaluator_cerebrum_criminal_case 1050483.3352521057 ns/iter 1034689.8641061995 ns/iter 1.02
E2E_Evaluator_clang_format 106499.5807221919 ns/iter 108348.51939788129 ns/iter 0.98
E2E_Evaluator_cmake_presets 5386892.345323568 ns/iter 4403598.012659074 ns/iter 1.22
E2E_Evaluator_code_climate 193269.7968495661 ns/iter 191020.9491384328 ns/iter 1.01
E2E_Evaluator_cql2 216965.24689441107 ns/iter 216028.81617418092 ns/iter 1.00
E2E_Evaluator_cspell 551027.640154524 ns/iter 530826.1853252051 ns/iter 1.04
E2E_Evaluator_cypress 174371.05052526935 ns/iter 175643.95021266182 ns/iter 0.99
E2E_Evaluator_deno 330440.4050396365 ns/iter 328431.09748138086 ns/iter 1.01
E2E_Evaluator_dependabot 356778.21643703175 ns/iter 363247.76625474164 ns/iter 0.98
E2E_Evaluator_draft_04 8410463.882978063 ns/iter 6696213.737373598 ns/iter 1.26
E2E_Evaluator_fabric_mod 753579.1587471709 ns/iter 780791.533557113 ns/iter 0.97
E2E_Evaluator_geojson 17680941.195122592 ns/iter 16061649.930232434 ns/iter 1.10
E2E_Evaluator_gitpod_configuration 255311.60213864403 ns/iter 255465.9057705864 ns/iter 1.00
E2E_Evaluator_helm_chart_lock 305869.3993696154 ns/iter 307080.6521547755 ns/iter 1.00
E2E_Evaluator_importmap 48472.587942367514 ns/iter 50144.2433999955 ns/iter 0.97
E2E_Evaluator_jasmine 113304.84299125377 ns/iter 120300.94956402677 ns/iter 0.94
E2E_Evaluator_jshintrc 1046437.9164134928 ns/iter 1086796.8595420702 ns/iter 0.96
E2E_Evaluator_jsconfig 404157.2305004963 ns/iter 399555.19336377806 ns/iter 1.01
E2E_Evaluator_krakend 205247.5809837934 ns/iter 212841.8395173376 ns/iter 0.96
E2E_Evaluator_lazygit 135809.58200525155 ns/iter 133883.57497074618 ns/iter 1.01
E2E_Evaluator_lerna 152947.90102908388 ns/iter 152507.41173941584 ns/iter 1.00
E2E_Evaluator_nest_cli 196815.35167327785 ns/iter 195434.1779441005 ns/iter 1.01
E2E_Evaluator_omc 18763.646959004105 ns/iter 18374.616520359144 ns/iter 1.02
E2E_Evaluator_omnisharp 566466.2144577544 ns/iter 557304.6701613293 ns/iter 1.02
E2E_Evaluator_openapi 10226450.953845974 ns/iter 9962024.957745522 ns/iter 1.03
E2E_Evaluator_pre_commit_hooks 515586.0355029298 ns/iter 519595.2026627757 ns/iter 0.99
E2E_Evaluator_pulumi 712242.5997973272 ns/iter 726392.9156378546 ns/iter 0.98
E2E_Evaluator_semantic_release 103834.64128715474 ns/iter 104817.7571258852 ns/iter 0.99
E2E_Evaluator_stale 155007.15840070133 ns/iter 156708.778916854 ns/iter 0.99
E2E_Evaluator_stylecop 309339.4915400799 ns/iter 306846.43568121153 ns/iter 1.01
E2E_Evaluator_tmuxinator 98618.49985878868 ns/iter 102656.69131455633 ns/iter 0.96
E2E_Evaluator_ui5 543178.4164063202 ns/iter 542970.3444529664 ns/iter 1.00
E2E_Evaluator_ui5_manifest 2810646.1771651846 ns/iter 2704721.7220080155 ns/iter 1.04
E2E_Evaluator_unreal_engine_uproject 464105.2754010844 ns/iter 476450.6625767881 ns/iter 0.97
E2E_Evaluator_users_array 626537.668181713 ns/iter 606612.0164645597 ns/iter 1.03
E2E_Evaluator_vercel 305435.8323143831 ns/iter 308059.819371761 ns/iter 0.99
E2E_Evaluator_yamllint 10689.09809373771 ns/iter 10460.791022368407 ns/iter 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: fcba3fe Previous: 6e06923 Ratio
E2E_Evaluator_adaptivecard 119704 ns 115262 ns 1.04
E2E_Evaluator_ansible-meta 520325 ns 519906 ns 1.00
E2E_Evaluator_aws-cdk 140598 ns 139892 ns 1.01
E2E_Evaluator_babelrc 330962 ns 323568 ns 1.02
E2E_Evaluator_cerebrum-criminal-case 2508236 ns 2496326 ns 1.00
E2E_Evaluator_clang-format 276809 ns 262622 ns 1.05
E2E_Evaluator_cmake-presets 18329466 ns 17268969 ns 1.06
E2E_Evaluator_code-climate 503311 ns 504652 ns 1.00
E2E_Evaluator_cql2 1211801 ns 1206115 ns 1.00
E2E_Evaluator_cspell 1531608 ns 1464832 ns 1.05
E2E_Evaluator_cypress 800444 ns 744189 ns 1.08
E2E_Evaluator_deno 1096414 ns 1060464 ns 1.03
E2E_Evaluator_dependabot 1224152 ns 1087382 ns 1.13
E2E_Evaluator_draft-04 26534971 ns 22768952 ns 1.17
E2E_Evaluator_fabric-mod 2347053 ns 2290286 ns 1.02
E2E_Evaluator_geojson 21173405 ns 19547240 ns 1.08
E2E_Evaluator_gitpod-configuration 716807 ns 695810 ns 1.03
E2E_Evaluator_helm-chart-lock 993210 ns 987728 ns 1.01
E2E_Evaluator_importmap 272598 ns 262437 ns 1.04
E2E_Evaluator_jasmine 284809 ns 299145 ns 0.95
E2E_Evaluator_jsconfig 1304365 ns 1215129 ns 1.07
E2E_Evaluator_jshintrc 2742822 ns 2725527 ns 1.01
E2E_Evaluator_krakend 687745 ns 671869 ns 1.02
E2E_Evaluator_lazygit 521924 ns 501765 ns 1.04
E2E_Evaluator_lerna 456927 ns 454197 ns 1.01
E2E_Evaluator_nest-cli 605445 ns 577714 ns 1.05
E2E_Evaluator_omc 90409 ns 92439 ns 0.98
E2E_Evaluator_omnisharp 1401697 ns 1392544 ns 1.01
E2E_Evaluator_openapi 24457840 ns 22490429 ns 1.09
E2E_Evaluator_pre-commit-hooks 2017452 ns 2008332 ns 1.00
E2E_Evaluator_pulumi 1899848 ns 1854050 ns 1.02
E2E_Evaluator_semantic-release 256068 ns 247666 ns 1.03
E2E_Evaluator_stale 403456 ns 403555 ns 1.00
E2E_Evaluator_stylecop 1300108 ns 1215875 ns 1.07
E2E_Evaluator_tmuxinator 230489 ns 224481 ns 1.03
E2E_Evaluator_ui5 2357637 ns 2328268 ns 1.01
E2E_Evaluator_ui5-manifest 11258192 ns 10072829 ns 1.12
E2E_Evaluator_unreal-engine-uproject 1520871 ns 1484846 ns 1.02
E2E_Evaluator_users-array 2486989 ns 2481253 ns 1.00
E2E_Evaluator_vercel 996550 ns 966427 ns 1.03
E2E_Evaluator_yamllint 25563 ns 25227 ns 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: fcba3fe Previous: db399b3 Ratio
E2E_Compiler_adaptivecard 86420902.83331072 ns/iter 86484150.9999792 ns/iter 1.00
E2E_Compiler_ansible_meta 33352571.42857916 ns/iter 29861182.956526887 ns/iter 1.12
E2E_Compiler_aws_cdk 475885.4084839607 ns/iter 392385.6413145155 ns/iter 1.21
E2E_Compiler_babelrc 2824861.88085057 ns/iter 2900226.8204230475 ns/iter 0.97
E2E_Compiler_clang_format 20711188.550001226 ns/iter 19700936.97436007 ns/iter 1.05
E2E_Compiler_cmake_presets 39726565.78947097 ns/iter 45285502.15789102 ns/iter 0.88
E2E_Compiler_code_climate 2791486.221790559 ns/iter 3085400.3118283115 ns/iter 0.90
E2E_Compiler_cql2 16082300.181815093 ns/iter 17754009.146340363 ns/iter 0.91
E2E_Compiler_cspell 27356576.137929644 ns/iter 29370382.217393853 ns/iter 0.93
E2E_Compiler_cypress 4880497.201341331 ns/iter 5134538.734376193 ns/iter 0.95
E2E_Compiler_deno 9496915.269662341 ns/iter 11017252.567901295 ns/iter 0.86
E2E_Compiler_dependabot 5576615.743055728 ns/iter 4718258.814101809 ns/iter 1.18
E2E_Compiler_draft_04 3123326.8022386106 ns/iter 3147422.459459305 ns/iter 0.99
E2E_Compiler_fabric_mod 6497317.211678288 ns/iter 5906521.462121059 ns/iter 1.10
E2E_Compiler_geojson 35890043.99999693 ns/iter 34449210.33333447 ns/iter 1.04
E2E_Compiler_gitpod_configuration 6536790.410000321 ns/iter 5974449.5900008585 ns/iter 1.09
E2E_Compiler_helm_chart_lock 921112.9024662713 ns/iter 762125.3569131369 ns/iter 1.21
E2E_Compiler_importmap 318565.5637494462 ns/iter 273246.5055280927 ns/iter 1.17
E2E_Compiler_jasmine 1595711.4095239637 ns/iter 1507221.6778397493 ns/iter 1.06
E2E_Compiler_jshintrc 5280140.419999952 ns/iter 4755840.701219735 ns/iter 1.11
E2E_Compiler_jsconfig 27598173.91303999 ns/iter 23262518.319997977 ns/iter 1.19
E2E_Compiler_krakend 206108301.99996144 ns/iter 158510775.00001338 ns/iter 1.30
E2E_Compiler_lazygit 51634416.66665373 ns/iter 39254802.06250142 ns/iter 1.32
E2E_Compiler_lerna 2186887.109374425 ns/iter 1633193.0909088296 ns/iter 1.34
E2E_Compiler_nest_cli 9509509.259260084 ns/iter 7772079.439251327 ns/iter 1.22
E2E_Compiler_omc 238230374.9999816 ns/iter 222470208.3333341 ns/iter 1.07
E2E_Compiler_omnisharp 8400330.164554765 ns/iter 7524586.306122469 ns/iter 1.12
E2E_Compiler_openapi 35741673.62500209 ns/iter 32625421.296297982 ns/iter 1.10
E2E_Compiler_pre_commit_hooks 6904345.977527862 ns/iter 6408760.924137698 ns/iter 1.08
E2E_Compiler_pulumi 5589300.847459064 ns/iter 4381197.784810646 ns/iter 1.28
E2E_Compiler_semantic_release 1877790.0812180638 ns/iter 1522980.4805822752 ns/iter 1.23
E2E_Compiler_stale 1924331.4869796063 ns/iter 1908639.0449440463 ns/iter 1.01
E2E_Compiler_stylecop 9286863.194689527 ns/iter 6670471.281554941 ns/iter 1.39
E2E_Compiler_tmuxinator 3066282.286549296 ns/iter 2662023.6570600406 ns/iter 1.15
E2E_Compiler_ui5 87617651.00001639 ns/iter 65650312.4999972 ns/iter 1.33
E2E_Compiler_ui5_manifest 626951333.0000792 ns/iter 490444312.50001705 ns/iter 1.28
E2E_Compiler_unreal_engine_uproject 5505105.645667977 ns/iter 5414488.33000004 ns/iter 1.02
E2E_Compiler_users_array 1234607.6495601223 ns/iter 1229889.8998699654 ns/iter 1.00
E2E_Compiler_vercel 19526063.605260454 ns/iter 16767621.323524777 ns/iter 1.16
E2E_Compiler_yamllint 430979.7058823171 ns/iter 377693.82631373376 ns/iter 1.14
E2E_Evaluator_adaptivecard 30497.81566778876 ns/iter 27248.93168053018 ns/iter 1.12
E2E_Evaluator_ansible_meta 329435.9152128422 ns/iter 245624.5823834129 ns/iter 1.34
E2E_Evaluator_aws_cdk 48157.71684642813 ns/iter 52468.962500006455 ns/iter 0.92
E2E_Evaluator_babelrc 100629.69240655156 ns/iter 148455.95512921162 ns/iter 0.68
E2E_Evaluator_cerebrum_criminal_case 1015775.6912442469 ns/iter 933604.4881565032 ns/iter 1.09
E2E_Evaluator_clang_format 144392.05792513126 ns/iter 121006.22489392302 ns/iter 1.19
E2E_Evaluator_cmake_presets 4468572.444443898 ns/iter 4646207.352941608 ns/iter 0.96
E2E_Evaluator_code_climate 168740.43222922346 ns/iter 158540.35100250243 ns/iter 1.06
E2E_Evaluator_cql2 232436.48062012246 ns/iter 171433.6158192193 ns/iter 1.36
E2E_Evaluator_cspell 588724.3750000835 ns/iter 649270.708999893 ns/iter 0.91
E2E_Evaluator_cypress 170779.29437345566 ns/iter 191945.54893501475 ns/iter 0.89
E2E_Evaluator_deno 323839.41644680576 ns/iter 349288.8999009685 ns/iter 0.93
E2E_Evaluator_dependabot 359420.69536425656 ns/iter 348755.5623255397 ns/iter 1.03
E2E_Evaluator_draft_04 7632106.972971848 ns/iter 6578977.560438643 ns/iter 1.16
E2E_Evaluator_fabric_mod 685699.452525215 ns/iter 722997.7156135921 ns/iter 0.95
E2E_Evaluator_geojson 14961035.446808733 ns/iter 19170966.814815275 ns/iter 0.78
E2E_Evaluator_gitpod_configuration 216521.87179487155 ns/iter 287180.31623213604 ns/iter 0.75
E2E_Evaluator_helm_chart_lock 264353.9261550671 ns/iter 366774.40957194444 ns/iter 0.72
E2E_Evaluator_importmap 45872.00351587614 ns/iter 47212.11990505425 ns/iter 0.97
E2E_Evaluator_jasmine 118997.28603281413 ns/iter 116362.21878914906 ns/iter 1.02
E2E_Evaluator_jshintrc 1333824.4515507151 ns/iter 1192931.35825102 ns/iter 1.12
E2E_Evaluator_jsconfig 441270.0316288681 ns/iter 383998.57404130406 ns/iter 1.15
E2E_Evaluator_krakend 173765.90214660033 ns/iter 232098.87511736265 ns/iter 0.75
E2E_Evaluator_lazygit 129431.90197764005 ns/iter 146497.54305978885 ns/iter 0.88
E2E_Evaluator_lerna 136486.4563042013 ns/iter 195786.60392966509 ns/iter 0.70
E2E_Evaluator_nest_cli 181861.4836902518 ns/iter 182210.5753592221 ns/iter 1.00
E2E_Evaluator_omc 17049.66555400666 ns/iter 16739.151484723305 ns/iter 1.02
E2E_Evaluator_omnisharp 644334.0000000716 ns/iter 600154.3576538303 ns/iter 1.07
E2E_Evaluator_openapi 8343676.43209937 ns/iter 7692410.584268964 ns/iter 1.08
E2E_Evaluator_pre_commit_hooks 608823.8636362577 ns/iter 397677.1933518555 ns/iter 1.53
E2E_Evaluator_pulumi 862229.3233081643 ns/iter 733973.2320717241 ns/iter 1.17
E2E_Evaluator_semantic_release 89812.73760965 ns/iter 97581.53727957323 ns/iter 0.92
E2E_Evaluator_stale 129499.13229772415 ns/iter 139671.23081223975 ns/iter 0.93
E2E_Evaluator_stylecop 267433.4564974677 ns/iter 281313.4830478768 ns/iter 0.95
E2E_Evaluator_tmuxinator 105662.32342583922 ns/iter 110919.50143734828 ns/iter 0.95
E2E_Evaluator_ui5 450507.5759694529 ns/iter 497420.413342906 ns/iter 0.91
E2E_Evaluator_ui5_manifest 2866899.431818514 ns/iter 2609111.3208958087 ns/iter 1.10
E2E_Evaluator_unreal_engine_uproject 534345.765667598 ns/iter 426547.04370176955 ns/iter 1.25
E2E_Evaluator_users_array 556709.0708661532 ns/iter 562181.6670000044 ns/iter 0.99
E2E_Evaluator_vercel 330198.8612837107 ns/iter 279310.3887486659 ns/iter 1.18
E2E_Evaluator_yamllint 9062.037377651648 ns/iter 8110.668959390731 ns/iter 1.12
Micro_Draft4_Meta_1_No_Callback 161.62805697484046 ns/iter 155.06793665462783 ns/iter 1.04
Micro_Draft4_Required_Properties 757.2680648524778 ns/iter 770.7472313269416 ns/iter 0.98
Micro_Draft4_Many_Optional_Properties_Minimal_Match 19.845083842194615 ns/iter 20.572191483106707 ns/iter 0.96
Micro_Draft4_Few_Optional_Properties_Minimal_Match 9.84463427651476 ns/iter 8.737622366739963 ns/iter 1.13
Micro_Draft4_Items_Schema 425.34713674754755 ns/iter 310.5409730775259 ns/iter 1.37
Micro_Draft4_Nested_Object 1.2147977161220438 ns/iter 0.8259444153822041 ns/iter 1.47
Micro_Draft4_Properties_Triad_Optional 283.36894661451134 ns/iter 210.5610826905238 ns/iter 1.35
Micro_Draft4_Properties_Triad_Closed 238.4790100825916 ns/iter 185.84830349428768 ns/iter 1.28
Micro_Draft4_Properties_Triad_Required 260.71618793952024 ns/iter 243.0046226619032 ns/iter 1.07
Micro_Draft4_Properties_Closed 48.88927586618366 ns/iter 40.68749529933413 ns/iter 1.20
Micro_Draft4_Non_Recursive_Ref 16.859138837403854 ns/iter 15.886424049991685 ns/iter 1.06
Micro_Draft4_Pattern_Properties_True 180.57511855399764 ns/iter 163.373714952477 ns/iter 1.11
Micro_Draft4_Ref_To_Single_Property 9.724704165595213 ns/iter 7.626841873903967 ns/iter 1.28
Micro_Draft4_Additional_Properties_Type 30.789460249057704 ns/iter 28.249406785004957 ns/iter 1.09
Micro_Draft4_Nested_Oneof 50.52084589999595 ns/iter 44.51799521381417 ns/iter 1.13
Micro_Draft4_Short_Enum 6.339872841956309 ns/iter 5.253016241958762 ns/iter 1.21
Micro_Draft4_Long_Enum 12.501775396806162 ns/iter 10.741047015203378 ns/iter 1.16
Micro_Draft4_Long_Enum_Short_Strings 7.686354211379702 ns/iter 7.014925062785793 ns/iter 1.10
Micro_Draft4_Type_Object 2.929771039680713 ns/iter 2.3432516183436944 ns/iter 1.25
Micro_Draft4_Ref_Single_100 2878966.1921701957 ns/iter 1905837.499999794 ns/iter 1.51
Micro_Draft4_Compile_Ref_Many_Nested 1820048.1321839797 ns/iter 1452484.1513294037 ns/iter 1.25
Micro_Draft4_Compile_Wrap 2850269.060283434 ns/iter 2700055.5114000975 ns/iter 1.06
Micro_Draft6_Property_Names 127.75506944927484 ns/iter 103.21172162313617 ns/iter 1.24
Micro_Draft6_Compile_FHIR 21397302958.000183 ns/iter 14013703709.000084 ns/iter 1.53
Micro_Draft7_If_Then_Else 25.20502861263498 ns/iter 20.46142179925904 ns/iter 1.23
Micro_2019_09_Unevaluated_Properties 33.942904010004824 ns/iter 34.39793332982175 ns/iter 0.99
Micro_2019_09_Compile_Wrap 450623145.9999981 ns/iter 349491020.99994886 ns/iter 1.29
Micro_2020_12_Dynamic_Ref 236.88769379061011 ns/iter 236.3828582834343 ns/iter 1.00
Micro_2020_12_Dynamic_Ref_Single 2.5678962105512686 ns/iter 3.2995180340105956 ns/iter 0.78
Micro_2020_12_Simple_Output_Mask 1042.5979873719664 ns/iter 1110.6542287092961 ns/iter 0.94
Micro_2020_12_Simple_Output_Annotations 147577.06106478392 ns/iter 135826.91059547823 ns/iter 1.09
Micro_2020_12_Compile_NonCircular_Shared_Refs 1157937.5337519273 ns/iter 1472726.8946398993 ns/iter 0.79
Micro_2020_12_Exhaustive_Deep_Numeric 8194.261073732681 ns/iter 7916.481174167002 ns/iter 1.04
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 167300.59776382198 ns/iter 178859.95479249663 ns/iter 0.94
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 19341.28698960998 ns/iter 21954.58525114484 ns/iter 0.88
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 140.1066782243148 ns/iter 147.91461588447677 ns/iter 0.95
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 6792.8043097753325 ns/iter 6890.82745105461 ns/iter 0.99
Alterschema_Check_Readibility_ISO_Language_Set_3 358029103.99991107 ns/iter 396090707.99997425 ns/iter 0.90
Alterschema_Check_Readibility_OMC 103765862.4999949 ns/iter 108349506.00000022 ns/iter 0.96
Alterschema_Check_Readibility_KrakenD 1130078541.0001025 ns/iter 1471786542.0000181 ns/iter 0.77
Alterschema_Apply_Readibility_KrakenD 118634614332.99994 ns/iter 114042443416.99995 ns/iter 1.04
Alterschema_Check_Invalid_External_Refs 236671596.99994043 ns/iter 233089041.66666856 ns/iter 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: fcba3fe Previous: db399b3 Ratio
E2E_Evaluator_adaptivecard 129144 ns 105109 ns 1.23
E2E_Evaluator_ansible-meta 579521 ns 404798 ns 1.43
E2E_Evaluator_aws-cdk 160501 ns 122918 ns 1.31
E2E_Evaluator_babelrc 355405 ns 299072 ns 1.19
E2E_Evaluator_cerebrum-criminal-case 2454634 ns 2205098 ns 1.11
E2E_Evaluator_clang-format 270325 ns 221403 ns 1.22
E2E_Evaluator_cmake-presets 19388159 ns 18700360 ns 1.04
E2E_Evaluator_code-climate 532064 ns 443155 ns 1.20
E2E_Evaluator_cql2 1315698 ns 1039650 ns 1.27
E2E_Evaluator_cspell 1728364 ns 1653400 ns 1.05
E2E_Evaluator_cypress 816851 ns 748225 ns 1.09
E2E_Evaluator_deno 1112455 ns 1003839 ns 1.11
E2E_Evaluator_dependabot 1314621 ns 1024246 ns 1.28
E2E_Evaluator_draft-04 25197944 ns 22452795 ns 1.12
E2E_Evaluator_fabric-mod 2613222 ns 2064766 ns 1.27
E2E_Evaluator_geojson 18891522 ns 18568755 ns 1.02
E2E_Evaluator_gitpod-configuration 662948 ns 750520 ns 0.88
E2E_Evaluator_helm-chart-lock 1129704 ns 1023838 ns 1.10
E2E_Evaluator_importmap 309016 ns 245837 ns 1.26
E2E_Evaluator_jasmine 308436 ns 252795 ns 1.22
E2E_Evaluator_jsconfig 1210575 ns 1466548 ns 0.83
E2E_Evaluator_jshintrc 2741492 ns 2114649 ns 1.30
E2E_Evaluator_krakend 766291 ns 497524 ns 1.54
E2E_Evaluator_lazygit 480606 ns 368114 ns 1.31
E2E_Evaluator_lerna 494460 ns 346589 ns 1.43
E2E_Evaluator_nest-cli 673946 ns 661423 ns 1.02
E2E_Evaluator_omc 101631 ns 101766 ns 1.00
E2E_Evaluator_omnisharp 1768645 ns 1639833 ns 1.08
E2E_Evaluator_openapi 31810096 ns 25765941 ns 1.23
E2E_Evaluator_pre-commit-hooks 2174980 ns 2052626 ns 1.06
E2E_Evaluator_pulumi 2311844 ns 2564794 ns 0.90
E2E_Evaluator_semantic-release 291108 ns 271520 ns 1.07
E2E_Evaluator_stale 428463 ns 425763 ns 1.01
E2E_Evaluator_stylecop 1273305 ns 1821511 ns 0.70
E2E_Evaluator_tmuxinator 257167 ns 231495 ns 1.11
E2E_Evaluator_ui5 2574466 ns 3461012 ns 0.74
E2E_Evaluator_ui5-manifest 19154701 ns 21669553 ns 0.88
E2E_Evaluator_unreal-engine-uproject 1842159 ns 2309929 ns 0.80
E2E_Evaluator_users-array 3916243 ns 3128899 ns 1.25
E2E_Evaluator_vercel 1483842 ns 1509677 ns 0.98
E2E_Evaluator_yamllint 32317 ns 43627 ns 0.74

This comment was automatically generated by workflow using github-action-benchmark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant