Skip to content

Add a JSON-LD expansion benchmark case#904

Merged
jviotti merged 2 commits into
mainfrom
json-ld-benchmark
Jul 6, 2026
Merged

Add a JSON-LD expansion benchmark case#904
jviotti merged 2 commits into
mainfrom
json-ld-benchmark

Conversation

@jviotti

@jviotti jviotti commented Jul 6, 2026

Copy link
Copy Markdown
Member

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Review in cubic

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@jviotti jviotti force-pushed the json-ld-benchmark branch from 22333d0 to b03b17a Compare July 6, 2026 19:36
@augmentcode

augmentcode Bot commented Jul 6, 2026

Copy link
Copy Markdown
🤖 Augment PR Summary

Summary: This PR adds a new micro-benchmark that exercises Blaze’s JSON-LD expansion output path using schema annotations.

Changes:

  • Registers a new benchmark source file (benchmark/micro/jsonld.cc) in the benchmark CMake target.
  • Implements a synthetic “catalog” instance generator (people, addresses, organizations, and relations) to create a sizable annotated output.
  • Defines a Draft 2020-12 JSON Schema using x-jsonld-id and x-jsonld-type annotations to drive JSON-LD materialization.
  • Compiles the schema with annotation collection enabled via sourcemeta::blaze::Tweaks.
  • Benchmarks sourcemeta::blaze::jsonld(...) in a loop and asserts the outcome is expanded JSON-LD.

Technical Notes: The benchmark uses Mode::FastValidation and keeps the compiled template and instance outside the benchmark loop to focus timing on evaluation/materialization.

🤖 Was this summary useful? React with 👍 or 👎

@augmentcode augmentcode Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@jviotti jviotti merged commit 64d53c9 into main Jul 6, 2026
14 checks passed
@jviotti jviotti deleted the json-ld-benchmark branch July 6, 2026 20:00

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: 7b10139 Previous: ff61457 Ratio
Schema_Iterator_ISO_Language 2365755.670068062 ns/iter 1863941.5578945773 ns/iter 1.27
Schema_Tracker_ISO_Language 4896118.88111823 ns/iter 2858949.9999996293 ns/iter 1.71
Schema_Tracker_ISO_Language_To_JSON 18329297.6190479 ns/iter 16860472.54545222 ns/iter 1.09
Schema_Frame_WoT_References 6712395.604395269 ns/iter 4311445.535947665 ns/iter 1.56
Schema_Frame_OMC_References 30084175.739133295 ns/iter 20559639.285712752 ns/iter 1.46
Schema_Frame_OMC_Locations 26500649.66666445 ns/iter 18364210.526316892 ns/iter 1.44
Schema_Frame_ISO_Language_Locations 97030928.57143605 ns/iter 69675226.8889011 ns/iter 1.39
Schema_Frame_KrakenD_References 51045361.08332998 ns/iter 37778238.38888455 ns/iter 1.35
Schema_Frame_KrakenD_Reachable 557592874.9999548 ns/iter 348645145.50008607 ns/iter 1.60
Schema_Frame_ISO_Language_Locations_To_JSON 112602805.66665415 ns/iter 77804964.28573056 ns/iter 1.45
Schema_Frame_Many_Resources_References 510399875.0000756 ns/iter 258145437.4999339 ns/iter 1.98
Schema_Bundle_Meta_2020_12 1663120.324464485 ns/iter 1188299.4047184957 ns/iter 1.40
Schema_Format_ISO_Language_To_JSON 103696934.57144941 ns/iter 72140687.30002055 ns/iter 1.44
E2E_Compiler_adaptivecard 91812244.75000249 ns/iter 49055889.85715375 ns/iter 1.87
E2E_Compiler_ansible_meta 33336809.041666508 ns/iter 24660610.687504914 ns/iter 1.35
E2E_Compiler_aws_cdk 399062.0026525235 ns/iter 246580.48910670844 ns/iter 1.62
E2E_Compiler_babelrc 3053762.5545854317 ns/iter 1868760.8655915684 ns/iter 1.63
E2E_Compiler_clang_format 21161246.323528945 ns/iter 14213380.10204079 ns/iter 1.49
E2E_Compiler_cmake_presets 31902536.00000274 ns/iter 22850563.8999953 ns/iter 1.40
E2E_Compiler_code_climate 2842975.247524772 ns/iter 1976384.5955054327 ns/iter 1.44
E2E_Compiler_cql2 15737976.744186345 ns/iter 10688577.015151057 ns/iter 1.47
E2E_Compiler_cspell 23511786.606060483 ns/iter 19660293.91891843 ns/iter 1.20
E2E_Compiler_cypress 3987427.2598870266 ns/iter 3211486.5303039113 ns/iter 1.24
E2E_Compiler_deno 7842654.21839075 ns/iter 6039295.258619467 ns/iter 1.30
E2E_Compiler_dependabot 4240283.33714302 ns/iter 3132976.37499943 ns/iter 1.35
E2E_Compiler_draft_04 2256382.71380451 ns/iter 1844068.8976376837 ns/iter 1.22
E2E_Compiler_fabric_mod 3950126.604395761 ns/iter 3582984.4315793184 ns/iter 1.10
E2E_Compiler_geojson 27890844.148146246 ns/iter 18838615.9729755 ns/iter 1.48
E2E_Compiler_gitpod_configuration 4930819.803419573 ns/iter 3658835.9631578946 ns/iter 1.35
E2E_Compiler_helm_chart_lock 689919.5910087154 ns/iter 467925.7909754618 ns/iter 1.47
E2E_Compiler_importmap 303281.4272689585 ns/iter 187151.95823224558 ns/iter 1.62
E2E_Compiler_jasmine 1504673.7726099184 ns/iter 938536.8457448623 ns/iter 1.60
E2E_Compiler_jshintrc 4044422.8979585925 ns/iter 3187662.3534489665 ns/iter 1.27
E2E_Compiler_jsconfig 24991083.30769454 ns/iter 17168834.447363082 ns/iter 1.46
E2E_Compiler_krakend 161061116.59998986 ns/iter 121524381.9999993 ns/iter 1.33
E2E_Compiler_lazygit 35483587.4999992 ns/iter 31753267.857149176 ns/iter 1.12
E2E_Compiler_lerna 1416109.4348659045 ns/iter 1222795.9090908123 ns/iter 1.16
E2E_Compiler_nest_cli 7666071.477063587 ns/iter 6425553.474999409 ns/iter 1.19
E2E_Compiler_omc 202421791.50000083 ns/iter 155305947.99997744 ns/iter 1.30
E2E_Compiler_omnisharp 7083308.638888858 ns/iter 5484730.868851866 ns/iter 1.29
E2E_Compiler_openapi 26277253.359999124 ns/iter 20289091.911763534 ns/iter 1.30
E2E_Compiler_pre_commit_hooks 4253321.463575832 ns/iter 3812418.0384609364 ns/iter 1.12
E2E_Compiler_pulumi 4615328.271028222 ns/iter 2980702.6595742 ns/iter 1.55
E2E_Compiler_semantic_release 1534814.566793873 ns/iter 1096299.0835912866 ns/iter 1.40
E2E_Compiler_stale 1285157.608695547 ns/iter 1127065.9179811443 ns/iter 1.14
E2E_Compiler_stylecop 5408021.296296249 ns/iter 4904050.299999848 ns/iter 1.10
E2E_Compiler_tmuxinator 1527707.2674417614 ns/iter 1377258.8235292013 ns/iter 1.11
E2E_Compiler_ui5 49833214.28570824 ns/iter 59265450.00000563 ns/iter 0.84
E2E_Compiler_ui5_manifest 283917625.0000151 ns/iter 364287812.49992424 ns/iter 0.78
E2E_Compiler_unreal_engine_uproject 3995926.0947368513 ns/iter 3473302.196628824 ns/iter 1.15
E2E_Compiler_users_array 825058.3910550658 ns/iter 629145.2555853394 ns/iter 1.31
E2E_Compiler_vercel 12459406.818183279 ns/iter 10314876.202897537 ns/iter 1.21
E2E_Compiler_yamllint 368704.57348065375 ns/iter 225793.02255154127 ns/iter 1.63
E2E_Evaluator_adaptivecard 21991.569126471088 ns/iter 18688.07085794772 ns/iter 1.18
E2E_Evaluator_ansible_meta 218119.56563112378 ns/iter 164245.62854377917 ns/iter 1.33
E2E_Evaluator_aws_cdk 53877.15829999707 ns/iter 37198.688119319115 ns/iter 1.45
E2E_Evaluator_babelrc 119914.60506992934 ns/iter 82134.96558796089 ns/iter 1.46
E2E_Evaluator_cerebrum_criminal_case 1096098.7121952565 ns/iter 661935.7311320048 ns/iter 1.66
E2E_Evaluator_clang_format 153322.19106144877 ns/iter 93980.89779043802 ns/iter 1.63
E2E_Evaluator_cmake_presets 4101348.354651484 ns/iter 3166302.1321584275 ns/iter 1.30
E2E_Evaluator_code_climate 175764.8543874669 ns/iter 138053.59973431696 ns/iter 1.27
E2E_Evaluator_cql2 203049.70484802788 ns/iter 138229.99090188683 ns/iter 1.47
E2E_Evaluator_cspell 554816.8750000286 ns/iter 375979.6034389624 ns/iter 1.48
E2E_Evaluator_cypress 193495.59135459873 ns/iter 136345.68498236832 ns/iter 1.42
E2E_Evaluator_deno 322161.1401247349 ns/iter 222233.22780411324 ns/iter 1.45
E2E_Evaluator_dependabot 307345.95330897183 ns/iter 227951.75317482286 ns/iter 1.35
E2E_Evaluator_draft_04 6219807.851239276 ns/iter 5299238.146153584 ns/iter 1.17
E2E_Evaluator_fabric_mod 782975.7905198783 ns/iter 450283.9884019443 ns/iter 1.74
E2E_Evaluator_geojson 10038526.40845022 ns/iter 8703054.687501322 ns/iter 1.15
E2E_Evaluator_gitpod_configuration 174892.4715078337 ns/iter 164621.5699251859 ns/iter 1.06
E2E_Evaluator_helm_chart_lock 215646.45890205077 ns/iter 224864.5832205493 ns/iter 0.96
E2E_Evaluator_importmap 33366.374440868196 ns/iter 33907.559843667834 ns/iter 0.98
E2E_Evaluator_jasmine 86052.02761537324 ns/iter 86604.21046121963 ns/iter 0.99
E2E_Evaluator_jshintrc 1004065.8331016033 ns/iter 913458.3895583111 ns/iter 1.10
E2E_Evaluator_jsconfig 337920.4303059583 ns/iter 300476.9056199167 ns/iter 1.12
E2E_Evaluator_krakend 150089.492922939 ns/iter 127050.51078238491 ns/iter 1.18
E2E_Evaluator_lazygit 104487.59600425654 ns/iter 90089.71482074197 ns/iter 1.16
E2E_Evaluator_lerna 124951.57715260147 ns/iter 119538.34864728658 ns/iter 1.05
E2E_Evaluator_nest_cli 150891.1272068893 ns/iter 126640.90663301734 ns/iter 1.19
E2E_Evaluator_omc 14025.492042087732 ns/iter 12581.393224613797 ns/iter 1.11
E2E_Evaluator_omnisharp 486664.0837875218 ns/iter 448016.97993728495 ns/iter 1.09
E2E_Evaluator_openapi 7185737.295237361 ns/iter 5173973.992482491 ns/iter 1.39
E2E_Evaluator_pre_commit_hooks 459278.13781694334 ns/iter 336073.30004772835 ns/iter 1.37
E2E_Evaluator_pulumi 546421.8750000171 ns/iter 497330.65772761166 ns/iter 1.10
E2E_Evaluator_semantic_release 78076.62478504205 ns/iter 70162.0851127445 ns/iter 1.11
E2E_Evaluator_stale 141771.52856873506 ns/iter 118254.87994118643 ns/iter 1.20
E2E_Evaluator_stylecop 293290.4790522219 ns/iter 211502.68079102758 ns/iter 1.39
E2E_Evaluator_tmuxinator 99237.09232117914 ns/iter 65728.8378225054 ns/iter 1.51
E2E_Evaluator_ui5 740668.9767283042 ns/iter 346705.3273632347 ns/iter 2.14
E2E_Evaluator_ui5_manifest 1810235.9725685744 ns/iter 1836232.639639625 ns/iter 0.99
E2E_Evaluator_unreal_engine_uproject 346392.7404214427 ns/iter 321722.2602298774 ns/iter 1.08
E2E_Evaluator_users_array 428718.7301082046 ns/iter 414392.33193283924 ns/iter 1.03
E2E_Evaluator_vercel 236925.21016716232 ns/iter 227009.72858071787 ns/iter 1.04
E2E_Evaluator_yamllint 6892.7335300788645 ns/iter 6429.768616185447 ns/iter 1.07
Micro_Draft4_Meta_1_No_Callback 151.63770412446857 ns/iter 131.6615036112015 ns/iter 1.15
Micro_Draft4_Required_Properties 743.1147502578918 ns/iter 694.1204535274748 ns/iter 1.07
Micro_Draft4_Many_Optional_Properties_Minimal_Match 18.83914617399564 ns/iter 16.384069563499903 ns/iter 1.15
Micro_Draft4_Few_Optional_Properties_Minimal_Match 8.220897866748224 ns/iter 7.691134465861051 ns/iter 1.07
Micro_Draft4_Items_Schema 222.68469226548783 ns/iter 206.3285368516502 ns/iter 1.08
Micro_Draft4_Nested_Object 0.7023454726148004 ns/iter 0.9773048200321238 ns/iter 0.72
Micro_Draft4_Properties_Triad_Optional 227.14111700367883 ns/iter 199.10683511407237 ns/iter 1.14
Micro_Draft4_Properties_Triad_Closed 206.74726569462266 ns/iter 169.57432839069793 ns/iter 1.22
Micro_Draft4_Properties_Triad_Required 267.70987066144426 ns/iter 213.20442128484467 ns/iter 1.26
Micro_Draft4_Properties_Closed 47.39284714745444 ns/iter 39.88624200784641 ns/iter 1.19
Micro_Draft4_Non_Recursive_Ref 12.594040084200417 ns/iter 12.156294374410892 ns/iter 1.04
Micro_Draft4_Pattern_Properties_True 165.50306687827805 ns/iter 138.8547186703614 ns/iter 1.19
Micro_Draft4_Ref_To_Single_Property 8.922446140247898 ns/iter 7.6480770177538 ns/iter 1.17
Micro_Draft4_Additional_Properties_Type 28.562131998092397 ns/iter 26.14733330394478 ns/iter 1.09
Micro_Draft4_Nested_Oneof 43.73160494284018 ns/iter 34.184036243707816 ns/iter 1.28
Micro_Draft4_Short_Enum 5.271611013187331 ns/iter 4.713291026259001 ns/iter 1.12
Micro_Draft4_Long_Enum 10.389471476991092 ns/iter 9.107134773808793 ns/iter 1.14
Micro_Draft4_Long_Enum_Short_Strings 6.862581966419741 ns/iter 6.299467502472757 ns/iter 1.09
Micro_Draft4_Type_Object 2.5082505207986823 ns/iter 4.160430106030034 ns/iter 0.60
Micro_Draft4_Ref_Single_100 1749275.297619252 ns/iter 1810053.3282440503 ns/iter 0.97
Micro_Draft4_Compile_Ref_Many_Nested 1327879.8253675546 ns/iter 1248440.8513985127 ns/iter 1.06
Micro_Draft4_Compile_Wrap 2773098.0415232326 ns/iter 1921155.7262567198 ns/iter 1.44
Micro_Draft6_Property_Names 108.57226577831764 ns/iter 93.52637926411114 ns/iter 1.16
Micro_Draft6_Compile_FHIR 11703285124.999866 ns/iter 10502612333.000116 ns/iter 1.11
Micro_Draft7_If_Then_Else 18.757297328821526 ns/iter 16.02533302933278 ns/iter 1.17
Micro_2019_09_Unevaluated_Properties 26.508977669637556 ns/iter 26.150782890474503 ns/iter 1.01
Micro_2019_09_Compile_Wrap 334877603.9999848 ns/iter 285527604.50008917 ns/iter 1.17
Micro_2020_12_Dynamic_Ref 769.0090762413985 ns/iter 581.3542957203359 ns/iter 1.32
Micro_2020_12_Dynamic_Ref_Single 3.1568116657525187 ns/iter 2.3489465938694525 ns/iter 1.34
Micro_2020_12_Simple_Output_Mask 1004.6088190404446 ns/iter 799.8807902879729 ns/iter 1.26
Micro_2020_12_Simple_Output_Annotations 90244.44328097432 ns/iter 84619.03713027562 ns/iter 1.07
Micro_2020_12_Compile_NonCircular_Shared_Refs 891637.5656252028 ns/iter 753130.8174005186 ns/iter 1.18
Micro_2020_12_Exhaustive_Deep_Numeric 5408.127688855314 ns/iter 4847.805986103465 ns/iter 1.12
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 145979.6028422991 ns/iter 136386.84928321777 ns/iter 1.07
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 17798.73400655779 ns/iter 14718.057557133818 ns/iter 1.21
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 98.80487233545136 ns/iter 85.84601771837903 ns/iter 1.15
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 5002.222362325344 ns/iter 4608.036705519573 ns/iter 1.09
Micro_JSONLD_Catalog 61573098.45453215 ns/iter
Alterschema_Check_Readibility_ISO_Language_Set_3 229472500.00000468 ns/iter 226186250.00003096 ns/iter 1.01
Alterschema_Check_Readibility_OMC 59015632.63635332 ns/iter 57736844.63635866 ns/iter 1.02
Alterschema_Check_Readibility_KrakenD 709465625.0001208 ns/iter 623811750.0001863 ns/iter 1.14
Alterschema_Apply_Readibility_KrakenD 78175771125.00021 ns/iter 66020460125 ns/iter 1.18
Alterschema_Check_Invalid_External_Refs 194365562.49996784 ns/iter 149858510.24994192 ns/iter 1.30

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: 7b10139 Previous: ff61457 Ratio
E2E_Evaluator_adaptivecard 121776 ns 121083 ns 1.01
E2E_Evaluator_ansible-meta 433870 ns 370056 ns 1.17
E2E_Evaluator_aws-cdk 144004 ns 112416 ns 1.28
E2E_Evaluator_babelrc 358182 ns 259678 ns 1.38
E2E_Evaluator_cerebrum-criminal-case 2056712 ns 1589270 ns 1.29
E2E_Evaluator_clang-format 217157 ns 171714 ns 1.26
E2E_Evaluator_cmake-presets 15276352 ns 12701989 ns 1.20
E2E_Evaluator_code-climate 504137 ns 387843 ns 1.30
E2E_Evaluator_cql2 1431397 ns 934123 ns 1.53
E2E_Evaluator_cspell 1454864 ns 1046983 ns 1.39
E2E_Evaluator_cypress 629702 ns 588682 ns 1.07
E2E_Evaluator_deno 1013831 ns 780596 ns 1.30
E2E_Evaluator_dependabot 1028390 ns 737221 ns 1.39
E2E_Evaluator_draft-04 19660303 ns 15604958 ns 1.26
E2E_Evaluator_fabric-mod 1939308 ns 1380140 ns 1.41
E2E_Evaluator_geojson 18576702 ns 15312451 ns 1.21
E2E_Evaluator_gitpod-configuration 571486 ns 500965 ns 1.14
E2E_Evaluator_helm-chart-lock 938269 ns 828043 ns 1.13
E2E_Evaluator_importmap 244412 ns 210803 ns 1.16
E2E_Evaluator_jasmine 253764 ns 207312 ns 1.22
E2E_Evaluator_jsconfig 1178310 ns 875720 ns 1.35
E2E_Evaluator_jshintrc 2280052 ns 1972712 ns 1.16
E2E_Evaluator_krakend 482170 ns 441466 ns 1.09
E2E_Evaluator_lazygit 309162 ns 328144 ns 0.94
E2E_Evaluator_lerna 385231 ns 322289 ns 1.20
E2E_Evaluator_nest-cli 515492 ns 432013 ns 1.19
E2E_Evaluator_omc 82696 ns 70944 ns 1.17
E2E_Evaluator_omnisharp 1048979 ns 987626 ns 1.06
E2E_Evaluator_openapi 18105147 ns 15342405 ns 1.18
E2E_Evaluator_pre-commit-hooks 1529784 ns 1376168 ns 1.11
E2E_Evaluator_pulumi 1486942 ns 1388504 ns 1.07
E2E_Evaluator_semantic-release 240709 ns 176126 ns 1.37
E2E_Evaluator_stale 350397 ns 275978 ns 1.27
E2E_Evaluator_stylecop 1182199 ns 799528 ns 1.48
E2E_Evaluator_tmuxinator 172780 ns 165302 ns 1.05
E2E_Evaluator_ui5 1824613 ns 1537056 ns 1.19
E2E_Evaluator_ui5-manifest 10998758 ns 9009201 ns 1.22
E2E_Evaluator_unreal-engine-uproject 1310331 ns 1148087 ns 1.14
E2E_Evaluator_users-array 2373031 ns 1863531 ns 1.27
E2E_Evaluator_vercel 857787 ns 699679 ns 1.23
E2E_Evaluator_yamllint 26211 ns 24105 ns 1.09

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: 7b10139 Previous: ff61457 Ratio
Schema_Iterator_ISO_Language 3082267.139639904 ns/iter 3061549.1453734785 ns/iter 1.01
Schema_Tracker_ISO_Language 4627783.157894484 ns/iter 4684965.268964741 ns/iter 0.99
Schema_Tracker_ISO_Language_To_JSON 20257276.99999807 ns/iter 20714869.18181577 ns/iter 0.98
Schema_Frame_WoT_References 4505199.399999759 ns/iter 4471636.9358971305 ns/iter 1.01
Schema_Frame_OMC_References 19832905.777775522 ns/iter 20167942.6285734 ns/iter 0.98
Schema_Frame_OMC_Locations 18385796.526316475 ns/iter 19189755.43589906 ns/iter 0.96
Schema_Frame_ISO_Language_Locations 95662769.16666538 ns/iter 101856025.99998826 ns/iter 0.94
Schema_Frame_KrakenD_References 37609497.947366774 ns/iter 40841072.11764711 ns/iter 0.92
Schema_Frame_KrakenD_Reachable 616684157.9999982 ns/iter 623309830.999915 ns/iter 0.99
Schema_Frame_ISO_Language_Locations_To_JSON 122279983.49999325 ns/iter 119818089.83334 ns/iter 1.02
Schema_Frame_Many_Resources_References 348765190.999984 ns/iter 346534563.99996686 ns/iter 1.01
Schema_Bundle_Meta_2020_12 1434262.4620101866 ns/iter 1438257.9876816077 ns/iter 1.00
Schema_Format_ISO_Language_To_JSON 102945511.57141995 ns/iter 107429454.14290261 ns/iter 0.96
E2E_Compiler_adaptivecard 56436677.00000303 ns/iter 58206975.33334851 ns/iter 0.97
E2E_Compiler_ansible_meta 24908895.785711948 ns/iter 24912980.17857194 ns/iter 1.00
E2E_Compiler_aws_cdk 304775.78580761 ns/iter 328992.5527426181 ns/iter 0.93
E2E_Compiler_babelrc 2279523.886363529 ns/iter 2302616.63696348 ns/iter 0.99
E2E_Compiler_clang_format 16191566.837209774 ns/iter 16197803.883721653 ns/iter 1.00
E2E_Compiler_cmake_presets 25358607.03571302 ns/iter 25423242.535712887 ns/iter 1.00
E2E_Compiler_code_climate 2300269.9933776637 ns/iter 2293929.3245897596 ns/iter 1.00
E2E_Compiler_cql2 12711398.618181523 ns/iter 12992096.25454668 ns/iter 0.98
E2E_Compiler_cspell 22540958.41935337 ns/iter 22755644.225805055 ns/iter 0.99
E2E_Compiler_cypress 3814580.1043957104 ns/iter 3914657.150000443 ns/iter 0.97
E2E_Compiler_deno 6896146.656862245 ns/iter 6996419.98000061 ns/iter 0.99
E2E_Compiler_dependabot 3492004.2985074692 ns/iter 3477596.4554457893 ns/iter 1.00
E2E_Compiler_draft_04 2388887.126279608 ns/iter 2428180.741378975 ns/iter 0.98
E2E_Compiler_fabric_mod 4221677.493975572 ns/iter 4303717.712500088 ns/iter 0.98
E2E_Compiler_geojson 20055362.88571485 ns/iter 20170775.228572372 ns/iter 0.99
E2E_Compiler_gitpod_configuration 4445308.620253273 ns/iter 4478095.191083192 ns/iter 0.99
E2E_Compiler_helm_chart_lock 581139.7205021444 ns/iter 620177.9234153648 ns/iter 0.94
E2E_Compiler_importmap 227385.91331167534 ns/iter 245808.6424050389 ns/iter 0.93
E2E_Compiler_jasmine 1179155.8279933569 ns/iter 1226767.1958039291 ns/iter 0.96
E2E_Compiler_jshintrc 3759597.3422462353 ns/iter 3844776.390110383 ns/iter 0.98
E2E_Compiler_jsconfig 19930311.11428536 ns/iter 19957255.71428011 ns/iter 1.00
E2E_Compiler_krakend 133682493.20001268 ns/iter 139339463.59998116 ns/iter 0.96
E2E_Compiler_lazygit 30615125.695649307 ns/iter 30097685.26086863 ns/iter 1.02
E2E_Compiler_lerna 1389409.6115538208 ns/iter 1435174.8439425756 ns/iter 0.97
E2E_Compiler_nest_cli 6658483.714285727 ns/iter 6662251.666667934 ns/iter 1.00
E2E_Compiler_omc 150045228.3999948 ns/iter 156122303.2500152 ns/iter 0.96
E2E_Compiler_omnisharp 5960805.516948868 ns/iter 5980482.658118583 ns/iter 1.00
E2E_Compiler_openapi 22822012.129033223 ns/iter 22826158.838714976 ns/iter 1.00
E2E_Compiler_pre_commit_hooks 4604149.1788083175 ns/iter 4593155.440789443 ns/iter 1.00
E2E_Compiler_pulumi 3557911.796954424 ns/iter 3594099.0360816233 ns/iter 0.99
E2E_Compiler_semantic_release 1329977.3769231339 ns/iter 1370637.109589098 ns/iter 0.97
E2E_Compiler_stale 1384718.6515465286 ns/iter 1399840.5520001142 ns/iter 0.99
E2E_Compiler_stylecop 5046546.417266366 ns/iter 5221462.365672995 ns/iter 0.97
E2E_Compiler_tmuxinator 1636606.8995327058 ns/iter 1677054.9090907613 ns/iter 0.98
E2E_Compiler_ui5 47100737.53333291 ns/iter 47631086.19999912 ns/iter 0.99
E2E_Compiler_ui5_manifest 307540785.0000147 ns/iter 311546902.5000266 ns/iter 0.99
E2E_Compiler_unreal_engine_uproject 4093351.3625734327 ns/iter 4098400.701754176 ns/iter 1.00
E2E_Compiler_users_array 739921.6469968462 ns/iter 779005.8812431574 ns/iter 0.95
E2E_Compiler_vercel 12036311.931034293 ns/iter 12068690.172413724 ns/iter 1.00
E2E_Compiler_yamllint 282906.964054927 ns/iter 305558.5471943851 ns/iter 0.93
E2E_Evaluator_adaptivecard 26821.83657676312 ns/iter 25517.192830341653 ns/iter 1.05
E2E_Evaluator_ansible_meta 222295.6618705029 ns/iter 243616.14044171086 ns/iter 0.91
E2E_Evaluator_aws_cdk 45854.38179060769 ns/iter 53505.00160184006 ns/iter 0.86
E2E_Evaluator_babelrc 99269.31974523097 ns/iter 115864.02155528976 ns/iter 0.86
E2E_Evaluator_cerebrum_criminal_case 1113417.6559485928 ns/iter 1032956.120234623 ns/iter 1.08
E2E_Evaluator_clang_format 115556.05592104935 ns/iter 122665.93386384212 ns/iter 0.94
E2E_Evaluator_cmake_presets 4438323.628204735 ns/iter 5118656.539999998 ns/iter 0.87
E2E_Evaluator_code_climate 162336.78563070923 ns/iter 180530.89615080852 ns/iter 0.90
E2E_Evaluator_cql2 199074.15319390906 ns/iter 213996.62156380832 ns/iter 0.93
E2E_Evaluator_cspell 605955.886825819 ns/iter 605473.6922397885 ns/iter 1.00
E2E_Evaluator_cypress 173566.7986179707 ns/iter 193757.84222227643 ns/iter 0.90
E2E_Evaluator_deno 264729.08308158035 ns/iter 331937.75318547647 ns/iter 0.80
E2E_Evaluator_dependabot 331059.7642085531 ns/iter 328624.71796068415 ns/iter 1.01
E2E_Evaluator_draft_04 8658395.70833297 ns/iter 10323994.552239658 ns/iter 0.84
E2E_Evaluator_fabric_mod 678752.0234374788 ns/iter 702785.7142857629 ns/iter 0.97
E2E_Evaluator_geojson 18271811.55263253 ns/iter 17119971.02380619 ns/iter 1.07
E2E_Evaluator_gitpod_configuration 221031.50439973603 ns/iter 242201.57554703142 ns/iter 0.91
E2E_Evaluator_helm_chart_lock 229411.4341801556 ns/iter 313776.8304702419 ns/iter 0.73
E2E_Evaluator_importmap 52243.467662819756 ns/iter 51169.71932823796 ns/iter 1.02
E2E_Evaluator_jasmine 101177.18431771513 ns/iter 107352.32633499346 ns/iter 0.94
E2E_Evaluator_jshintrc 1170869.381113161 ns/iter 1215299.0365855512 ns/iter 0.96
E2E_Evaluator_jsconfig 409249.871990645 ns/iter 439074.94601384737 ns/iter 0.93
E2E_Evaluator_krakend 191650.24280281668 ns/iter 212179.3534827201 ns/iter 0.90
E2E_Evaluator_lazygit 132405.99513928453 ns/iter 152075.4831386327 ns/iter 0.87
E2E_Evaluator_lerna 116661.94418450339 ns/iter 152771.89860064638 ns/iter 0.76
E2E_Evaluator_nest_cli 185438.59603697422 ns/iter 194429.56352682906 ns/iter 0.95
E2E_Evaluator_omc 19808.414413918515 ns/iter 18651.7086536401 ns/iter 1.06
E2E_Evaluator_omnisharp 564493.2858312981 ns/iter 620731.13110296 ns/iter 0.91
E2E_Evaluator_openapi 10024992.582089 ns/iter 12533682.875000197 ns/iter 0.80
E2E_Evaluator_pre_commit_hooks 493389.12587908685 ns/iter 489681.10429882706 ns/iter 1.01
E2E_Evaluator_pulumi 693857.5703124838 ns/iter 706032.8743616609 ns/iter 0.98
E2E_Evaluator_semantic_release 87675.00378788289 ns/iter 105577.32118108113 ns/iter 0.83
E2E_Evaluator_stale 153072.7370378331 ns/iter 155687.64378723377 ns/iter 0.98
E2E_Evaluator_stylecop 272368.68199533847 ns/iter 301576.9208570242 ns/iter 0.90
E2E_Evaluator_tmuxinator 85866.36135584205 ns/iter 101678.91511781048 ns/iter 0.84
E2E_Evaluator_ui5 507428.88652998843 ns/iter 536629.068094876 ns/iter 0.95
E2E_Evaluator_ui5_manifest 2504746.572437748 ns/iter 2767776.62921301 ns/iter 0.90
E2E_Evaluator_unreal_engine_uproject 434411.23232955934 ns/iter 444087.4895237992 ns/iter 0.98
E2E_Evaluator_users_array 632552.7101448708 ns/iter 574914.0737206931 ns/iter 1.10
E2E_Evaluator_vercel 269727.55402828765 ns/iter 335521.3279389726 ns/iter 0.80
E2E_Evaluator_yamllint 8750.514995885907 ns/iter 9235.611978074814 ns/iter 0.95
Micro_Draft4_Meta_1_No_Callback 201.92386305104498 ns/iter 201.66422372616293 ns/iter 1.00
Micro_Draft4_Required_Properties 920.2790529488327 ns/iter 862.4290706167583 ns/iter 1.07
Micro_Draft4_Many_Optional_Properties_Minimal_Match 26.41617892811817 ns/iter 23.503456270680267 ns/iter 1.12
Micro_Draft4_Few_Optional_Properties_Minimal_Match 11.774415735744089 ns/iter 11.834591479618805 ns/iter 0.99
Micro_Draft4_Items_Schema 272.8737812485002 ns/iter 274.7138651753529 ns/iter 0.99
Micro_Draft4_Nested_Object 1.406572405025283 ns/iter 1.8689670867865 ns/iter 0.75
Micro_Draft4_Properties_Triad_Optional 328.1940396353934 ns/iter 322.4725955471932 ns/iter 1.02
Micro_Draft4_Properties_Triad_Closed 271.6536836831874 ns/iter 267.2564492704776 ns/iter 1.02
Micro_Draft4_Properties_Triad_Required 345.88408255570766 ns/iter 348.7842802768294 ns/iter 0.99
Micro_Draft4_Properties_Closed 65.32857177714232 ns/iter 62.827724346794945 ns/iter 1.04
Micro_Draft4_Non_Recursive_Ref 16.301991411488757 ns/iter 13.954609811719488 ns/iter 1.17
Micro_Draft4_Pattern_Properties_True 148.9696209192016 ns/iter 150.4841118941106 ns/iter 0.99
Micro_Draft4_Ref_To_Single_Property 11.786943923372487 ns/iter 11.847313187060008 ns/iter 0.99
Micro_Draft4_Additional_Properties_Type 37.98578117350229 ns/iter 33.365228202742166 ns/iter 1.14
Micro_Draft4_Nested_Oneof 59.175839905709715 ns/iter 60.12280352155649 ns/iter 0.98
Micro_Draft4_Short_Enum 10.933663046821527 ns/iter 12.175307685009255 ns/iter 0.90
Micro_Draft4_Long_Enum 14.608894446450831 ns/iter 15.585670651377491 ns/iter 0.94
Micro_Draft4_Long_Enum_Short_Strings 10.927425493892976 ns/iter 12.158643831493606 ns/iter 0.90
Micro_Draft4_Type_Object 3.525473748073898 ns/iter 3.4306690251692253 ns/iter 1.03
Micro_Draft4_Ref_Single_100 2290574.4444446387 ns/iter 2361798.030201743 ns/iter 0.97
Micro_Draft4_Compile_Ref_Many_Nested 1667978.6642682338 ns/iter 1738570.0226131617 ns/iter 0.96
Micro_Draft4_Compile_Wrap 2308868.049341658 ns/iter 2339224.950000395 ns/iter 0.99
Micro_Draft6_Property_Names 124.39250624176384 ns/iter 118.64758553408151 ns/iter 1.05
Micro_Draft6_Compile_FHIR 16736724094.00001 ns/iter 14461388077.000038 ns/iter 1.16
Micro_Draft7_If_Then_Else 25.4422700245249 ns/iter 24.92619999569119 ns/iter 1.02
Micro_2019_09_Unevaluated_Properties 25.521880083333418 ns/iter 27.41688953390557 ns/iter 0.93
Micro_2019_09_Compile_Wrap 287539277.5000591 ns/iter 292705409.99993956 ns/iter 0.98
Micro_2020_12_Dynamic_Ref 724.3700222907751 ns/iter 711.133402317855 ns/iter 1.02
Micro_2020_12_Dynamic_Ref_Single 3.5253882101124545 ns/iter 3.4307386887160014 ns/iter 1.03
Micro_2020_12_Simple_Output_Mask 1056.7408827869672 ns/iter 1085.9270690868639 ns/iter 0.97
Micro_2020_12_Simple_Output_Annotations 93880.98828913785 ns/iter 105822.82893329377 ns/iter 0.89
Micro_2020_12_Compile_NonCircular_Shared_Refs 933138.8436655198 ns/iter 982500.9008378839 ns/iter 0.95
Micro_2020_12_Exhaustive_Deep_Numeric 8629.588175695524 ns/iter 8254.056139608709 ns/iter 1.05
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 172503.13990385935 ns/iter 179331.0646803866 ns/iter 0.96
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 23299.917267033914 ns/iter 22847.077982545434 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 158.0304223896929 ns/iter 150.60504282960164 ns/iter 1.05
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4156.078891729475 ns/iter 4437.9565126787165 ns/iter 0.94
Micro_JSONLD_Catalog 74768184.88887854 ns/iter
Alterschema_Check_Readibility_ISO_Language_Set_3 343599659.0000059 ns/iter 380085397.0000162 ns/iter 0.90
Alterschema_Check_Readibility_OMC 88521552.6249965 ns/iter 88480091.5000028 ns/iter 1.00
Alterschema_Check_Readibility_KrakenD 1347944422.9999444 ns/iter 1221728243.9999053 ns/iter 1.10
Alterschema_Apply_Readibility_KrakenD 127266237276.99985 ns/iter 122521666595.00017 ns/iter 1.04
Alterschema_Check_Invalid_External_Refs 256911429.66669154 ns/iter 297912699.9999835 ns/iter 0.86

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: 7b10139 Previous: ff61457 Ratio
E2E_Evaluator_adaptivecard 125298 ns 118208 ns 1.06
E2E_Evaluator_ansible-meta 544749 ns 536548 ns 1.02
E2E_Evaluator_aws-cdk 128086 ns 148757 ns 0.86
E2E_Evaluator_babelrc 381037 ns 350591 ns 1.09
E2E_Evaluator_cerebrum-criminal-case 2661494 ns 2524715 ns 1.05
E2E_Evaluator_clang-format 278982 ns 256120 ns 1.09
E2E_Evaluator_cmake-presets 17828378 ns 17881521 ns 1.00
E2E_Evaluator_code-climate 500478 ns 523936 ns 0.96
E2E_Evaluator_cql2 1243334 ns 1180871 ns 1.05
E2E_Evaluator_cspell 1644764 ns 1501016 ns 1.10
E2E_Evaluator_cypress 848183 ns 800732 ns 1.06
E2E_Evaluator_deno 1089798 ns 1060545 ns 1.03
E2E_Evaluator_dependabot 1060230 ns 1078408 ns 0.98
E2E_Evaluator_draft-04 20413164 ns 22675546 ns 0.90
E2E_Evaluator_fabric-mod 2458085 ns 2386448 ns 1.03
E2E_Evaluator_geojson 24787825 ns 30433160 ns 0.81
E2E_Evaluator_gitpod-configuration 743083 ns 724361 ns 1.03
E2E_Evaluator_helm-chart-lock 1067358 ns 995036 ns 1.07
E2E_Evaluator_importmap 280626 ns 265541 ns 1.06
E2E_Evaluator_jasmine 287555 ns 300669 ns 0.96
E2E_Evaluator_jsconfig 1490414 ns 1237711 ns 1.20
E2E_Evaluator_jshintrc 2897592 ns 2726938 ns 1.06
E2E_Evaluator_krakend 650626 ns 683078 ns 0.95
E2E_Evaluator_lazygit 486531 ns 497924 ns 0.98
E2E_Evaluator_lerna 458024 ns 479605 ns 0.96
E2E_Evaluator_nest-cli 651990 ns 619223 ns 1.05
E2E_Evaluator_omc 92461 ns 94042 ns 0.98
E2E_Evaluator_omnisharp 1509164 ns 1408945 ns 1.07
E2E_Evaluator_openapi 23056108 ns 24924830 ns 0.93
E2E_Evaluator_pre-commit-hooks 2048569 ns 1996248 ns 1.03
E2E_Evaluator_pulumi 2042437 ns 1912483 ns 1.07
E2E_Evaluator_semantic-release 239350 ns 257631 ns 0.93
E2E_Evaluator_stale 393936 ns 402228 ns 0.98
E2E_Evaluator_stylecop 1243872 ns 1225782 ns 1.01
E2E_Evaluator_tmuxinator 229056 ns 230191 ns 1.00
E2E_Evaluator_ui5 2213141 ns 2238014 ns 0.99
E2E_Evaluator_ui5-manifest 10177136 ns 11565029 ns 0.88
E2E_Evaluator_unreal-engine-uproject 1622570 ns 1534126 ns 1.06
E2E_Evaluator_users-array 2503748 ns 2466080 ns 1.02
E2E_Evaluator_vercel 1029387 ns 961778 ns 1.07
E2E_Evaluator_yamllint 25049 ns 25875 ns 0.97

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: 7b10139 Previous: ff61457 Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 347954004.00003016 ns/iter 347499370.50003153 ns/iter 1.00
Alterschema_Check_Readibility_OMC 99495099.57141344 ns/iter 99288832.28573276 ns/iter 1.00
Alterschema_Check_Readibility_KrakenD 1435024696.0000277 ns/iter 1411942831.0000331 ns/iter 1.02
Alterschema_Apply_Readibility_KrakenD 132650414191.99997 ns/iter 132543161544.99997 ns/iter 1.00
Alterschema_Check_Invalid_External_Refs 282357211.0000896 ns/iter 286352104.0000023 ns/iter 0.99
Micro_JSONLD_Catalog 69097899.0000076 ns/iter
Micro_2020_12_Dynamic_Ref 836.4265316120274 ns/iter 804.8144562228933 ns/iter 1.04
Micro_2020_12_Dynamic_Ref_Single 4.5730967040115384 ns/iter 4.222397757533204 ns/iter 1.08
Micro_2020_12_Simple_Output_Mask 1118.7759988497075 ns/iter 1130.157818343456 ns/iter 0.99
Micro_2020_12_Simple_Output_Annotations 101084.30320824948 ns/iter 104220.9472267879 ns/iter 0.97
Micro_2020_12_Compile_NonCircular_Shared_Refs 1068928.9817628793 ns/iter 1107665.9340657215 ns/iter 0.97
Micro_2020_12_Exhaustive_Deep_Numeric 9162.271615061947 ns/iter 9956.02042003718 ns/iter 0.92
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 165079.24185171418 ns/iter 167015.10526314206 ns/iter 0.99
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 27392.503714713494 ns/iter 27441.637728307247 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 163.9413200500522 ns/iter 181.729511284478 ns/iter 0.90
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4574.8022623336055 ns/iter 4416.37193734414 ns/iter 1.04
Micro_2019_09_Unevaluated_Properties 31.01123126903274 ns/iter 30.47129364161209 ns/iter 1.02
Micro_2019_09_Compile_Wrap 308287986.5000905 ns/iter 306868298.9999161 ns/iter 1.00
Micro_Draft7_If_Then_Else 25.83623518839627 ns/iter 24.916644569524745 ns/iter 1.04
Micro_Draft6_Property_Names 159.80202533286425 ns/iter 152.5262778239178 ns/iter 1.05
Micro_Draft6_Compile_FHIR 14819372784.000051 ns/iter 14103245382.000069 ns/iter 1.05
Micro_Draft4_Meta_1_No_Callback 182.2568712763902 ns/iter 180.74599706220212 ns/iter 1.01
Micro_Draft4_Required_Properties 949.06985126433 ns/iter 918.8871524154916 ns/iter 1.03
Micro_Draft4_Many_Optional_Properties_Minimal_Match 22.015035990443934 ns/iter 21.85636169903263 ns/iter 1.01
Micro_Draft4_Few_Optional_Properties_Minimal_Match 16.245243722764968 ns/iter 15.843895661399852 ns/iter 1.03
Micro_Draft4_Items_Schema 296.2378940518895 ns/iter 296.71585120740434 ns/iter 1.00
Micro_Draft4_Nested_Object 2.10907644428801 ns/iter 2.1111851828197774 ns/iter 1.00
Micro_Draft4_Properties_Triad_Optional 486.00770306462834 ns/iter 432.40884204166116 ns/iter 1.12
Micro_Draft4_Properties_Triad_Closed 390.6699004754779 ns/iter 354.9670920696207 ns/iter 1.10
Micro_Draft4_Properties_Triad_Required 502.5054261152463 ns/iter 509.67921799997384 ns/iter 0.99
Micro_Draft4_Properties_Closed 64.6944231341842 ns/iter 65.15995627015177 ns/iter 0.99
Micro_Draft4_Non_Recursive_Ref 9.1753919357011 ns/iter 8.79825842963343 ns/iter 1.04
Micro_Draft4_Pattern_Properties_True 193.89081464486077 ns/iter 194.08649530769335 ns/iter 1.00
Micro_Draft4_Ref_To_Single_Property 16.20485121067687 ns/iter 15.860040012543735 ns/iter 1.02
Micro_Draft4_Additional_Properties_Type 13.861389222263263 ns/iter 14.781104893350847 ns/iter 0.94
Micro_Draft4_Nested_Oneof 63.692965123886054 ns/iter 63.39803015989159 ns/iter 1.00
Micro_Draft4_Short_Enum 14.500500934718525 ns/iter 14.540546041427655 ns/iter 1.00
Micro_Draft4_Long_Enum 13.390893868044115 ns/iter 13.398606516565673 ns/iter 1.00
Micro_Draft4_Long_Enum_Short_Strings 14.520748284757982 ns/iter 14.47674997262805 ns/iter 1.00
Micro_Draft4_Type_Object 4.572170787441199 ns/iter 4.222970855471329 ns/iter 1.08
Micro_Draft4_Ref_Single_100 2430429.6124569587 ns/iter 2469723.845070854 ns/iter 0.98
Micro_Draft4_Compile_Ref_Many_Nested 1803186.717223814 ns/iter 1837507.3227508394 ns/iter 0.98
Micro_Draft4_Compile_Wrap 2565130.974452433 ns/iter 2602270.553505459 ns/iter 0.99
E2E_Compiler_adaptivecard 61078589.0000071 ns/iter 62079422.000000365 ns/iter 0.98
E2E_Compiler_ansible_meta 27775124.360005066 ns/iter 28836321.291673053 ns/iter 0.96
E2E_Compiler_aws_cdk 345050.0964566937 ns/iter 359541.92406358017 ns/iter 0.96
E2E_Compiler_babelrc 2504158.9749100804 ns/iter 2584679.7148149023 ns/iter 0.97
E2E_Compiler_clang_format 17571154.82499785 ns/iter 18153459.743591435 ns/iter 0.97
E2E_Compiler_cmake_presets 27032400.269228254 ns/iter 27706663.959997967 ns/iter 0.98
E2E_Compiler_code_climate 2545940.6459847502 ns/iter 2616492.3520598486 ns/iter 0.97
E2E_Compiler_cql2 14052980.32000246 ns/iter 14211260.89795804 ns/iter 0.99
E2E_Compiler_cspell 23943718.137929708 ns/iter 24494329.931030735 ns/iter 0.98
E2E_Compiler_cypress 4098500.6549705938 ns/iter 4219381.373493626 ns/iter 0.97
E2E_Compiler_deno 7792349.277777552 ns/iter 8010312.66666604 ns/iter 0.97
E2E_Compiler_dependabot 3810392.5054354914 ns/iter 3947652.6516859285 ns/iter 0.97
E2E_Compiler_draft_04 2681034.279693871 ns/iter 2752657.736221222 ns/iter 0.97
E2E_Compiler_fabric_mod 4622179.848683429 ns/iter 4767758.40816179 ns/iter 0.97
E2E_Compiler_geojson 22248490.46875477 ns/iter 22842702.387100462 ns/iter 0.97
E2E_Compiler_gitpod_configuration 4910564.230770503 ns/iter 5071831.812949522 ns/iter 0.97
E2E_Compiler_helm_chart_lock 625423.5639639896 ns/iter 656520.5451127703 ns/iter 0.95
E2E_Compiler_importmap 253000.32186823877 ns/iter 264781.87400683545 ns/iter 0.96
E2E_Compiler_jasmine 1320729.0903956299 ns/iter 1359467.16085256 ns/iter 0.97
E2E_Compiler_jshintrc 4073526.61627926 ns/iter 4197956.964072726 ns/iter 0.97
E2E_Compiler_jsconfig 21035954.63636614 ns/iter 21873576.499999102 ns/iter 0.96
E2E_Compiler_krakend 136258094.40000013 ns/iter 141615922.9999721 ns/iter 0.96
E2E_Compiler_lazygit 32566889.045452546 ns/iter 33869091.66666945 ns/iter 0.96
E2E_Compiler_lerna 1550431.6928104693 ns/iter 1585191.8803612702 ns/iter 0.98
E2E_Compiler_nest_cli 7207561.443298809 ns/iter 7498629.095743069 ns/iter 0.96
E2E_Compiler_omc 161009121.99999583 ns/iter 164082248.99998912 ns/iter 0.98
E2E_Compiler_omnisharp 6465716.834861411 ns/iter 6695006.115384454 ns/iter 0.97
E2E_Compiler_openapi 25316185.89285602 ns/iter 26019145.851848777 ns/iter 0.97
E2E_Compiler_pre_commit_hooks 5079875.050724049 ns/iter 5223586.671641937 ns/iter 0.97
E2E_Compiler_pulumi 3934496.6629207623 ns/iter 4063826.1802335596 ns/iter 0.97
E2E_Compiler_semantic_release 1508095.1072959108 ns/iter 1557202.1447657843 ns/iter 0.97
E2E_Compiler_stale 1499799.8372592563 ns/iter 1551419.4855230642 ns/iter 0.97
E2E_Compiler_stylecop 5660900.056451254 ns/iter 5980325.452991309 ns/iter 0.95
E2E_Compiler_tmuxinator 1836802.9476439925 ns/iter 1905179.323369156 ns/iter 0.96
E2E_Compiler_ui5 49451208.92856331 ns/iter 50585351.928556785 ns/iter 0.98
E2E_Compiler_ui5_manifest 311885327.00002724 ns/iter 324299365.9999911 ns/iter 0.96
E2E_Compiler_unreal_engine_uproject 4443643.196201622 ns/iter 4609124.690788529 ns/iter 0.96
E2E_Compiler_users_array 843720.8676472142 ns/iter 880574.2839196691 ns/iter 0.96
E2E_Compiler_vercel 12819103.763637362 ns/iter 13118653.509433707 ns/iter 0.98
E2E_Compiler_yamllint 320932.8253314196 ns/iter 330790.0647754689 ns/iter 0.97
E2E_Evaluator_adaptivecard 25334.013672369674 ns/iter 25232.630701908234 ns/iter 1.00
E2E_Evaluator_ansible_meta 269617.19450888835 ns/iter 272774.66666666145 ns/iter 0.99
E2E_Evaluator_aws_cdk 56283.90581762439 ns/iter 57404.640431344866 ns/iter 0.98
E2E_Evaluator_babelrc 98334.50034881722 ns/iter 99585.38682836831 ns/iter 0.99
E2E_Evaluator_cerebrum_criminal_case 1180355.082910226 ns/iter 1193627.4488053755 ns/iter 0.99
E2E_Evaluator_clang_format 101976.01447367156 ns/iter 96760.37846450756 ns/iter 1.05
E2E_Evaluator_cmake_presets 4888961.788733276 ns/iter 4995416.916084128 ns/iter 0.98
E2E_Evaluator_code_climate 202360.9149611135 ns/iter 202087.55571639034 ns/iter 1.00
E2E_Evaluator_cql2 214570.0317989311 ns/iter 212112.78162651806 ns/iter 1.01
E2E_Evaluator_cspell 537443.5810809687 ns/iter 521422.4079938591 ns/iter 1.03
E2E_Evaluator_cypress 154554.64570413702 ns/iter 151252.7762268474 ns/iter 1.02
E2E_Evaluator_deno 301105.39654424525 ns/iter 293959.6451342185 ns/iter 1.02
E2E_Evaluator_dependabot 366368.3984127578 ns/iter 372642.7252922175 ns/iter 0.98
E2E_Evaluator_draft_04 8092218.935897877 ns/iter 7687756.022989206 ns/iter 1.05
E2E_Evaluator_fabric_mod 765444.7718714649 ns/iter 775966.0636159944 ns/iter 0.99
E2E_Evaluator_geojson 19752416.2777793 ns/iter 18233399.675673846 ns/iter 1.08
E2E_Evaluator_gitpod_configuration 246117.02013188173 ns/iter 239721.4007620277 ns/iter 1.03
E2E_Evaluator_helm_chart_lock 222765.82364223473 ns/iter 220008.82087674274 ns/iter 1.01
E2E_Evaluator_importmap 41870.72611579813 ns/iter 41405.71372525845 ns/iter 1.01
E2E_Evaluator_jasmine 112995.6765607296 ns/iter 114672.5978630423 ns/iter 0.99
E2E_Evaluator_jshintrc 1055605.9984757316 ns/iter 1032419.4243323766 ns/iter 1.02
E2E_Evaluator_jsconfig 421555.06380368024 ns/iter 397921.3117848145 ns/iter 1.06
E2E_Evaluator_krakend 194313.8042694975 ns/iter 193969.4257206502 ns/iter 1.00
E2E_Evaluator_lazygit 133175.7696364514 ns/iter 132274.76602624793 ns/iter 1.01
E2E_Evaluator_lerna 139656.6904762018 ns/iter 136645.2987600898 ns/iter 1.02
E2E_Evaluator_nest_cli 195962.66396194734 ns/iter 193000.56116286825 ns/iter 1.02
E2E_Evaluator_omc 19091.68706132423 ns/iter 19210.459597211655 ns/iter 0.99
E2E_Evaluator_omnisharp 538727.6124514374 ns/iter 533226.4597264538 ns/iter 1.01
E2E_Evaluator_openapi 10593427.019998671 ns/iter 10502766.184617938 ns/iter 1.01
E2E_Evaluator_pre_commit_hooks 485722.0431343323 ns/iter 493035.5671532682 ns/iter 0.99
E2E_Evaluator_pulumi 783677.1143499061 ns/iter 778311.8686869851 ns/iter 1.01
E2E_Evaluator_semantic_release 92295.33075485461 ns/iter 91446.64012489417 ns/iter 1.01
E2E_Evaluator_stale 174150.69228862482 ns/iter 172360.33719786114 ns/iter 1.01
E2E_Evaluator_stylecop 332802.55977234984 ns/iter 301159.926406895 ns/iter 1.11
E2E_Evaluator_tmuxinator 98606.60827934784 ns/iter 96357.88512479173 ns/iter 1.02
E2E_Evaluator_ui5 563930.2626914331 ns/iter 566358.2489694561 ns/iter 1.00
E2E_Evaluator_ui5_manifest 2938431.465020552 ns/iter 2827371.303643996 ns/iter 1.04
E2E_Evaluator_unreal_engine_uproject 456547.4642153651 ns/iter 456047.55185898877 ns/iter 1.00
E2E_Evaluator_users_array 686841.7519686274 ns/iter 683934.9468085543 ns/iter 1.00
E2E_Evaluator_vercel 281882.38321162027 ns/iter 283380.4779975396 ns/iter 0.99
E2E_Evaluator_yamllint 12019.817446454628 ns/iter 12049.29542961236 ns/iter 1.00
Schema_Format_ISO_Language_To_JSON 111805892.33333649 ns/iter 110886260.33339703 ns/iter 1.01
Schema_Bundle_Meta_2020_12 1705147.6958598485 ns/iter 1743071.6224993148 ns/iter 0.98
Schema_Frame_WoT_References 5182819.740740444 ns/iter 5354613.90076418 ns/iter 0.97
Schema_Frame_OMC_References 22134140.93749577 ns/iter 22848047.709680207 ns/iter 0.97
Schema_Frame_OMC_Locations 20562646.970588237 ns/iter 21172655.84848665 ns/iter 0.97
Schema_Frame_ISO_Language_Locations 101711743.71427177 ns/iter 104311944.28572 ns/iter 0.98
Schema_Frame_KrakenD_References 40605480.23529223 ns/iter 41956669.874991804 ns/iter 0.97
Schema_Frame_KrakenD_Reachable 573199109.999905 ns/iter 579589550.999799 ns/iter 0.99
Schema_Frame_ISO_Language_Locations_To_JSON 182729527.49998695 ns/iter 173751845.7500187 ns/iter 1.05
Schema_Frame_Many_Resources_References 367910520.99999887 ns/iter 373388152.4999561 ns/iter 0.99
Schema_Iterator_ISO_Language 3686883.5235609324 ns/iter 4082831.038888596 ns/iter 0.90
Schema_Tracker_ISO_Language 5256833.796992348 ns/iter 5258798.676692109 ns/iter 1.00
Schema_Tracker_ISO_Language_To_JSON 26390121.538462643 ns/iter 26248393.37036738 ns/iter 1.01

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: 7b10139 Previous: ff61457 Ratio
E2E_Evaluator_adaptivecard 118819 ns 117723 ns 1.01
E2E_Evaluator_ansible-meta 543665 ns 551209 ns 0.99
E2E_Evaluator_aws-cdk 139003 ns 131903 ns 1.05
E2E_Evaluator_babelrc 341623 ns 398922 ns 0.86
E2E_Evaluator_cerebrum-criminal-case 2766623 ns 2755786 ns 1.00
E2E_Evaluator_clang-format 259044 ns 262884 ns 0.99
E2E_Evaluator_cmake-presets 19338543 ns 20409134 ns 0.95
E2E_Evaluator_code-climate 510524 ns 503135 ns 1.01
E2E_Evaluator_cql2 1325903 ns 1304659 ns 1.02
E2E_Evaluator_cspell 1610095 ns 1570495 ns 1.03
E2E_Evaluator_cypress 842215 ns 798622 ns 1.05
E2E_Evaluator_deno 1078602 ns 1050537 ns 1.03
E2E_Evaluator_dependabot 1043117 ns 1030415 ns 1.01
E2E_Evaluator_draft-04 20185028 ns 19871945 ns 1.02
E2E_Evaluator_fabric-mod 2403013 ns 2381790 ns 1.01
E2E_Evaluator_geojson 25525338 ns 22941785 ns 1.11
E2E_Evaluator_gitpod-configuration 733613 ns 717770 ns 1.02
E2E_Evaluator_helm-chart-lock 1009828 ns 1015888 ns 0.99
E2E_Evaluator_importmap 266871 ns 264691 ns 1.01
E2E_Evaluator_jasmine 283527 ns 279206 ns 1.02
E2E_Evaluator_jsconfig 1450943 ns 1365807 ns 1.06
E2E_Evaluator_jshintrc 2916008 ns 2858225 ns 1.02
E2E_Evaluator_krakend 640738 ns 639439 ns 1.00
E2E_Evaluator_lazygit 462357 ns 449316 ns 1.03
E2E_Evaluator_lerna 447816 ns 448637 ns 1.00
E2E_Evaluator_nest-cli 594125 ns 591919 ns 1.00
E2E_Evaluator_omc 93356 ns 92035 ns 1.01
E2E_Evaluator_omnisharp 1450612 ns 1471149 ns 0.99
E2E_Evaluator_openapi 23037441 ns 22841434 ns 1.01
E2E_Evaluator_pre-commit-hooks 2037738 ns 1983295 ns 1.03
E2E_Evaluator_pulumi 1992796 ns 1946517 ns 1.02
E2E_Evaluator_semantic-release 226568 ns 225221 ns 1.01
E2E_Evaluator_stale 379344 ns 373589 ns 1.02
E2E_Evaluator_stylecop 1141416 ns 1177703 ns 0.97
E2E_Evaluator_tmuxinator 219487 ns 218505 ns 1.00
E2E_Evaluator_ui5 2221216 ns 2175287 ns 1.02
E2E_Evaluator_ui5-manifest 9931973 ns 9852566 ns 1.01
E2E_Evaluator_unreal-engine-uproject 1577518 ns 1543871 ns 1.02
E2E_Evaluator_users-array 2414497 ns 2534520 ns 0.95
E2E_Evaluator_vercel 979136 ns 984217 ns 0.99
E2E_Evaluator_yamllint 23853 ns 23658 ns 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant