Skip to content

Commit a343e46

Browse files
nikcionikcio
committed
test: Benchmark
1 parent 05d2a6d commit a343e46

10 files changed

Lines changed: 409 additions & 0 deletions

‎Directory.Packages.props‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,8 @@
44
<CentralPackageTransitivePinningEnabled>false</CentralPackageTransitivePinningEnabled>
55
</PropertyGroup>
66
<ItemGroup>
7+
<PackageVersion Include="BenchmarkDotNet" Version="0.15.8" />
8+
<PackageVersion Include="Nikcio.OpenApiCodeGen" Version="1.0.0" />
79
<PackageVersion Include="coverlet.collector" Version="8.0.0" />
810
<PackageVersion Include="Microsoft.NET.Test.Sdk" Version="18.3.0" />
911
<PackageVersion Include="Microsoft.OpenApi" Version="3.4.0" />

‎OpenApiCodeGenerator.slnx‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,9 @@
77
<Project Path="tests/OpenApiCodeGenerator.Tests/OpenApiCodeGenerator.Tests.csproj" />
88
<Project Path="tests/OpenApiCodeGenerator.IntegrationTests/OpenApiCodeGenerator.IntegrationTests.csproj" />
99
</Folder>
10+
<Folder Name="/benchmarks/">
11+
<Project Path="benchmarks/OpenApiCodeGenerator.Benchmarks/OpenApiCodeGenerator.Benchmarks.csproj" />
12+
</Folder>
1013
<Folder Name="/examples/">
1114
<Project Path="examples/OpenApiCodeGenerator.Examples/OpenApiCodeGenerator.Examples.csproj" />
1215
</Folder>

‎benchmarks/OpenApiCodeGenerator.Benchmarks/BenchmarkDotNet.Artifacts/results/ComparisonBenchmarks-report-github.md‎

Lines changed: 31 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,31 @@
1+
```
2+
3+
BenchmarkDotNet v0.15.8, Windows 11 (10.0.26200.7840/25H2/2025Update/HudsonValley2)
4+
AMD Ryzen 7 7800X3D 4.20GHz, 1 CPU, 16 logical and 8 physical cores
5+
.NET SDK 10.0.200-preview.0.26103.119
6+
[Host] : .NET 10.0.3 (10.0.3, 10.0.326.7603), X64 RyuJIT x86-64-v4
7+
DefaultJob : .NET 10.0.3 (10.0.3, 10.0.326.7603), X64 RyuJIT x86-64-v4
8+
9+
10+
```
11+
| Method | Categories | Mean | Error | StdDev | Median | Ratio | RatioSD | Gen0 | Gen1 | Gen2 | Allocated | Alloc Ratio |
12+
|--------- |------------------------------- |----------------:|--------------:|---------------:|----------------:|------:|--------:|------------:|----------:|--------:|---------------:|------------:|
13+
| Current | GitHubApiNext,GenerateOnly | 19,590.73 μs | 913.760 μs | 2,694.242 μs | 18,504.19 μs | ? | ? | 687.5000 | 343.7500 | 15.6250 | 37497.21 KB | ? |
14+
| | | | | | | | | | | | | |
15+
| Released | GitHubApiNext,ParseAndGenerate | 4,275,059.67 μs | 82,573.361 μs | 113,027.358 μs | 4,264,655.55 μs | 1.00 | 0.04 | 204000.0000 | 9000.0000 | - | 10055299.83 KB | 1.00 |
16+
| Current | GitHubApiNext,ParseAndGenerate | 758,891.62 μs | 14,788.118 μs | 23,023.320 μs | 754,015.15 μs | 0.18 | 0.01 | 13000.0000 | 8000.0000 | - | 678324.84 KB | 0.07 |
17+
| | | | | | | | | | | | | |
18+
| Current | GitHubApi,GenerateOnly | 15,883.52 μs | 308.995 μs | 317.315 μs | 15,751.93 μs | ? | ? | 718.7500 | 343.7500 | - | 39430.52 KB | ? |
19+
| | | | | | | | | | | | | |
20+
| Released | GitHubApi,ParseAndGenerate | 610,237.06 μs | 14,185.529 μs | 40,928.499 μs | 601,908.25 μs | 1.00 | 0.09 | 8000.0000 | 7000.0000 | - | 435401.99 KB | 1.00 |
21+
| Current | GitHubApi,ParseAndGenerate | 548,678.89 μs | 10,787.996 μs | 19,175.653 μs | 548,303.45 μs | 0.90 | 0.07 | 8000.0000 | 7000.0000 | - | 412075.61 KB | 0.95 |
22+
| | | | | | | | | | | | | |
23+
| Current | Petstore,GenerateOnly | 18.11 μs | 0.732 μs | 2.053 μs | 17.33 μs | ? | ? | 1.1292 | 0.0305 | - | 56.34 KB | ? |
24+
| | | | | | | | | | | | | |
25+
| Released | Petstore,ParseAndGenerate | 384.84 μs | 7.691 μs | 9.155 μs | 382.91 μs | 1.00 | 0.03 | 17.5781 | 7.8125 | - | 883.69 KB | 1.00 |
26+
| Current | Petstore,ParseAndGenerate | 474.75 μs | 26.998 μs | 79.604 μs | 454.69 μs | 1.23 | 0.21 | 16.6016 | 5.8594 | - | 849.99 KB | 0.96 |
27+
| | | | | | | | | | | | | |
28+
| Current | StripeApi,GenerateOnly | 18,655.74 μs | 923.037 μs | 2,721.595 μs | 18,123.93 μs | ? | ? | 625.0000 | 250.0000 | 31.2500 | 34779.54 KB | ? |
29+
| | | | | | | | | | | | | |
30+
| Released | StripeApi,ParseAndGenerate | 419,754.60 μs | 15,256.846 μs | 44,745.693 μs | 417,412.80 μs | 1.01 | 0.15 | 5000.0000 | 4000.0000 | - | 275602.76 KB | 1.00 |
31+
| Current | StripeApi,ParseAndGenerate | 393,432.72 μs | 16,806.124 μs | 49,553.240 μs | 377,968.55 μs | 0.95 | 0.15 | 4000.0000 | 3000.0000 | - | 255438.53 KB | 0.93 |

‎benchmarks/OpenApiCodeGenerator.Benchmarks/BenchmarkDotNet.Artifacts/results/ComparisonBenchmarks-report.csv‎

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
Method;Job;AnalyzeLaunchVariance;EvaluateOverhead;MaxAbsoluteError;MaxRelativeError;MinInvokeCount;MinIterationTime;OutlierMode;Affinity;EnvironmentVariables;Jit;LargeAddressAware;Platform;PowerPlanMode;Runtime;AllowVeryLargeObjects;Concurrent;CpuGroups;Force;HeapAffinitizeMask;HeapCount;NoAffinitize;RetainVm;Server;Arguments;BuildConfiguration;Clock;EngineFactory;NuGetReferences;Toolchain;IsMutator;InvocationCount;IterationCount;IterationTime;LaunchCount;MaxIterationCount;MaxWarmupIterationCount;MemoryRandomization;MinIterationCount;MinWarmupIterationCount;RunStrategy;UnrollFactor;WarmupCount;Categories;Mean;Error;StdDev;Median;Ratio;RatioSD;Gen0;Gen1;Gen2;Allocated;Alloc Ratio
2+
Current;DefaultJob;False;Default;Default;Default;Default;Default;Default;1111111111111111;Empty;RyuJit;Default;X64;8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c;.NET 10.0;False;True;False;True;Default;Default;False;False;False;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;16;Default;"GitHubApiNext,GenerateOnly";"19,590.73 μs";913.760 μs;"2,694.242 μs";"18,504.19 μs";?;?;687.5000;343.7500;15.6250;37497.21 KB;?
3+
Released;DefaultJob;False;Default;Default;Default;Default;Default;Default;1111111111111111;Empty;RyuJit;Default;X64;8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c;.NET 10.0;False;True;False;True;Default;Default;False;False;False;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;16;Default;"GitHubApiNext,ParseAndGenerate";"4,275,059.67 μs";"82,573.361 μs";"113,027.358 μs";"4,264,655.55 μs";1.00;0.04;204000.0000;9000.0000;0.0000;10055299.83 KB;1.00
4+
Current;DefaultJob;False;Default;Default;Default;Default;Default;Default;1111111111111111;Empty;RyuJit;Default;X64;8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c;.NET 10.0;False;True;False;True;Default;Default;False;False;False;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;16;Default;"GitHubApiNext,ParseAndGenerate";"758,891.62 μs";"14,788.118 μs";"23,023.320 μs";"754,015.15 μs";0.18;0.01;13000.0000;8000.0000;0.0000;678324.84 KB;0.07
5+
Current;DefaultJob;False;Default;Default;Default;Default;Default;Default;1111111111111111;Empty;RyuJit;Default;X64;8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c;.NET 10.0;False;True;False;True;Default;Default;False;False;False;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;16;Default;"GitHubApi,GenerateOnly";"15,883.52 μs";308.995 μs;317.315 μs;"15,751.93 μs";?;?;718.7500;343.7500;0.0000;39430.52 KB;?
6+
Released;DefaultJob;False;Default;Default;Default;Default;Default;Default;1111111111111111;Empty;RyuJit;Default;X64;8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c;.NET 10.0;False;True;False;True;Default;Default;False;False;False;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;16;Default;"GitHubApi,ParseAndGenerate";"610,237.06 μs";"14,185.529 μs";"40,928.499 μs";"601,908.25 μs";1.00;0.09;8000.0000;7000.0000;0.0000;435401.99 KB;1.00
7+
Current;DefaultJob;False;Default;Default;Default;Default;Default;Default;1111111111111111;Empty;RyuJit;Default;X64;8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c;.NET 10.0;False;True;False;True;Default;Default;False;False;False;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;16;Default;"GitHubApi,ParseAndGenerate";"548,678.89 μs";"10,787.996 μs";"19,175.653 μs";"548,303.45 μs";0.90;0.07;8000.0000;7000.0000;0.0000;412075.61 KB;0.95
8+
Current;DefaultJob;False;Default;Default;Default;Default;Default;Default;1111111111111111;Empty;RyuJit;Default;X64;8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c;.NET 10.0;False;True;False;True;Default;Default;False;False;False;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;16;Default;"Petstore,GenerateOnly";18.11 μs;0.732 μs;2.053 μs;17.33 μs;?;?;1.1292;0.0305;0.0000;56.34 KB;?
9+
Released;DefaultJob;False;Default;Default;Default;Default;Default;Default;1111111111111111;Empty;RyuJit;Default;X64;8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c;.NET 10.0;False;True;False;True;Default;Default;False;False;False;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;16;Default;"Petstore,ParseAndGenerate";384.84 μs;7.691 μs;9.155 μs;382.91 μs;1.00;0.03;17.5781;7.8125;0.0000;883.69 KB;1.00
10+
Current;DefaultJob;False;Default;Default;Default;Default;Default;Default;1111111111111111;Empty;RyuJit;Default;X64;8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c;.NET 10.0;False;True;False;True;Default;Default;False;False;False;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;16;Default;"Petstore,ParseAndGenerate";474.75 μs;26.998 μs;79.604 μs;454.69 μs;1.23;0.21;16.6016;5.8594;0.0000;849.99 KB;0.96
11+
Current;DefaultJob;False;Default;Default;Default;Default;Default;Default;1111111111111111;Empty;RyuJit;Default;X64;8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c;.NET 10.0;False;True;False;True;Default;Default;False;False;False;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;16;Default;"StripeApi,GenerateOnly";"18,655.74 μs";923.037 μs;"2,721.595 μs";"18,123.93 μs";?;?;625.0000;250.0000;31.2500;34779.54 KB;?
12+
Released;DefaultJob;False;Default;Default;Default;Default;Default;Default;1111111111111111;Empty;RyuJit;Default;X64;8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c;.NET 10.0;False;True;False;True;Default;Default;False;False;False;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;16;Default;"StripeApi,ParseAndGenerate";"419,754.60 μs";"15,256.846 μs";"44,745.693 μs";"417,412.80 μs";1.01;0.15;5000.0000;4000.0000;0.0000;275602.76 KB;1.00
13+
Current;DefaultJob;False;Default;Default;Default;Default;Default;Default;1111111111111111;Empty;RyuJit;Default;X64;8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c;.NET 10.0;False;True;False;True;Default;Default;False;False;False;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;Default;16;Default;"StripeApi,ParseAndGenerate";"393,432.72 μs";"16,806.124 μs";"49,553.240 μs";"377,968.55 μs";0.95;0.15;4000.0000;3000.0000;0.0000;255438.53 KB;0.93

‎benchmarks/OpenApiCodeGenerator.Benchmarks/BenchmarkDotNet.Artifacts/results/ComparisonBenchmarks-report.html‎

Lines changed: 41 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,41 @@
1+
<!DOCTYPE html>
2+
<html lang='en'>
3+
<head>
4+
<meta charset='utf-8' />
5+
<title>ComparisonBenchmarks-20260314-212521</title>
6+
7+
<style type="text/css">
8+
table { border-collapse: collapse; display: block; width: 100%; overflow: auto; }
9+
td, th { padding: 6px 13px; border: 1px solid #ddd; text-align: right; }
10+
tr { background-color: #fff; border-top: 1px solid #ccc; }
11+
tr:nth-child(even) { background: #f8f8f8; }
12+
</style>
13+
</head>
14+
<body>
15+
<pre><code>
16+
BenchmarkDotNet v0.15.8, Windows 11 (10.0.26200.7840/25H2/2025Update/HudsonValley2)
17+
AMD Ryzen 7 7800X3D 4.20GHz, 1 CPU, 16 logical and 8 physical cores
18+
.NET SDK 10.0.200-preview.0.26103.119
19+
[Host] : .NET 10.0.3 (10.0.3, 10.0.326.7603), X64 RyuJIT x86-64-v4
20+
DefaultJob : .NET 10.0.3 (10.0.3, 10.0.326.7603), X64 RyuJIT x86-64-v4
21+
</code></pre>
22+
<pre><code></code></pre>
23+
24+
<table>
25+
<thead><tr><th>Method</th><th>Categories </th><th>Mean </th><th>Error </th><th>StdDev </th><th>Median </th><th>Ratio</th><th>RatioSD</th><th>Gen0 </th><th>Gen1</th><th>Gen2</th><th>Allocated</th><th>Alloc Ratio</th>
26+
</tr>
27+
</thead><tbody><tr><td>Current</td><td>GitHubApiNext,GenerateOnly</td><td>19,590.73 &mu;s</td><td>913.760 &mu;s</td><td>2,694.242 &mu;s</td><td>18,504.19 &mu;s</td><td>?</td><td>?</td><td>687.5000</td><td>343.7500</td><td>15.6250</td><td>37497.21 KB</td><td>?</td>
28+
</tr><tr><td>Released</td><td>GitHubApiNext,ParseAndGenerate</td><td>4,275,059.67 &mu;s</td><td>82,573.361 &mu;s</td><td>113,027.358 &mu;s</td><td>4,264,655.55 &mu;s</td><td>1.00</td><td>0.04</td><td>204000.0000</td><td>9000.0000</td><td>-</td><td>10055299.83 KB</td><td>1.00</td>
29+
</tr><tr><td>Current</td><td>GitHubApiNext,ParseAndGenerate</td><td>758,891.62 &mu;s</td><td>14,788.118 &mu;s</td><td>23,023.320 &mu;s</td><td>754,015.15 &mu;s</td><td>0.18</td><td>0.01</td><td>13000.0000</td><td>8000.0000</td><td>-</td><td>678324.84 KB</td><td>0.07</td>
30+
</tr><tr><td>Current</td><td>GitHubApi,GenerateOnly</td><td>15,883.52 &mu;s</td><td>308.995 &mu;s</td><td>317.315 &mu;s</td><td>15,751.93 &mu;s</td><td>?</td><td>?</td><td>718.7500</td><td>343.7500</td><td>-</td><td>39430.52 KB</td><td>?</td>
31+
</tr><tr><td>Released</td><td>GitHubApi,ParseAndGenerate</td><td>610,237.06 &mu;s</td><td>14,185.529 &mu;s</td><td>40,928.499 &mu;s</td><td>601,908.25 &mu;s</td><td>1.00</td><td>0.09</td><td>8000.0000</td><td>7000.0000</td><td>-</td><td>435401.99 KB</td><td>1.00</td>
32+
</tr><tr><td>Current</td><td>GitHubApi,ParseAndGenerate</td><td>548,678.89 &mu;s</td><td>10,787.996 &mu;s</td><td>19,175.653 &mu;s</td><td>548,303.45 &mu;s</td><td>0.90</td><td>0.07</td><td>8000.0000</td><td>7000.0000</td><td>-</td><td>412075.61 KB</td><td>0.95</td>
33+
</tr><tr><td>Current</td><td>Petstore,GenerateOnly</td><td>18.11 &mu;s</td><td>0.732 &mu;s</td><td>2.053 &mu;s</td><td>17.33 &mu;s</td><td>?</td><td>?</td><td>1.1292</td><td>0.0305</td><td>-</td><td>56.34 KB</td><td>?</td>
34+
</tr><tr><td>Released</td><td>Petstore,ParseAndGenerate</td><td>384.84 &mu;s</td><td>7.691 &mu;s</td><td>9.155 &mu;s</td><td>382.91 &mu;s</td><td>1.00</td><td>0.03</td><td>17.5781</td><td>7.8125</td><td>-</td><td>883.69 KB</td><td>1.00</td>
35+
</tr><tr><td>Current</td><td>Petstore,ParseAndGenerate</td><td>474.75 &mu;s</td><td>26.998 &mu;s</td><td>79.604 &mu;s</td><td>454.69 &mu;s</td><td>1.23</td><td>0.21</td><td>16.6016</td><td>5.8594</td><td>-</td><td>849.99 KB</td><td>0.96</td>
36+
</tr><tr><td>Current</td><td>StripeApi,GenerateOnly</td><td>18,655.74 &mu;s</td><td>923.037 &mu;s</td><td>2,721.595 &mu;s</td><td>18,123.93 &mu;s</td><td>?</td><td>?</td><td>625.0000</td><td>250.0000</td><td>31.2500</td><td>34779.54 KB</td><td>?</td>
37+
</tr><tr><td>Released</td><td>StripeApi,ParseAndGenerate</td><td>419,754.60 &mu;s</td><td>15,256.846 &mu;s</td><td>44,745.693 &mu;s</td><td>417,412.80 &mu;s</td><td>1.01</td><td>0.15</td><td>5000.0000</td><td>4000.0000</td><td>-</td><td>275602.76 KB</td><td>1.00</td>
38+
</tr><tr><td>Current</td><td>StripeApi,ParseAndGenerate</td><td>393,432.72 &mu;s</td><td>16,806.124 &mu;s</td><td>49,553.240 &mu;s</td><td>377,968.55 &mu;s</td><td>0.95</td><td>0.15</td><td>4000.0000</td><td>3000.0000</td><td>-</td><td>255438.53 KB</td><td>0.93</td>
39+
</tr></tbody></table>
40+
</body>
41+
</html>

0 commit comments

Comments
 (0)