Skip to content

Fix release note generation by adding missing permissions#8484

Open
andrewlock wants to merge 2 commits intomasterfrom
andrew/fix-release-notes
Open

Fix release note generation by adding missing permissions#8484
andrewlock wants to merge 2 commits intomasterfrom
andrew/fix-release-notes

Conversation

@andrewlock
Copy link
Copy Markdown
Member

Summary of changes

Adds pull_requests permission to draft-release dd-octo-sts chainguard file

Reason for change

The release note generation has been silently failing since we switched to STS:

Fetching milestones...
Found vNext-v3 milestone: 216
Fetching previous release details
Fetching Issues assigned to vNext-v3
Found 0 issues, building release notes.

I think that's because we're missing the pull_requests permission in the dd-octo-sts file, and the issues endpoint we're using silently filters this out. This also seems to only apply to app permissions, which is what dd-octo-sts uses, not to fine-grained tokens, which is why we couldn't replicate it locally.

Implementation details

  • Added pull_requests: read to the draft release STS definition.
  • Removed permissions for the "ambient" GITHUB_TOKEN, as these aren't actually used, other than for the OIDC exchange, and just add confusion

Test coverage

Nope, we just have to wait for the next release, and hope nothing breaks 😬

@andrewlock andrewlock requested a review from a team as a code owner April 20, 2026 11:20
@andrewlock andrewlock added the area:builds project files, build scripts, pipelines, versioning, releases, packages label Apr 20, 2026
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 20, 2026

Benchmarks

Benchmark execution time: 2026-04-20 12:27:34

Comparing candidate commit 8db4a13 in PR branch andrew/fix-release-notes with baseline commit dc15c79 in branch master.

Found 1 performance improvements and 2 performance regressions! Performance is the same for 24 metrics, 0 unstable metrics, 87 known flaky benchmarks.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

scenario:Benchmarks.Trace.DbCommandBenchmark.ExecuteNonQuery net472

  • 🟥 throughput [-29475.664op/s; -23419.227op/s] or [-8.302%; -6.596%]

scenario:Benchmarks.Trace.HttpClientBenchmark.SendAsync net472

  • 🟥 throughput [-5270.283op/s; -5016.724op/s] or [-6.016%; -5.727%]

scenario:Benchmarks.Trace.HttpClientBenchmark.SendAsync net6.0

  • 🟩 throughput [+8897.046op/s; +9914.064op/s] or [+6.044%; +6.735%]

Known flaky benchmarks

These benchmarks are marked as flaky and will not trigger a failure. Modify FLAKY_BENCHMARKS_REGEX to control which benchmarks are marked as flaky.

scenario:Benchmarks.Trace.ActivityBenchmark.StartStopWithChild net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.008%; +0.005%]
  • ignore execution_time [-1178.097µs; -226.448µs] or [-0.585%; -0.112%]
  • ignore throughput [-1286.210op/s; -580.694op/s] or [-1.525%; -0.689%]

scenario:Benchmarks.Trace.ActivityBenchmark.StartStopWithChild net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.007%]
  • ignore execution_time [-1640.940µs; +1856.612µs] or [-0.819%; +0.926%]
  • 🟩 throughput [+9916.258op/s; +12190.057op/s] or [+8.335%; +10.246%]

scenario:Benchmarks.Trace.ActivityBenchmark.StartStopWithChild netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.007%]
  • ignore execution_time [-15.597ms; -2.764ms] or [-7.845%; -1.390%]
  • ignore throughput [-629.409op/s; +612.726op/s] or [-0.640%; +0.623%]

scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces net472

  • ignore allocated_mem [+30 bytes; +31 bytes] or [+0.936%; +0.949%]
  • 🟥 execution_time [+309.393ms; +314.840ms] or [+153.532%; +156.235%]
  • ignore throughput [+15.501op/s; +19.240op/s] or [+2.789%; +3.462%]

scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.009%; +0.002%]
  • 🟥 execution_time [+382.382ms; +384.707ms] or [+302.105%; +303.942%]
  • ignore throughput [+8.043op/s; +11.841op/s] or [+1.060%; +1.561%]

scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.009%; +0.002%]
  • 🟥 execution_time [+397.324ms; +399.770ms] or [+351.617%; +353.781%]
  • ignore throughput [-6.595op/s; -1.935op/s] or [-0.932%; -0.273%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleMoreComplexBody net472

  • 🟥 allocated_mem [+1.308KB; +1.308KB] or [+27.529%; +27.541%]
  • ignore execution_time [-579.103µs; +131.079µs] or [-0.289%; +0.065%]
  • ignore throughput [-4441.100op/s; -4008.065op/s] or [-3.455%; -3.118%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleMoreComplexBody net6.0

  • 🟥 allocated_mem [+471 bytes; +472 bytes] or [+9.977%; +9.987%]
  • 🟩 execution_time [-16.013ms; -11.843ms] or [-7.478%; -5.531%]
  • ignore throughput [+5926.322op/s; +8706.894op/s] or [+4.326%; +6.356%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleMoreComplexBody netcoreapp3.1

  • 🟥 allocated_mem [+1.272KB; +1.272KB] or [+27.502%; +27.510%]
  • ignore execution_time [-12.400ms; -8.252ms] or [-5.905%; -3.929%]
  • ignore throughput [-777.565op/s; +1494.774op/s] or [-0.703%; +1.351%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody net472

  • 🟥 allocated_mem [+1.307KB; +1.307KB] or [+105.746%; +105.759%]
  • ignore execution_time [-666.511µs; -13.253µs] or [-0.332%; -0.007%]
  • 🟥 throughput [-237548.856op/s; -234234.848op/s] or [-24.255%; -23.917%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody net6.0

  • 🟥 allocated_mem [+471 bytes; +472 bytes] or [+38.558%; +38.566%]
  • 🟩 execution_time [-27.024ms; -22.158ms] or [-12.052%; -9.881%]
  • ignore throughput [-63214.265op/s; -39768.571op/s] or [-6.753%; -4.249%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody netcoreapp3.1

  • 🟥 allocated_mem [+1.272KB; +1.272KB] or [+105.292%; +105.304%]
  • ignore execution_time [-3.352ms; +0.947ms] or [-1.673%; +0.473%]
  • 🟥 throughput [-134123.503op/s; -118046.740op/s] or [-19.271%; -16.961%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorMoreComplexBody net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.007%; +0.003%]
  • ignore execution_time [-761.351µs; +316.244µs] or [-0.380%; +0.158%]
  • ignore throughput [-1595.263op/s; -791.904op/s] or [-1.074%; -0.533%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorMoreComplexBody net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.003%]
  • ignore execution_time [-1649.826µs; +1864.967µs] or [-0.832%; +0.941%]
  • 🟩 throughput [+11984.944op/s; +14946.446op/s] or [+7.626%; +9.510%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorMoreComplexBody netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.007%; +0.003%]
  • ignore execution_time [+1.370ms; +8.312ms] or [+0.698%; +4.238%]
  • 🟩 throughput [+7112.681op/s; +10562.362op/s] or [+5.666%; +8.414%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.008%; +0.004%]
  • ignore execution_time [-210.259µs; +14.135µs] or [-0.105%; +0.007%]
  • ignore throughput [+22837.344op/s; +60701.475op/s] or [+0.695%; +1.847%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.008%]
  • ignore execution_time [-2.280ms; -1.593ms] or [-1.127%; -0.787%]
  • 🟩 throughput [+502276.111op/s; +516823.331op/s] or [+16.748%; +17.233%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.004%]
  • 🟩 execution_time [-19.257ms; -14.898ms] or [-8.877%; -6.867%]
  • 🟩 throughput [+196918.259op/s; +252542.483op/s] or [+7.816%; +10.024%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeArgs net472

  • ignore allocated_mem [+0 bytes; +2 bytes] or [-0.001%; +0.007%]
  • 🟥 execution_time [+299.127ms; +299.777ms] or [+149.464%; +149.789%]
  • ignore throughput [+132.986op/s; +174.642op/s] or [+1.469%; +1.929%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeArgs net6.0

  • ignore allocated_mem [-1 bytes; +2 bytes] or [-0.004%; +0.008%]
  • 🟥 execution_time [+300.981ms; +304.301ms] or [+151.785%; +153.460%]
  • ignore throughput [+321.096op/s; +532.911op/s] or [+2.456%; +4.076%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeArgs netcoreapp3.1

  • ignore allocated_mem [-1 bytes; +2 bytes] or [-0.004%; +0.008%]
  • 🟥 execution_time [+300.095ms; +302.536ms] or [+151.164%; +152.394%]
  • ignore throughput [+155.390op/s; +281.508op/s] or [+1.500%; +2.718%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs net472

  • ignore allocated_mem [+3 bytes; +4 bytes] or [+0.186%; +0.199%]
  • 🟥 execution_time [+297.177ms; +297.931ms] or [+145.962%; +146.332%]
  • ignore throughput [-10.933op/s; +7.848op/s] or [-0.290%; +0.208%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.009%]
  • 🟥 execution_time [+297.675ms; +300.865ms] or [+145.522%; +147.082%]
  • ignore throughput [+102.680op/s; +152.149op/s] or [+1.492%; +2.210%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.009%]
  • 🟥 execution_time [+300.309ms; +301.579ms] or [+150.094%; +150.729%]
  • ignore throughput [+30.098op/s; +55.846op/s] or [+0.597%; +1.108%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [+9.636µs; +14.598µs] or [+1.978%; +2.997%]
  • ignore throughput [-59.044op/s; -39.058op/s] or [-2.876%; -1.902%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.000%; +0.010%]
  • 🟥 execution_time [+25.277µs; +52.243µs] or [+5.797%; +11.982%]
  • 🟥 throughput [-253.068op/s; -132.042op/s] or [-11.002%; -5.741%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.003%]
  • ignore execution_time [+14.004µs; +36.880µs] or [+3.000%; +7.902%]
  • ignore throughput [-174.369op/s; -90.365op/s] or [-8.049%; -4.171%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [-2151.524ns; +1955.524ns] or [-0.581%; +0.528%]
  • ignore throughput [-13.492op/s; +16.003op/s] or [-0.500%; +0.593%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.007%]
  • 🟥 execution_time [+35.600µs; +59.800µs] or [+11.365%; +19.091%]
  • 🟥 throughput [-534.201op/s; -331.910op/s] or [-16.653%; -10.347%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.003%]
  • ignore execution_time [-12.371µs; +10.061µs] or [-3.384%; +2.752%]
  • ignore throughput [-108.603op/s; +25.442op/s] or [-3.897%; +0.913%]

scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • 🟥 execution_time [+299.919ms; +300.588ms] or [+149.690%; +150.024%]
  • ignore throughput [-1658958.733op/s; -1096567.167op/s] or [-0.831%; -0.549%]

scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest net6.0

  • ignore allocated_mem [+72 bytes; +74 bytes] or [+0.404%; +0.415%]
  • unstable execution_time [+363.469ms; +401.357ms] or [+394.924%; +436.091%]
  • 🟩 throughput [+1056.779op/s; +1195.394op/s] or [+8.684%; +9.823%]

scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest netcoreapp3.1

  • ignore allocated_mem [+20 bytes; +22 bytes] or [+0.099%; +0.110%]
  • 🟥 execution_time [+369.389ms; +372.920ms] or [+280.473%; +283.155%]
  • 🟩 throughput [+663.250op/s; +862.006op/s] or [+6.421%; +8.345%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net472

  • ignore allocated_mem [+2.762KB; +2.767KB] or [+4.908%; +4.916%]
  • unstable execution_time [+397.364ms; +472.952ms] or [+182.704%; +217.459%]
  • 🟥 throughput [-635.143op/s; -573.273op/s] or [-57.550%; -51.944%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net6.0

  • ignore allocated_mem [-1.270KB; -1.268KB] or [-2.995%; -2.990%]
  • unstable execution_time [+203.300ms; +336.520ms] or [+86.638%; +143.411%]
  • 🟥 throughput [-748.205op/s; -664.642op/s] or [-49.905%; -44.332%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1

  • ignore allocated_mem [+1.706KB; +1.709KB] or [+4.029%; +4.036%]
  • 🟥 execution_time [+333.420ms; +340.476ms] or [+199.424%; +203.644%]
  • 🟥 throughput [-399.321op/s; -364.578op/s] or [-27.804%; -25.385%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [-66.927µs; -45.655µs] or [-3.368%; -2.298%]
  • ignore throughput [+12.283op/s; +17.819op/s] or [+2.441%; +3.541%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [-41.277µs; -21.007µs] or [-2.836%; -1.443%]
  • ignore throughput [+10.920op/s; +20.814op/s] or [+1.590%; +3.030%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [-205.465µs; -101.563µs] or [-7.148%; -3.533%]
  • ignore throughput [+14.093op/s; +35.804op/s] or [+4.051%; +10.292%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [-11.435µs; -5.847µs] or [-0.988%; -0.505%]
  • ignore throughput [+4.480op/s; +8.683op/s] or [+0.519%; +1.005%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [-82.598µs; -52.325µs] or [-7.660%; -4.853%]
  • 🟩 throughput [+50.856op/s; +86.320op/s] or [+5.483%; +9.307%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • ignore execution_time [-97.170µs; +4.557µs] or [-5.206%; +0.244%]
  • unstable throughput [+4.276op/s; +70.179op/s] or [+0.798%; +13.099%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OriginalCharSlice net472

  • ignore allocated_mem [-43 bytes; +21 bytes] or [-0.007%; +0.003%]
  • ignore execution_time [+7.598µs; +18.026µs] or [+0.297%; +0.704%]
  • ignore throughput [-2.696op/s; -1.120op/s] or [-0.690%; -0.287%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OriginalCharSlice net6.0

  • ignore allocated_mem [-38 bytes; +46 bytes] or [-0.006%; +0.007%]
  • 🟩 execution_time [-182.681µs; -139.668µs] or [-9.254%; -7.075%]
  • 🟩 throughput [+40.938op/s; +52.704op/s] or [+8.081%; +10.404%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OriginalCharSlice netcoreapp3.1

  • ignore allocated_mem [-42 bytes; +23 bytes] or [-0.007%; +0.004%]
  • ignore execution_time [-138.224µs; -93.016µs] or [-3.505%; -2.359%]
  • ignore throughput [+6.448op/s; +9.302op/s] or [+2.543%; +3.668%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.001%; +0.008%]
  • 🟥 execution_time [+301.802ms; +303.308ms] or [+151.982%; +152.740%]
  • ignore throughput [+7.285op/s; +1709.546op/s] or [+0.002%; +0.550%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.004%]
  • 🟥 execution_time [+302.300ms; +304.631ms] or [+151.483%; +152.651%]
  • ignore throughput [+17141.431op/s; +22488.782op/s] or [+2.703%; +3.546%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.004%]
  • 🟥 execution_time [+301.200ms; +304.367ms] or [+151.310%; +152.901%]
  • ignore throughput [+16645.977op/s; +25149.919op/s] or [+3.506%; +5.298%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.008%; +0.004%]
  • 🟥 execution_time [+302.501ms; +304.179ms] or [+151.906%; +152.748%]
  • ignore throughput [+4339.155op/s; +6083.326op/s] or [+1.454%; +2.038%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.007%; +0.006%]
  • 🟥 execution_time [+299.217ms; +301.045ms] or [+147.950%; +148.853%]
  • ignore throughput [+11069.335op/s; +15900.324op/s] or [+1.783%; +2.562%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.004%]
  • 🟥 execution_time [+303.160ms; +306.783ms] or [+153.655%; +155.491%]
  • ignore throughput [-4672.437op/s; +4167.518op/s] or [-1.009%; +0.900%]

scenario:Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync net472

  • ignore allocated_mem [+0 bytes; +1 bytes] or [+0.108%; +0.119%]
  • 🟥 execution_time [+301.786ms; +303.196ms] or [+151.469%; +152.177%]
  • ignore throughput [+4574.884op/s; +7488.334op/s] or [+1.187%; +1.943%]

scenario:Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.006%]
  • 🟥 execution_time [+298.921ms; +301.057ms] or [+148.985%; +150.050%]
  • 🟩 throughput [+46909.361op/s; +54240.643op/s] or [+9.315%; +10.770%]

scenario:Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.006%]
  • 🟥 execution_time [+301.102ms; +303.872ms] or [+149.796%; +151.174%]
  • ignore throughput [-5404.458op/s; -64.509op/s] or [-1.279%; -0.015%]

scenario:Benchmarks.Trace.ILoggerBenchmark.EnrichedLog net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.006%]
  • ignore execution_time [-1.843ms; -1.022ms] or [-0.916%; -0.508%]
  • ignore throughput [-5896.730op/s; -4349.415op/s] or [-2.371%; -1.749%]

scenario:Benchmarks.Trace.ILoggerBenchmark.EnrichedLog net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.003%]
  • 🟩 execution_time [-16.543ms; -12.899ms] or [-7.692%; -5.998%]
  • ignore throughput [+16250.393op/s; +23073.270op/s] or [+4.458%; +6.330%]

scenario:Benchmarks.Trace.ILoggerBenchmark.EnrichedLog netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.008%]
  • ignore execution_time [-0.108ms; +3.851ms] or [-0.054%; +1.932%]
  • ignore throughput [+1011.201op/s; +6950.164op/s] or [+0.369%; +2.537%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark net472

  • ignore allocated_mem [-4.459KB; -4.431KB] or [-1.623%; -1.613%]
  • unstable execution_time [+3.641µs; +44.273µs] or [+0.899%; +10.936%]
  • ignore throughput [-230.671op/s; -25.844op/s] or [-9.282%; -1.040%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark net6.0

  • 🟩 allocated_mem [-19.136KB; -19.115KB] or [-6.980%; -6.973%]
  • unstable execution_time [-37.319µs; +15.651µs] or [-7.376%; +3.093%]
  • ignore throughput [-49.268op/s; +135.472op/s] or [-2.458%; +6.760%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark netcoreapp3.1

  • 🟩 allocated_mem [-18.199KB; -18.184KB] or [-6.634%; -6.629%]
  • ignore execution_time [-53.369µs; +3.812µs] or [-9.249%; +0.661%]
  • ignore throughput [+3.933op/s; +159.935op/s] or [+0.225%; +9.137%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark net472

  • ignore allocated_mem [-2 bytes; +2 bytes] or [-0.005%; +0.006%]
  • ignore execution_time [+25.609ns; +1449.057ns] or [+0.044%; +2.510%]
  • ignore throughput [-408.079op/s; -9.271op/s] or [-2.355%; -0.053%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark net6.0

  • ignore allocated_mem [-4 bytes; +0 bytes] or [-0.010%; -0.001%]
  • 🟥 execution_time [+5.779µs; +9.936µs] or [+13.659%; +23.485%]
  • 🟥 throughput [-4488.901op/s; -2704.910op/s] or [-18.897%; -11.387%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark netcoreapp3.1

  • ignore allocated_mem [-1 bytes; +1 bytes] or [-0.002%; +0.002%]
  • unstable execution_time [-12.607µs; -5.199µs] or [-19.559%; -8.067%]
  • 🟩 throughput [+1296.696op/s; +2861.688op/s] or [+7.956%; +17.557%]

scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog net472

  • ignore allocated_mem [+3 bytes; +4 bytes] or [+0.084%; +0.094%]
  • 🟥 execution_time [+301.760ms; +303.193ms] or [+152.526%; +153.251%]
  • ignore throughput [-195.757op/s; -173.960op/s] or [-3.271%; -2.907%]

scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.005%]
  • 🟥 execution_time [+300.473ms; +303.186ms] or [+152.940%; +154.321%]
  • ignore throughput [-254.086op/s; -168.921op/s] or [-3.151%; -2.095%]

scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog netcoreapp3.1

  • ignore allocated_mem [-1 bytes; +0 bytes] or [-0.027%; -0.017%]
  • 🟥 execution_time [+301.465ms; +304.498ms] or [+150.920%; +152.439%]
  • ignore throughput [-233.722op/s; -162.547op/s] or [-2.977%; -2.071%]

scenario:Benchmarks.Trace.RedisBenchmark.SendReceive net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.005%]
  • ignore execution_time [-429.009µs; +431.310µs] or [-0.214%; +0.215%]
  • ignore throughput [+2373.073op/s; +4273.922op/s] or [+0.657%; +1.183%]

scenario:Benchmarks.Trace.RedisBenchmark.SendReceive net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.007%]
  • ignore execution_time [-904.819µs; -140.969µs] or [-0.452%; -0.070%]
  • 🟩 throughput [+38175.777op/s; +42104.008op/s] or [+7.226%; +7.969%]

scenario:Benchmarks.Trace.RedisBenchmark.SendReceive netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.006%]
  • ignore execution_time [+1.435ms; +5.129ms] or [+0.728%; +2.600%]
  • ignore throughput [+3547.957op/s; +11879.235op/s] or [+0.840%; +2.811%]

scenario:Benchmarks.Trace.SerilogBenchmark.EnrichedLog net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.006%]
  • 🟥 execution_time [+299.514ms; +301.175ms] or [+149.281%; +150.109%]
  • ignore throughput [-6756.288op/s; -5737.152op/s] or [-4.461%; -3.788%]

scenario:Benchmarks.Trace.SerilogBenchmark.EnrichedLog net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+0.000%; +0.009%]
  • 🟥 execution_time [+301.710ms; +303.047ms] or [+151.504%; +152.176%]
  • ignore throughput [+4576.925op/s; +6378.620op/s] or [+1.990%; +2.774%]

scenario:Benchmarks.Trace.SerilogBenchmark.EnrichedLog netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.003%]
  • 🟥 execution_time [+304.712ms; +307.158ms] or [+154.530%; +155.771%]
  • ignore throughput [+1363.235op/s; +3279.694op/s] or [+0.768%; +1.847%]

scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • 🟥 execution_time [+300.133ms; +300.800ms] or [+149.708%; +150.040%]
  • 🟩 throughput [+60979485.161op/s; +61236080.180op/s] or [+44.409%; +44.596%]

scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore net6.0

  • ignore allocated_mem [+79 bytes; +81 bytes] or [+0.463%; +0.473%]
  • unstable execution_time [+378.104ms; +415.223ms] or [+470.240%; +516.404%]
  • 🟩 throughput [+914.960op/s; +1088.502op/s] or [+7.073%; +8.415%]

scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [+nan%; +nan%]
  • 🟥 execution_time [+299.830ms; +300.730ms] or [+149.548%; +149.997%]
  • ignore throughput [+1563367.391op/s; +2501396.435op/s] or [+0.692%; +1.108%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.006%]
  • ignore execution_time [-140.335µs; +415.894µs] or [-0.070%; +0.208%]
  • ignore throughput [-5099.053op/s; -1533.506op/s] or [-0.569%; -0.171%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.007%]
  • ignore execution_time [-4.817ms; -3.644ms] or [-2.359%; -1.785%]
  • 🟩 throughput [+83490.364op/s; +91560.057op/s] or [+7.795%; +8.549%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.003%; +0.006%]
  • ignore execution_time [+2.858ms; +6.995ms] or [+1.446%; +3.539%]
  • 🟩 throughput [+51871.207op/s; +71114.700op/s] or [+6.004%; +8.231%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishSpan net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.000%; +0.009%]
  • ignore execution_time [+657.600µs; +1224.411µs] or [+0.329%; +0.612%]
  • ignore throughput [-9019.543op/s; -5100.355op/s] or [-0.826%; -0.467%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishSpan net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.004%]
  • ignore execution_time [+6.322ms; +11.149ms] or [+3.294%; +5.809%]
  • ignore throughput [+51540.008op/s; +86167.176op/s] or [+3.989%; +6.669%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishSpan netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.001%; +0.008%]
  • ignore execution_time [-3.175ms; -1.752ms] or [-1.560%; -0.861%]
  • 🟩 throughput [+87451.395op/s; +95914.854op/s] or [+8.685%; +9.526%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.008%; +0.002%]
  • ignore execution_time [-1444.295µs; -143.152µs] or [-0.719%; -0.071%]
  • ignore throughput [+9175.090op/s; +12185.921op/s] or [+2.044%; +2.715%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.004%; +0.009%]
  • ignore execution_time [+0.269ms; +2.074ms] or [+0.134%; +1.036%]
  • 🟩 throughput [+56424.517op/s; +61717.669op/s] or [+10.246%; +11.207%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.006%; +0.004%]
  • ignore execution_time [+0.285ms; +4.429ms] or [+0.143%; +2.225%]
  • ignore throughput [+20969.902op/s; +30562.382op/s] or [+4.694%; +6.841%]

scenario:Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin net472

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.006%]
  • ignore execution_time [-1167.243µs; -143.470µs] or [-0.582%; -0.072%]
  • ignore throughput [-41330.268op/s; -30513.372op/s] or [-6.049%; -4.466%]

scenario:Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin net6.0

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.007%]
  • ignore execution_time [-1183.614µs; +2325.487µs] or [-0.592%; +1.163%]
  • 🟩 throughput [+46764.368op/s; +65312.180op/s] or [+5.225%; +7.297%]

scenario:Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin netcoreapp3.1

  • ignore allocated_mem [+0 bytes; +0 bytes] or [-0.005%; +0.005%]
  • ignore execution_time [+1.634ms; +5.549ms] or [+0.830%; +2.818%]
  • ignore throughput [+19293.857op/s; +34246.383op/s] or [+2.694%; +4.782%]

Copy link
Copy Markdown
Collaborator

@bouwkast bouwkast left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:builds project files, build scripts, pipelines, versioning, releases, packages

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants