Skip to content

Integrate parallel macrobenchmarks from apm-sdks-benchmarks#11129

Open
faydef wants to merge 3 commits intomasterfrom
fayssal/integrate-apm-sdks-benchmarks
Open

Integrate parallel macrobenchmarks from apm-sdks-benchmarks#11129
faydef wants to merge 3 commits intomasterfrom
fayssal/integrate-apm-sdks-benchmarks

Conversation

@faydef
Copy link
Copy Markdown
Contributor

@faydef faydef commented Apr 16, 2026 •
edited
Loading

What Does This Do

Integrates new parallel macrobenchmarks from the DataDog/apm-reliability/apm-sdks-benchmarks repository into the GitLab CI pipeline via include: project:. Both old and new benchmark stages run together during a transition period before switching over completely.

Motivation

The apm-sdks-benchmarks repository will be the single source for all macrobenchmark configurations across APM SDKs. This integration enables centralized benchmark management while maintaining stability during the migration.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 16, 2026 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master fayssal/integrate-apm-sdks-benchmarks
git_commit_date 1776158168 1776416011
git_commit_sha da8bdd2 f12d511
release_version 1.62.0-SNAPSHOT~da8bdd22c1 1.62.0-SNAPSHOT~f12d5117c9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776417783 1776417783
ci_job_id 1604633752 1604633752
ci_pipeline_id 108184084 108184084
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-35z41ulj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-35z41ulj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~f12d5117c9, baseline=1.62.0-SNAPSHOT~da8bdd22c1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1063278
Total [baseline] (8.825 s) : 0, 8824591
Agent [candidate] (1.058 s) : 0, 1057513
Total [candidate] (8.842 s) : 0, 8842397
section iast
Agent [baseline] (1.238 s) : 0, 1237870
Total [baseline] (9.57 s) : 0, 9570473
Agent [candidate] (1.225 s) : 0, 1225126
Total [candidate] (9.574 s) : 0, 9574414
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent iast 1.238 s 174.592 ms (16.4%)
Total tracing 8.825 s -
Total iast 9.57 s 745.882 ms (8.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent iast 1.225 s 167.614 ms (15.8%)
Total tracing 8.842 s -
Total iast 9.574 s 732.017 ms (8.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~f12d5117c9, baseline=1.62.0-SNAPSHOT~da8bdd22c1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.235 ms) : 0, 1235
crashtracking [candidate] (1.219 ms) : 0, 1219
BytebuddyAgent [baseline] (637.218 ms) : 0, 637218
BytebuddyAgent [candidate] (633.418 ms) : 0, 633418
AgentMeter [baseline] (29.59 ms) : 0, 29590
AgentMeter [candidate] (29.398 ms) : 0, 29398
GlobalTracer [baseline] (249.79 ms) : 0, 249790
GlobalTracer [candidate] (248.983 ms) : 0, 248983
AppSec [baseline] (32.659 ms) : 0, 32659
AppSec [candidate] (32.463 ms) : 0, 32463
Debugger [baseline] (59.591 ms) : 0, 59591
Debugger [candidate] (59.024 ms) : 0, 59024
Remote Config [baseline] (597.207 µs) : 0, 597
Remote Config [candidate] (585.628 µs) : 0, 586
Telemetry [baseline] (8.068 ms) : 0, 8068
Telemetry [candidate] (8.044 ms) : 0, 8044
Flare Poller [baseline] (8.218 ms) : 0, 8218
Flare Poller [candidate] (8.247 ms) : 0, 8247
section iast
crashtracking [baseline] (1.244 ms) : 0, 1244
crashtracking [candidate] (1.234 ms) : 0, 1234
BytebuddyAgent [baseline] (811.976 ms) : 0, 811976
BytebuddyAgent [candidate] (800.914 ms) : 0, 800914
AgentMeter [baseline] (11.853 ms) : 0, 11853
AgentMeter [candidate] (11.393 ms) : 0, 11393
GlobalTracer [baseline] (240.892 ms) : 0, 240892
GlobalTracer [candidate] (239.967 ms) : 0, 239967
IAST [baseline] (25.803 ms) : 0, 25803
IAST [candidate] (26.678 ms) : 0, 26678
AppSec [baseline] (32.429 ms) : 0, 32429
AppSec [candidate] (30.791 ms) : 0, 30791
Debugger [baseline] (60.922 ms) : 0, 60922
Debugger [candidate] (61.537 ms) : 0, 61537
Remote Config [baseline] (1.146 ms) : 0, 1146
Remote Config [candidate] (548.687 µs) : 0, 549
Telemetry [baseline] (11.868 ms) : 0, 11868
Telemetry [candidate] (12.247 ms) : 0, 12247
Flare Poller [baseline] (3.491 ms) : 0, 3491
Flare Poller [candidate] (3.474 ms) : 0, 3474
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~f12d5117c9, baseline=1.62.0-SNAPSHOT~da8bdd22c1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058040
Total [baseline] (10.963 s) : 0, 10962923
Agent [candidate] (1.072 s) : 0, 1072165
Total [candidate] (11.162 s) : 0, 11162024
section appsec
Agent [baseline] (1.261 s) : 0, 1261097
Total [baseline] (11.158 s) : 0, 11157847
Agent [candidate] (1.247 s) : 0, 1247361
Total [candidate] (11.141 s) : 0, 11141128
section iast
Agent [baseline] (1.233 s) : 0, 1232519
Total [baseline] (11.293 s) : 0, 11292508
Agent [candidate] (1.23 s) : 0, 1229778
Total [candidate] (11.285 s) : 0, 11285494
section profiling
Agent [baseline] (1.191 s) : 0, 1191081
Total [baseline] (11.051 s) : 0, 11050716
Agent [candidate] (1.183 s) : 0, 1182579
Total [candidate] (11.062 s) : 0, 11061832
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.261 s 203.057 ms (19.2%)
Agent iast 1.233 s 174.479 ms (16.5%)
Agent profiling 1.191 s 133.04 ms (12.6%)
Total tracing 10.963 s -
Total appsec 11.158 s 194.925 ms (1.8%)
Total iast 11.293 s 329.585 ms (3.0%)
Total profiling 11.051 s 87.793 ms (0.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent appsec 1.247 s 175.196 ms (16.3%)
Agent iast 1.23 s 157.614 ms (14.7%)
Agent profiling 1.183 s 110.414 ms (10.3%)
Total tracing 11.162 s -
Total appsec 11.141 s -20.896 ms (-0.2%)
Total iast 11.285 s 123.47 ms (1.1%)
Total profiling 11.062 s -100.192 ms (-0.9%) 
gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~f12d5117c9, baseline=1.62.0-SNAPSHOT~da8bdd22c1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.229 ms) : 0, 1229
crashtracking [candidate] (1.237 ms) : 0, 1237
BytebuddyAgent [baseline] (632.855 ms) : 0, 632855
BytebuddyAgent [candidate] (641.036 ms) : 0, 641036
AgentMeter [baseline] (29.424 ms) : 0, 29424
AgentMeter [candidate] (29.935 ms) : 0, 29935
GlobalTracer [baseline] (248.827 ms) : 0, 248827
GlobalTracer [candidate] (251.444 ms) : 0, 251444
AppSec [baseline] (32.474 ms) : 0, 32474
AppSec [candidate] (33.025 ms) : 0, 33025
Debugger [baseline] (60.095 ms) : 0, 60095
Debugger [candidate] (61.056 ms) : 0, 61056
Remote Config [baseline] (606.283 µs) : 0, 606
Remote Config [candidate] (602.526 µs) : 0, 603
Telemetry [baseline] (8.043 ms) : 0, 8043
Telemetry [candidate] (8.222 ms) : 0, 8222
Flare Poller [baseline] (8.296 ms) : 0, 8296
Flare Poller [candidate] (9.131 ms) : 0, 9131
section appsec
crashtracking [baseline] (1.22 ms) : 0, 1220
crashtracking [candidate] (1.236 ms) : 0, 1236
BytebuddyAgent [baseline] (669.334 ms) : 0, 669334
BytebuddyAgent [candidate] (660.332 ms) : 0, 660332
AgentMeter [baseline] (12.2 ms) : 0, 12200
AgentMeter [candidate] (12.072 ms) : 0, 12072
GlobalTracer [baseline] (251.509 ms) : 0, 251509
GlobalTracer [candidate] (248.815 ms) : 0, 248815
IAST [baseline] (24.853 ms) : 0, 24853
IAST [candidate] (24.516 ms) : 0, 24516
AppSec [baseline] (186.244 ms) : 0, 186244
AppSec [candidate] (185.184 ms) : 0, 185184
Debugger [baseline] (66.584 ms) : 0, 66584
Debugger [candidate] (66.185 ms) : 0, 66185
Remote Config [baseline] (609.442 µs) : 0, 609
Remote Config [candidate] (625.106 µs) : 0, 625
Telemetry [baseline] (8.512 ms) : 0, 8512
Telemetry [candidate] (8.463 ms) : 0, 8463
Flare Poller [baseline] (3.618 ms) : 0, 3618
Flare Poller [candidate] (3.542 ms) : 0, 3542
section iast
crashtracking [baseline] (1.224 ms) : 0, 1224
crashtracking [candidate] (1.24 ms) : 0, 1240
BytebuddyAgent [baseline] (807.056 ms) : 0, 807056
BytebuddyAgent [candidate] (806.383 ms) : 0, 806383
AgentMeter [baseline] (11.374 ms) : 0, 11374
AgentMeter [candidate] (11.461 ms) : 0, 11461
GlobalTracer [baseline] (239.357 ms) : 0, 239357
GlobalTracer [candidate] (239.726 ms) : 0, 239726
IAST [baseline] (25.96 ms) : 0, 25960
IAST [candidate] (25.715 ms) : 0, 25715
AppSec [baseline] (29.263 ms) : 0, 29263
AppSec [candidate] (31.926 ms) : 0, 31926
Debugger [baseline] (64.858 ms) : 0, 64858
Debugger [candidate] (61.973 ms) : 0, 61973
Remote Config [baseline] (1.154 ms) : 0, 1154
Remote Config [candidate] (1.164 ms) : 0, 1164
Telemetry [baseline] (12.292 ms) : 0, 12292
Telemetry [candidate] (10.368 ms) : 0, 10368
Flare Poller [baseline] (3.468 ms) : 0, 3468
Flare Poller [candidate] (3.427 ms) : 0, 3427
section profiling
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (696.849 ms) : 0, 696849
BytebuddyAgent [candidate] (689.753 ms) : 0, 689753
AgentMeter [baseline] (9.1 ms) : 0, 9100
AgentMeter [candidate] (9.06 ms) : 0, 9060
GlobalTracer [baseline] (207.59 ms) : 0, 207590
GlobalTracer [candidate] (207.079 ms) : 0, 207079
AppSec [baseline] (32.869 ms) : 0, 32869
AppSec [candidate] (32.795 ms) : 0, 32795
Debugger [baseline] (65.886 ms) : 0, 65886
Debugger [candidate] (65.635 ms) : 0, 65635
Remote Config [baseline] (575.288 µs) : 0, 575
Remote Config [candidate] (570.902 µs) : 0, 571
Telemetry [baseline] (7.882 ms) : 0, 7882
Telemetry [candidate] (7.752 ms) : 0, 7752
Flare Poller [baseline] (3.569 ms) : 0, 3569
Flare Poller [candidate] (3.529 ms) : 0, 3529
ProfilingAgent [baseline] (93.812 ms) : 0, 93812
ProfilingAgent [candidate] (94.002 ms) : 0, 94002
Profiling [baseline] (94.403 ms) : 0, 94403
Profiling [candidate] (94.575 ms) : 0, 94575
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master fayssal/integrate-apm-sdks-benchmarks
git_commit_date 1776158168 1776416011
git_commit_sha da8bdd2 f12d511
release_version 1.62.0-SNAPSHOT~da8bdd22c1 1.62.0-SNAPSHOT~f12d5117c9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776418261 1776418261
ci_job_id 1604633754 1604633754
ci_pipeline_id 108184084 108184084
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-ich7uilf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-ich7uilf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 4 performance regressions! Performance is the same for 17 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+55.128µs; +179.898µs] or [+2.092%; +6.828%]		 unsure
[+79.897µs; +505.918µs] or [+1.048%; +6.634%]		 unstable
[-195.882op/s; +80.945op/s] or [-14.417%; +5.957%]		 2.752ms 7.920ms 1301.250op/s 2.635ms 7.627ms 1358.719op/s
scenario:load:petclinic:profiling:high_load worse
[+1.916ms; +2.346ms] or [+10.696%; +13.092%]		 worse
[+1.826ms; +3.025ms] or [+6.231%; +10.323%]		 unstable
[-52.584op/s; -0.791op/s] or [-20.533%; -0.309%]		 20.047ms 31.728ms 229.406op/s 17.916ms 29.302ms 256.094op/s
scenario:load:petclinic:appsec:high_load worse
[+0.772ms; +1.599ms] or [+4.210%; +8.721%]		 unsure
[+0.461ms; +1.864ms] or [+1.544%; +6.248%]		 unstable
[-39.532op/s; +13.157op/s] or [-15.823%; +5.266%]		 19.526ms 31.006ms 236.656op/s 18.340ms 29.843ms 249.844op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~f12d5117c9, baseline=1.62.0-SNAPSHOT~da8bdd22c1
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.117 ms) : 18922, 19311
.   : milestone, 19117,
appsec (18.681 ms) : 18492, 18869
.   : milestone, 18681,
code_origins (18.097 ms) : 17919, 18275
.   : milestone, 18097,
iast (18.157 ms) : 17976, 18338
.   : milestone, 18157,
profiling (18.22 ms) : 18039, 18401
.   : milestone, 18220,
tracing (17.791 ms) : 17614, 17968
.   : milestone, 17791,
section candidate
no_agent (19.351 ms) : 19154, 19549
.   : milestone, 19351,
appsec (19.722 ms) : 19519, 19926
.   : milestone, 19722,
code_origins (17.903 ms) : 17725, 18082
.   : milestone, 17903,
iast (17.907 ms) : 17730, 18084
.   : milestone, 17907,
profiling (20.35 ms) : 20149, 20552
.   : milestone, 20350,
tracing (18.216 ms) : 18039, 18393
.   : milestone, 18216,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.117 ms [18.922 ms, 19.311 ms] -
appsec 18.681 ms [18.492 ms, 18.869 ms] -435.838 µs (-2.3%)
code_origins 18.097 ms [17.919 ms, 18.275 ms] -1.02 ms (-5.3%)
iast 18.157 ms [17.976 ms, 18.338 ms] -959.555 µs (-5.0%)
profiling 18.22 ms [18.039 ms, 18.401 ms] -896.918 µs (-4.7%)
tracing 17.791 ms [17.614 ms, 17.968 ms] -1.326 ms (-6.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.351 ms [19.154 ms, 19.549 ms] -
appsec 19.722 ms [19.519 ms, 19.926 ms] 370.949 µs (1.9%)
code_origins 17.903 ms [17.725 ms, 18.082 ms] -1.448 ms (-7.5%)
iast 17.907 ms [17.73 ms, 18.084 ms] -1.444 ms (-7.5%)
profiling 20.35 ms [20.149 ms, 20.552 ms] 999.016 µs (5.2%)
tracing 18.216 ms [18.039 ms, 18.393 ms] -1.135 ms (-5.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~f12d5117c9, baseline=1.62.0-SNAPSHOT~da8bdd22c1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.233 ms) : 1221, 1244
.   : milestone, 1233,
iast (3.369 ms) : 3323, 3416
.   : milestone, 3369,
iast_FULL (6.095 ms) : 6033, 6157
.   : milestone, 6095,
iast_GLOBAL (3.727 ms) : 3664, 3790
.   : milestone, 3727,
profiling (2.21 ms) : 2188, 2232
.   : milestone, 2210,
tracing (1.979 ms) : 1962, 1996
.   : milestone, 1979,
section candidate
no_agent (1.238 ms) : 1227, 1250
.   : milestone, 1238,
iast (3.521 ms) : 3468, 3575
.   : milestone, 3521,
iast_FULL (6.192 ms) : 6128, 6257
.   : milestone, 6192,
iast_GLOBAL (3.748 ms) : 3684, 3811
.   : milestone, 3748,
profiling (2.17 ms) : 2150, 2190
.   : milestone, 2170,
tracing (1.894 ms) : 1878, 1910
.   : milestone, 1894,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.233 ms [1.221 ms, 1.244 ms] -
iast 3.369 ms [3.323 ms, 3.416 ms] 2.137 ms (173.4%)
iast_FULL 6.095 ms [6.033 ms, 6.157 ms] 4.863 ms (394.5%)
iast_GLOBAL 3.727 ms [3.664 ms, 3.79 ms] 2.494 ms (202.4%)
profiling 2.21 ms [2.188 ms, 2.232 ms] 977.27 µs (79.3%)
tracing 1.979 ms [1.962 ms, 1.996 ms] 746.14 µs (60.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.238 ms [1.227 ms, 1.25 ms] -
iast 3.521 ms [3.468 ms, 3.575 ms] 2.283 ms (184.4%)
iast_FULL 6.192 ms [6.128 ms, 6.257 ms] 4.954 ms (400.1%)
iast_GLOBAL 3.748 ms [3.684 ms, 3.811 ms] 2.51 ms (202.7%)
profiling 2.17 ms [2.15 ms, 2.19 ms] 931.894 µs (75.3%)
tracing 1.894 ms [1.878 ms, 1.91 ms] 655.814 µs (53.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master fayssal/integrate-apm-sdks-benchmarks
git_commit_date 1776158168 1776416011
git_commit_sha da8bdd2 f12d511
release_version 1.62.0-SNAPSHOT~da8bdd22c1 1.62.0-SNAPSHOT~f12d5117c9
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1776418006 1776418006
ci_job_id 1604633755 1604633755
ci_pipeline_id 108184084 108184084
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-bmsxc92s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-bmsxc92s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~f12d5117c9, baseline=1.62.0-SNAPSHOT~da8bdd22c1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.492 ms) : 1481, 1504
.   : milestone, 1492,
appsec (2.536 ms) : 2482, 2591
.   : milestone, 2536,
iast (2.277 ms) : 2208, 2346
.   : milestone, 2277,
iast_GLOBAL (2.324 ms) : 2255, 2394
.   : milestone, 2324,
profiling (2.115 ms) : 2060, 2170
.   : milestone, 2115,
tracing (2.093 ms) : 2039, 2146
.   : milestone, 2093,
section candidate
no_agent (1.492 ms) : 1480, 1503
.   : milestone, 1492,
appsec (3.832 ms) : 3609, 4055
.   : milestone, 3832,
iast (2.288 ms) : 2219, 2357
.   : milestone, 2288,
iast_GLOBAL (2.333 ms) : 2264, 2403
.   : milestone, 2333,
profiling (2.11 ms) : 2055, 2165
.   : milestone, 2110,
tracing (2.085 ms) : 2032, 2138
.   : milestone, 2085,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.492 ms [1.481 ms, 1.504 ms] -
appsec 2.536 ms [2.482 ms, 2.591 ms] 1.044 ms (70.0%)
iast 2.277 ms [2.208 ms, 2.346 ms] 784.456 µs (52.6%)
iast_GLOBAL 2.324 ms [2.255 ms, 2.394 ms] 832.173 µs (55.8%)
profiling 2.115 ms [2.06 ms, 2.17 ms] 622.682 µs (41.7%)
tracing 2.093 ms [2.039 ms, 2.146 ms] 600.262 µs (40.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.492 ms [1.48 ms, 1.503 ms] -
appsec 3.832 ms [3.609 ms, 4.055 ms] 2.34 ms (156.9%)
iast 2.288 ms [2.219 ms, 2.357 ms] 796.565 µs (53.4%)
iast_GLOBAL 2.333 ms [2.264 ms, 2.403 ms] 841.698 µs (56.4%)
profiling 2.11 ms [2.055 ms, 2.165 ms] 618.221 µs (41.4%)
tracing 2.085 ms [2.032 ms, 2.138 ms] 593.414 µs (39.8%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~f12d5117c9, baseline=1.62.0-SNAPSHOT~da8bdd22c1
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.734 s) : 14734000, 14734000
.   : milestone, 14734000,
appsec (14.964 s) : 14964000, 14964000
.   : milestone, 14964000,
iast (18.53 s) : 18530000, 18530000
.   : milestone, 18530000,
iast_GLOBAL (18.038 s) : 18038000, 18038000
.   : milestone, 18038000,
profiling (15.053 s) : 15053000, 15053000
.   : milestone, 15053000,
tracing (15.026 s) : 15026000, 15026000
.   : milestone, 15026000,
section candidate
no_agent (15.534 s) : 15534000, 15534000
.   : milestone, 15534000,
appsec (14.757 s) : 14757000, 14757000
.   : milestone, 14757000,
iast (18.48 s) : 18480000, 18480000
.   : milestone, 18480000,
iast_GLOBAL (18.073 s) : 18073000, 18073000
.   : milestone, 18073000,
profiling (14.976 s) : 14976000, 14976000
.   : milestone, 14976000,
tracing (15.182 s) : 15182000, 15182000
.   : milestone, 15182000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.734 s [14.734 s, 14.734 s] -
appsec 14.964 s [14.964 s, 14.964 s] 230.0 ms (1.6%)
iast 18.53 s [18.53 s, 18.53 s] 3.796 s (25.8%)
iast_GLOBAL 18.038 s [18.038 s, 18.038 s] 3.304 s (22.4%)
profiling 15.053 s [15.053 s, 15.053 s] 319.0 ms (2.2%)
tracing 15.026 s [15.026 s, 15.026 s] 292.0 ms (2.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.534 s [15.534 s, 15.534 s] -
appsec 14.757 s [14.757 s, 14.757 s] -777.0 ms (-5.0%)
iast 18.48 s [18.48 s, 18.48 s] 2.946 s (19.0%)
iast_GLOBAL 18.073 s [18.073 s, 18.073 s] 2.539 s (16.3%)
profiling 14.976 s [14.976 s, 14.976 s] -558.0 ms (-3.6%)
tracing 15.182 s [15.182 s, 15.182 s] -352.0 ms (-2.3%)

@faydef faydef added the tag: no release notes Changes to exclude from release notes label Apr 17, 2026
@faydef faydef changed the title integrate a new set of benchmarks Integrate parallel macrobenchmarks from apm-sdks-benchmarks Apr 17, 2026
@faydef faydef marked this pull request as ready for review April 17, 2026 12:43
@faydef faydef requested a review from a team as a code owner April 17, 2026 12:43
@faydef faydef requested review from colin-higgins and removed request for a team April 17, 2026 12:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@colin-higgins colin-higgins Awaiting requested review from colin-higgins colin-higgins is a code owner automatically assigned from DataDog/apm-release-platform

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@faydef