Skip to content

Update smoke test latest tool versions#11159

Closed
dd-octo-sts[bot] wants to merge 1 commit intomasterfrom
ci/update-smoke-test-latest-versions-20260419
Closed

Update smoke test latest tool versions#11159
dd-octo-sts[bot] wants to merge 1 commit intomasterfrom
ci/update-smoke-test-latest-versions-20260419

Conversation

@dd-octo-sts
Copy link
Copy Markdown
Contributor

@dd-octo-sts dd-octo-sts bot commented Apr 19, 2026

What Does This Do

This PR updates the pinned "latest" tool versions used by CI Visibility smoke tests:

  • Gradle: 9.4.1
  • Maven: 3.9.15
  • Maven Surefire: 3.5.5

Motivation

Keep smoke tests running against the latest stable versions of build tools.

Contributor Checklist

  • Verify smoke tests pass with the new versions

@dd-octo-sts @github-actions
chore: Update smoke test latest tool versions
7f95433 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@dd-octo-sts dd-octo-sts bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Apr 19, 2026
@dd-octo-sts dd-octo-sts bot requested a review from a team as a code owner April 19, 2026 05:45
@dd-octo-sts dd-octo-sts bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Apr 19, 2026
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 19, 2026

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-smoke-test-latest-versions-20260419
git_commit_date 1776578167 1776577531
git_commit_sha eef6a08d6d 7f95433
release_version 1.62.0-SNAPSHOT~7eef6a08d6d 1.62.0-SNAPSHOT~7f95433f5f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776579460 1776579460
ci_job_id 1608559129 1608559129
ci_pipeline_id 108406478 108406478
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-2jk1tlvl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-2jk1tlvl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~7f95433f5f, baseline=1.62.0-SNAPSHOT~7eef6a08d6d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.073 s) : 0, 1072973
Total [baseline] (11.128 s) : 0, 11128362
Agent [candidate] (1.068 s) : 0, 1068348
Total [candidate] (11.088 s) : 0, 11088278
section appsec
Agent [baseline] (1.248 s) : 0, 1247804
Total [baseline] (11.07 s) : 0, 11069996
Agent [candidate] (1.245 s) : 0, 1244675
Total [candidate] (11.161 s) : 0, 11160855
section iast
Agent [baseline] (1.232 s) : 0, 1231600
Total [baseline] (11.339 s) : 0, 11339182
Agent [candidate] (1.229 s) : 0, 1228608
Total [candidate] (11.393 s) : 0, 11393217
section profiling
Agent [baseline] (1.185 s) : 0, 1184648
Total [baseline] (10.978 s) : 0, 10978410
Agent [candidate] (1.184 s) : 0, 1183588
Total [candidate] (10.986 s) : 0, 10986481
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.073 s -
Agent appsec 1.248 s 174.831 ms (16.3%)
Agent iast 1.232 s 158.626 ms (14.8%)
Agent profiling 1.185 s 111.675 ms (10.4%)
Total tracing 11.128 s -
Total appsec 11.07 s -58.366 ms (-0.5%)
Total iast 11.339 s 210.82 ms (1.9%)
Total profiling 10.978 s -149.951 ms (-1.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent appsec 1.245 s 176.327 ms (16.5%)
Agent iast 1.229 s 160.26 ms (15.0%)
Agent profiling 1.184 s 115.239 ms (10.8%)
Total tracing 11.088 s -
Total appsec 11.161 s 72.577 ms (0.7%)
Total iast 11.393 s 304.939 ms (2.8%)
Total profiling 10.986 s -101.797 ms (-0.9%) 
gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~7f95433f5f, baseline=1.62.0-SNAPSHOT~7eef6a08d6d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.257 ms) : 0, 1257
crashtracking [candidate] (1.234 ms) : 0, 1234
BytebuddyAgent [baseline] (643.527 ms) : 0, 643527
BytebuddyAgent [candidate] (640.472 ms) : 0, 640472
AgentMeter [baseline] (30.065 ms) : 0, 30065
AgentMeter [candidate] (29.936 ms) : 0, 29936
GlobalTracer [baseline] (250.871 ms) : 0, 250871
GlobalTracer [candidate] (251.646 ms) : 0, 251646
AppSec [baseline] (32.886 ms) : 0, 32886
AppSec [candidate] (32.767 ms) : 0, 32767
Debugger [baseline] (60.702 ms) : 0, 60702
Debugger [candidate] (60.545 ms) : 0, 60545
Remote Config [baseline] (594.103 µs) : 0, 594
Remote Config [candidate] (596.944 µs) : 0, 597
Telemetry [baseline] (8.241 ms) : 0, 8241
Telemetry [candidate] (8.133 ms) : 0, 8133
Flare Poller [baseline] (8.42 ms) : 0, 8420
Flare Poller [candidate] (6.775 ms) : 0, 6775
section appsec
crashtracking [baseline] (1.255 ms) : 0, 1255
crashtracking [candidate] (1.23 ms) : 0, 1230
BytebuddyAgent [baseline] (661.874 ms) : 0, 661874
BytebuddyAgent [candidate] (659.681 ms) : 0, 659681
AgentMeter [baseline] (12.184 ms) : 0, 12184
AgentMeter [candidate] (12.295 ms) : 0, 12295
GlobalTracer [baseline] (248.285 ms) : 0, 248285
GlobalTracer [candidate] (247.993 ms) : 0, 247993
IAST [baseline] (24.418 ms) : 0, 24418
IAST [candidate] (24.382 ms) : 0, 24382
AppSec [baseline] (184.97 ms) : 0, 184970
AppSec [candidate] (184.664 ms) : 0, 184664
Debugger [baseline] (66.062 ms) : 0, 66062
Debugger [candidate] (65.616 ms) : 0, 65616
Remote Config [baseline] (615.303 µs) : 0, 615
Remote Config [candidate] (605.474 µs) : 0, 605
Telemetry [baseline] (8.279 ms) : 0, 8279
Telemetry [candidate] (8.348 ms) : 0, 8348
Flare Poller [baseline] (3.464 ms) : 0, 3464
Flare Poller [candidate] (3.532 ms) : 0, 3532
section iast
crashtracking [baseline] (1.221 ms) : 0, 1221
crashtracking [candidate] (1.23 ms) : 0, 1230
BytebuddyAgent [baseline] (805.836 ms) : 0, 805836
BytebuddyAgent [candidate] (805.87 ms) : 0, 805870
AgentMeter [baseline] (11.691 ms) : 0, 11691
AgentMeter [candidate] (11.589 ms) : 0, 11589
GlobalTracer [baseline] (240.192 ms) : 0, 240192
GlobalTracer [candidate] (238.754 ms) : 0, 238754
IAST [baseline] (25.921 ms) : 0, 25921
IAST [candidate] (25.701 ms) : 0, 25701
AppSec [baseline] (31.416 ms) : 0, 31416
AppSec [candidate] (30.998 ms) : 0, 30998
Debugger [baseline] (65.508 ms) : 0, 65508
Debugger [candidate] (64.799 ms) : 0, 64799
Remote Config [baseline] (534.647 µs) : 0, 535
Remote Config [candidate] (529.237 µs) : 0, 529
Telemetry [baseline] (9.378 ms) : 0, 9378
Telemetry [candidate] (9.36 ms) : 0, 9360
Flare Poller [baseline] (3.604 ms) : 0, 3604
Flare Poller [candidate] (3.699 ms) : 0, 3699
section profiling
crashtracking [baseline] (1.177 ms) : 0, 1177
crashtracking [candidate] (1.17 ms) : 0, 1170
BytebuddyAgent [baseline] (692.156 ms) : 0, 692156
BytebuddyAgent [candidate] (690.234 ms) : 0, 690234
AgentMeter [baseline] (9.174 ms) : 0, 9174
AgentMeter [candidate] (9.126 ms) : 0, 9126
GlobalTracer [baseline] (206.596 ms) : 0, 206596
GlobalTracer [candidate] (206.671 ms) : 0, 206671
AppSec [baseline] (32.638 ms) : 0, 32638
AppSec [candidate] (33.041 ms) : 0, 33041
Debugger [baseline] (65.589 ms) : 0, 65589
Debugger [candidate] (65.861 ms) : 0, 65861
Remote Config [baseline] (586.025 µs) : 0, 586
Remote Config [candidate] (572.64 µs) : 0, 573
Telemetry [baseline] (7.772 ms) : 0, 7772
Telemetry [candidate] (7.837 ms) : 0, 7837
Flare Poller [baseline] (3.527 ms) : 0, 3527
Flare Poller [candidate] (3.581 ms) : 0, 3581
ProfilingAgent [baseline] (93.918 ms) : 0, 93918
ProfilingAgent [candidate] (94.332 ms) : 0, 94332
Profiling [baseline] (94.487 ms) : 0, 94487
Profiling [candidate] (94.902 ms) : 0, 94902
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~7f95433f5f, baseline=1.62.0-SNAPSHOT~7eef6a08d6d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1067863
Total [baseline] (8.86 s) : 0, 8860208
Agent [candidate] (1.07 s) : 0, 1070446
Total [candidate] (8.869 s) : 0, 8868540
section iast
Agent [baseline] (1.224 s) : 0, 1223917
Total [baseline] (9.546 s) : 0, 9546279
Agent [candidate] (1.224 s) : 0, 1224112
Total [candidate] (9.549 s) : 0, 9548712
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.224 s 156.054 ms (14.6%)
Total tracing 8.86 s -
Total iast 9.546 s 686.07 ms (7.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent iast 1.224 s 153.666 ms (14.4%)
Total tracing 8.869 s -
Total iast 9.549 s 680.172 ms (7.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~7f95433f5f, baseline=1.62.0-SNAPSHOT~7eef6a08d6d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.261 ms) : 0, 1261
crashtracking [candidate] (1.241 ms) : 0, 1241
BytebuddyAgent [baseline] (639.519 ms) : 0, 639519
BytebuddyAgent [candidate] (641.247 ms) : 0, 641247
AgentMeter [baseline] (29.691 ms) : 0, 29691
AgentMeter [candidate] (29.987 ms) : 0, 29987
GlobalTracer [baseline] (250.701 ms) : 0, 250701
GlobalTracer [candidate] (251.938 ms) : 0, 251938
AppSec [baseline] (32.94 ms) : 0, 32940
AppSec [candidate] (32.66 ms) : 0, 32660
Debugger [baseline] (59.995 ms) : 0, 59995
Debugger [candidate] (59.2 ms) : 0, 59200
Remote Config [baseline] (622.554 µs) : 0, 623
Remote Config [candidate] (594.649 µs) : 0, 595
Telemetry [baseline] (8.231 ms) : 0, 8231
Telemetry [candidate] (8.087 ms) : 0, 8087
Flare Poller [baseline] (8.342 ms) : 0, 8342
Flare Poller [candidate] (9.049 ms) : 0, 9049
section iast
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.232 ms) : 0, 1232
BytebuddyAgent [baseline] (801.288 ms) : 0, 801288
BytebuddyAgent [candidate] (801.258 ms) : 0, 801258
AgentMeter [baseline] (11.597 ms) : 0, 11597
AgentMeter [candidate] (11.563 ms) : 0, 11563
GlobalTracer [baseline] (238.697 ms) : 0, 238697
GlobalTracer [candidate] (239.111 ms) : 0, 239111
AppSec [baseline] (32.211 ms) : 0, 32211
AppSec [candidate] (33.67 ms) : 0, 33670
Debugger [baseline] (63.388 ms) : 0, 63388
Debugger [candidate] (62.05 ms) : 0, 62050
Remote Config [baseline] (533.529 µs) : 0, 534
Remote Config [candidate] (528.213 µs) : 0, 528
Telemetry [baseline] (9.295 ms) : 0, 9295
Telemetry [candidate] (9.217 ms) : 0, 9217
Flare Poller [baseline] (3.581 ms) : 0, 3581
Flare Poller [candidate] (3.606 ms) : 0, 3606
IAST [baseline] (25.902 ms) : 0, 25902
IAST [candidate] (25.797 ms) : 0, 25797
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-smoke-test-latest-versions-20260419
git_commit_date 1776578161 1776577531
git_commit_sha eef6a08d6d 7f95433
release_version 1.62.0-SNAPSHOT~7eef6a08d6d 1.62.0-SNAPSHOT~7f95433f5f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776579927 1776579927
ci_job_id 1608559131 1608559131
ci_pipeline_id 108406478 108406478
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-ecc48y9c 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-ecc48y9c 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 18 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-211.802µs; -81.589µs] or [-7.142%; -2.751%]		 same
[-451.436µs; +12.452µs] or [-5.522%; +0.152%]		 unstable
[-77.902op/s; +160.402op/s] or [-6.274%; +12.918%]		 2.819ms 7.955ms 1282.969op/s 2.966ms 8.175ms 1241.719op/s
scenario:load:petclinic:profiling:high_load worse
[+1.128ms; +1.821ms] or [+6.370%; +10.280%]		 worse
[+1.828ms; +3.318ms] or [+6.384%; +11.585%]		 unstable
[-42.537op/s; +5.599op/s] or [-16.483%; +2.170%]		 19.189ms 31.210ms 239.594op/s 17.714ms 28.637ms 258.062op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~7f95433f5f, baseline=1.62.0-SNAPSHOT~7eef6a08d6d
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.439 ms) : 19240, 19638
.   : milestone, 19439,
appsec (18.713 ms) : 18526, 18901
.   : milestone, 18713,
code_origins (17.997 ms) : 17818, 18176
.   : milestone, 17997,
iast (17.642 ms) : 17469, 17816
.   : milestone, 17642,
profiling (18.081 ms) : 17905, 18257
.   : milestone, 18081,
tracing (17.797 ms) : 17621, 17973
.   : milestone, 17797,
section candidate
no_agent (18.606 ms) : 18413, 18798
.   : milestone, 18606,
appsec (18.672 ms) : 18485, 18860
.   : milestone, 18672,
code_origins (17.7 ms) : 17527, 17872
.   : milestone, 17700,
iast (17.81 ms) : 17633, 17987
.   : milestone, 17810,
profiling (19.481 ms) : 19280, 19682
.   : milestone, 19481,
tracing (18.034 ms) : 17854, 18213
.   : milestone, 18034,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.439 ms [19.24 ms, 19.638 ms] -
appsec 18.713 ms [18.526 ms, 18.901 ms] -725.933 µs (-3.7%)
code_origins 17.997 ms [17.818 ms, 18.176 ms] -1.442 ms (-7.4%)
iast 17.642 ms [17.469 ms, 17.816 ms] -1.797 ms (-9.2%)
profiling 18.081 ms [17.905 ms, 18.257 ms] -1.358 ms (-7.0%)
tracing 17.797 ms [17.621 ms, 17.973 ms] -1.642 ms (-8.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.606 ms [18.413 ms, 18.798 ms] -
appsec 18.672 ms [18.485 ms, 18.86 ms] 66.835 µs (0.4%)
code_origins 17.7 ms [17.527 ms, 17.872 ms] -906.012 µs (-4.9%)
iast 17.81 ms [17.633 ms, 17.987 ms] -795.767 µs (-4.3%)
profiling 19.481 ms [19.28 ms, 19.682 ms] 875.611 µs (4.7%)
tracing 18.034 ms [17.854 ms, 18.213 ms] -571.73 µs (-3.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~7f95433f5f, baseline=1.62.0-SNAPSHOT~7eef6a08d6d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.248 ms) : 1236, 1260
.   : milestone, 1248,
iast (3.29 ms) : 3241, 3339
.   : milestone, 3290,
iast_FULL (6.179 ms) : 6114, 6243
.   : milestone, 6179,
iast_GLOBAL (3.694 ms) : 3634, 3755
.   : milestone, 3694,
profiling (2.328 ms) : 2304, 2352
.   : milestone, 2328,
tracing (1.96 ms) : 1943, 1977
.   : milestone, 1960,
section candidate
no_agent (1.248 ms) : 1236, 1260
.   : milestone, 1248,
iast (3.307 ms) : 3262, 3353
.   : milestone, 3307,
iast_FULL (6.112 ms) : 6049, 6174
.   : milestone, 6112,
iast_GLOBAL (3.572 ms) : 3522, 3622
.   : milestone, 3572,
profiling (2.565 ms) : 2537, 2592
.   : milestone, 2565,
tracing (1.89 ms) : 1874, 1906
.   : milestone, 1890,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.248 ms [1.236 ms, 1.26 ms] -
iast 3.29 ms [3.241 ms, 3.339 ms] 2.042 ms (163.7%)
iast_FULL 6.179 ms [6.114 ms, 6.243 ms] 4.931 ms (395.2%)
iast_GLOBAL 3.694 ms [3.634 ms, 3.755 ms] 2.447 ms (196.1%)
profiling 2.328 ms [2.304 ms, 2.352 ms] 1.08 ms (86.6%)
tracing 1.96 ms [1.943 ms, 1.977 ms] 712.069 µs (57.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.248 ms [1.236 ms, 1.26 ms] -
iast 3.307 ms [3.262 ms, 3.353 ms] 2.059 ms (165.0%)
iast_FULL 6.112 ms [6.049 ms, 6.174 ms] 4.864 ms (389.8%)
iast_GLOBAL 3.572 ms [3.522 ms, 3.622 ms] 2.324 ms (186.3%)
profiling 2.565 ms [2.537 ms, 2.592 ms] 1.317 ms (105.5%)
tracing 1.89 ms [1.874 ms, 1.906 ms] 641.919 µs (51.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-smoke-test-latest-versions-20260419
git_commit_date 1776578162 1776577531
git_commit_sha eef6a08d6d 7f95433
release_version 1.62.0-SNAPSHOT~7eef6a08d6d 1.62.0-SNAPSHOT~7f95433f5f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1776579682 1776579682
ci_job_id 1608559132 1608559132
ci_pipeline_id 108406478 108406478
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-wp4y8guk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-wp4y8guk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.451ms; -1.102ms] or [-38.085%; -28.933%]		 2.533ms 3.809ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~7f95433f5f, baseline=1.62.0-SNAPSHOT~7eef6a08d6d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.547 s) : 15547000, 15547000
.   : milestone, 15547000,
appsec (14.714 s) : 14714000, 14714000
.   : milestone, 14714000,
iast (17.967 s) : 17967000, 17967000
.   : milestone, 17967000,
iast_GLOBAL (17.926 s) : 17926000, 17926000
.   : milestone, 17926000,
profiling (15.301 s) : 15301000, 15301000
.   : milestone, 15301000,
tracing (14.884 s) : 14884000, 14884000
.   : milestone, 14884000,
section candidate
no_agent (15.483 s) : 15483000, 15483000
.   : milestone, 15483000,
appsec (14.86 s) : 14860000, 14860000
.   : milestone, 14860000,
iast (18.512 s) : 18512000, 18512000
.   : milestone, 18512000,
iast_GLOBAL (17.947 s) : 17947000, 17947000
.   : milestone, 17947000,
profiling (15.028 s) : 15028000, 15028000
.   : milestone, 15028000,
tracing (14.983 s) : 14983000, 14983000
.   : milestone, 14983000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.547 s [15.547 s, 15.547 s] -
appsec 14.714 s [14.714 s, 14.714 s] -833.0 ms (-5.4%)
iast 17.967 s [17.967 s, 17.967 s] 2.42 s (15.6%)
iast_GLOBAL 17.926 s [17.926 s, 17.926 s] 2.379 s (15.3%)
profiling 15.301 s [15.301 s, 15.301 s] -246.0 ms (-1.6%)
tracing 14.884 s [14.884 s, 14.884 s] -663.0 ms (-4.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.483 s [15.483 s, 15.483 s] -
appsec 14.86 s [14.86 s, 14.86 s] -623.0 ms (-4.0%)
iast 18.512 s [18.512 s, 18.512 s] 3.029 s (19.6%)
iast_GLOBAL 17.947 s [17.947 s, 17.947 s] 2.464 s (15.9%)
profiling 15.028 s [15.028 s, 15.028 s] -455.0 ms (-2.9%)
tracing 14.983 s [14.983 s, 14.983 s] -500.0 ms (-3.2%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~7f95433f5f, baseline=1.62.0-SNAPSHOT~7eef6a08d6d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1471, 1494
.   : milestone, 1482,
appsec (3.809 ms) : 3587, 4032
.   : milestone, 3809,
iast (2.266 ms) : 2197, 2336
.   : milestone, 2266,
iast_GLOBAL (2.311 ms) : 2241, 2381
.   : milestone, 2311,
profiling (2.096 ms) : 2041, 2151
.   : milestone, 2096,
tracing (2.078 ms) : 2024, 2132
.   : milestone, 2078,
section candidate
no_agent (1.486 ms) : 1474, 1498
.   : milestone, 1486,
appsec (2.533 ms) : 2478, 2588
.   : milestone, 2533,
iast (2.268 ms) : 2198, 2337
.   : milestone, 2268,
iast_GLOBAL (2.322 ms) : 2251, 2392
.   : milestone, 2322,
profiling (2.096 ms) : 2041, 2151
.   : milestone, 2096,
tracing (2.077 ms) : 2023, 2131
.   : milestone, 2077,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.471 ms, 1.494 ms] -
appsec 3.809 ms [3.587 ms, 4.032 ms] 2.327 ms (157.0%)
iast 2.266 ms [2.197 ms, 2.336 ms] 783.804 µs (52.9%)
iast_GLOBAL 2.311 ms [2.241 ms, 2.381 ms] 828.817 µs (55.9%)
profiling 2.096 ms [2.041 ms, 2.151 ms] 613.296 µs (41.4%)
tracing 2.078 ms [2.024 ms, 2.132 ms] 595.799 µs (40.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.486 ms [1.474 ms, 1.498 ms] -
appsec 2.533 ms [2.478 ms, 2.588 ms] 1.047 ms (70.4%)
iast 2.268 ms [2.198 ms, 2.337 ms] 781.519 µs (52.6%)
iast_GLOBAL 2.322 ms [2.251 ms, 2.392 ms] 835.715 µs (56.2%)
profiling 2.096 ms [2.041 ms, 2.151 ms] 609.982 µs (41.0%)
tracing 2.077 ms [2.023 ms, 2.131 ms] 591.172 µs (39.8%)

PerfectSlayer
PerfectSlayer reviewed Apr 20, 2026
View reviewed changes
Copy link
Copy Markdown
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💭 thought: That does not seem right… 🤔 ‏

@daniel-mohedano
Copy link
Copy Markdown
Contributor

daniel-mohedano commented Apr 20, 2026 •
edited
Loading

Yeah, some time ago we introduced logic to avoid resolving non-stable releases, when we still were resolving them during testing time instead of using this new approach. As a side effect, the latest version we test against is 4.0.0-beta-3 while the latest stable release is only 3.9.15, which triggers this updates

@daniel-mohedano
Copy link
Copy Markdown
Contributor

daniel-mohedano commented Apr 20, 2026

I'll check to maybe split the resolution between the 3.x.x and 4.x.x versions and handle them independently to avoid this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer left review comments

@daniel-mohedano daniel-mohedano Awaiting requested review from daniel-mohedano

Assignees

No one assigned

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@daniel-mohedano @PerfectSlayer