Skip to content

Update smoke test latest tool versions#10845

Closed
dd-octo-sts[bot] wants to merge 1 commit intomasterfrom
ci/update-smoke-test-latest-versions-20260315
Closed

Update smoke test latest tool versions#10845
dd-octo-sts[bot] wants to merge 1 commit intomasterfrom
ci/update-smoke-test-latest-versions-20260315

Conversation

@dd-octo-sts
Copy link
Copy Markdown
Contributor

@dd-octo-sts dd-octo-sts bot commented Mar 15, 2026

What Does This Do

This PR updates the pinned "latest" tool versions used by CI Visibility smoke tests:

  • Gradle: 9.4.0
  • Maven: 3.9.14
  • Maven Surefire: 3.5.5

Motivation

Keep smoke tests running against the latest stable versions of build tools.

Contributor Checklist

  • Verify smoke tests pass with the new versions

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@dd-octo-sts dd-octo-sts bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Mar 15, 2026
@dd-octo-sts dd-octo-sts bot requested a review from a team as a code owner March 15, 2026 05:35
@dd-octo-sts dd-octo-sts bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Mar 15, 2026
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Mar 15, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-smoke-test-latest-versions-20260315
git_commit_date 1773553708 1773553707
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773555002 1773555002
ci_job_id 1506810968 1506810968
ci_pipeline_id 102554312 102554312
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_sha 185dcf699b 185dcf699b
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-9oyp4t0c 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-9oyp4t0c 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
release_version 1.61.0-SNAPSHOT~8185dcf699b 1.61.0-SNAPSHOT~8185dcf699b

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1061755
Total [baseline] (11.057 s) : 0, 11056962
Agent [candidate] (1.06 s) : 0, 1059549
Total [candidate] (11.032 s) : 0, 11031593
section appsec
Agent [baseline] (1.247 s) : 0, 1246917
Total [baseline] (11.144 s) : 0, 11143746
Agent [candidate] (1.245 s) : 0, 1244962
Total [candidate] (11.247 s) : 0, 11247138
section iast
Agent [baseline] (1.225 s) : 0, 1224682
Total [baseline] (11.343 s) : 0, 11342674
Agent [candidate] (1.224 s) : 0, 1223837
Total [candidate] (11.389 s) : 0, 11388908
section profiling
Agent [baseline] (1.182 s) : 0, 1181889
Total [baseline] (11.066 s) : 0, 11066060
Agent [candidate] (1.203 s) : 0, 1202824
Total [candidate] (11.033 s) : 0, 11032800
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.247 s 185.162 ms (17.4%)
Agent iast 1.225 s 162.927 ms (15.3%)
Agent profiling 1.182 s 120.134 ms (11.3%)
Total tracing 11.057 s -
Total appsec 11.144 s 86.784 ms (0.8%)
Total iast 11.343 s 285.712 ms (2.6%)
Total profiling 11.066 s 9.098 ms (0.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.245 s 185.413 ms (17.5%)
Agent iast 1.224 s 164.288 ms (15.5%)
Agent profiling 1.203 s 143.275 ms (13.5%)
Total tracing 11.032 s -
Total appsec 11.247 s 215.545 ms (2.0%)
Total iast 11.389 s 357.314 ms (3.2%)
Total profiling 11.033 s 1.206 ms (0.0%)
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (629.026 ms) : 0, 629026
BytebuddyAgent [candidate] (629.229 ms) : 0, 629229
AgentMeter [baseline] (29.135 ms) : 0, 29135
AgentMeter [candidate] (29.159 ms) : 0, 29159
GlobalTracer [baseline] (257.645 ms) : 0, 257645
GlobalTracer [candidate] (256.852 ms) : 0, 256852
AppSec [baseline] (31.654 ms) : 0, 31654
AppSec [candidate] (31.434 ms) : 0, 31434
Debugger [baseline] (59.699 ms) : 0, 59699
Debugger [candidate] (59.219 ms) : 0, 59219
Remote Config [baseline] (613.839 µs) : 0, 614
Remote Config [candidate] (623.781 µs) : 0, 624
Telemetry [baseline] (8.769 ms) : 0, 8769
Telemetry [candidate] (8.655 ms) : 0, 8655
Flare Poller [baseline] (8.023 ms) : 0, 8023
Flare Poller [candidate] (7.247 ms) : 0, 7247
section appsec
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (659.963 ms) : 0, 659963
BytebuddyAgent [candidate] (656.944 ms) : 0, 656944
AgentMeter [baseline] (12.005 ms) : 0, 12005
AgentMeter [candidate] (12.068 ms) : 0, 12068
GlobalTracer [baseline] (257.201 ms) : 0, 257201
GlobalTracer [candidate] (258.68 ms) : 0, 258680
AppSec [baseline] (177.339 ms) : 0, 177339
AppSec [candidate] (176.705 ms) : 0, 176705
Debugger [baseline] (65.646 ms) : 0, 65646
Debugger [candidate] (65.816 ms) : 0, 65816
Remote Config [baseline] (582.872 µs) : 0, 583
Remote Config [candidate] (574.967 µs) : 0, 575
Telemetry [baseline] (9.108 ms) : 0, 9108
Telemetry [candidate] (9.155 ms) : 0, 9155
Flare Poller [baseline] (3.608 ms) : 0, 3608
Flare Poller [candidate] (3.708 ms) : 0, 3708
IAST [baseline] (23.955 ms) : 0, 23955
IAST [candidate] (23.926 ms) : 0, 23926
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (793.865 ms) : 0, 793865
BytebuddyAgent [candidate] (793.405 ms) : 0, 793405
AgentMeter [baseline] (11.3 ms) : 0, 11300
AgentMeter [candidate] (11.307 ms) : 0, 11307
GlobalTracer [baseline] (246.791 ms) : 0, 246791
GlobalTracer [candidate] (246.774 ms) : 0, 246774
AppSec [baseline] (26.432 ms) : 0, 26432
AppSec [candidate] (26.422 ms) : 0, 26422
Debugger [baseline] (63.915 ms) : 0, 63915
Debugger [candidate] (64.233 ms) : 0, 64233
Remote Config [baseline] (515.997 µs) : 0, 516
Remote Config [candidate] (516.444 µs) : 0, 516
Telemetry [baseline] (14.717 ms) : 0, 14717
Telemetry [candidate] (14.229 ms) : 0, 14229
Flare Poller [baseline] (4.905 ms) : 0, 4905
Flare Poller [candidate] (4.782 ms) : 0, 4782
IAST [baseline] (25.128 ms) : 0, 25128
IAST [candidate] (25.043 ms) : 0, 25043
section profiling
ProfilingAgent [baseline] (93.711 ms) : 0, 93711
ProfilingAgent [candidate] (94.238 ms) : 0, 94238
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (682.124 ms) : 0, 682124
BytebuddyAgent [candidate] (695.851 ms) : 0, 695851
AgentMeter [baseline] (8.644 ms) : 0, 8644
AgentMeter [candidate] (8.808 ms) : 0, 8808
GlobalTracer [baseline] (215.662 ms) : 0, 215662
GlobalTracer [candidate] (219.171 ms) : 0, 219171
AppSec [baseline] (31.911 ms) : 0, 31911
AppSec [candidate] (32.752 ms) : 0, 32752
Debugger [baseline] (62.397 ms) : 0, 62397
Debugger [candidate] (65.81 ms) : 0, 65810
Remote Config [baseline] (589.103 µs) : 0, 589
Remote Config [candidate] (587.981 µs) : 0, 588
Telemetry [baseline] (11.352 ms) : 0, 11352
Telemetry [candidate] (9.003 ms) : 0, 9003
Flare Poller [baseline] (3.522 ms) : 0, 3522
Flare Poller [candidate] (3.56 ms) : 0, 3560
Profiling [baseline] (94.284 ms) : 0, 94284
Profiling [candidate] (94.804 ms) : 0, 94804
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1062869
Total [baseline] (8.868 s) : 0, 8867802
Agent [candidate] (1.064 s) : 0, 1063988
Total [candidate] (8.802 s) : 0, 8801859
section iast
Agent [baseline] (1.231 s) : 0, 1231478
Total [baseline] (9.597 s) : 0, 9596984
Agent [candidate] (1.227 s) : 0, 1226878
Total [candidate] (9.544 s) : 0, 9543619
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent iast 1.231 s 168.609 ms (15.9%)
Total tracing 8.868 s -
Total iast 9.597 s 729.182 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.227 s 162.89 ms (15.3%)
Total tracing 8.802 s -
Total iast 9.544 s 741.759 ms (8.4%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (627.912 ms) : 0, 627912
BytebuddyAgent [candidate] (631.243 ms) : 0, 631243
AgentMeter [baseline] (29.296 ms) : 0, 29296
AgentMeter [candidate] (29.232 ms) : 0, 29232
GlobalTracer [baseline] (258.123 ms) : 0, 258123
GlobalTracer [candidate] (258.099 ms) : 0, 258099
AppSec [baseline] (31.726 ms) : 0, 31726
AppSec [candidate] (31.778 ms) : 0, 31778
Debugger [baseline] (58.942 ms) : 0, 58942
Debugger [candidate] (58.991 ms) : 0, 58991
Remote Config [baseline] (626.707 µs) : 0, 627
Remote Config [candidate] (633.035 µs) : 0, 633
Telemetry [baseline] (8.749 ms) : 0, 8749
Telemetry [candidate] (8.788 ms) : 0, 8788
Flare Poller [baseline] (10.289 ms) : 0, 10289
Flare Poller [candidate] (7.908 ms) : 0, 7908
section iast
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (799.509 ms) : 0, 799509
BytebuddyAgent [candidate] (796.381 ms) : 0, 796381
AgentMeter [baseline] (11.408 ms) : 0, 11408
AgentMeter [candidate] (11.335 ms) : 0, 11335
GlobalTracer [baseline] (248.579 ms) : 0, 248579
GlobalTracer [candidate] (247.218 ms) : 0, 247218
IAST [baseline] (25.201 ms) : 0, 25201
IAST [candidate] (25.192 ms) : 0, 25192
AppSec [baseline] (26.43 ms) : 0, 26430
AppSec [candidate] (26.413 ms) : 0, 26413
Debugger [baseline] (62.691 ms) : 0, 62691
Debugger [candidate] (62.912 ms) : 0, 62912
Remote Config [baseline] (518.16 µs) : 0, 518
Remote Config [candidate] (536.357 µs) : 0, 536
Telemetry [baseline] (14.866 ms) : 0, 14866
Telemetry [candidate] (14.75 ms) : 0, 14750
Flare Poller [baseline] (4.905 ms) : 0, 4905
Flare Poller [candidate] (4.899 ms) : 0, 4899
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-smoke-test-latest-versions-20260315
git_commit_date 1773553537 1773553536
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773555311 1773555311
ci_job_id 1506810969 1506810969
ci_pipeline_id 102554312 102554312
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_sha 185dcf699b 185dcf699b
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-7bunvg6m 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-7bunvg6m 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
release_version 1.61.0-SNAPSHOT~8185dcf699b 1.61.0-SNAPSHOT~8185dcf699b

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 19 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:no_agent:high_load better
[-1.994ms; -0.672ms] or [-10.692%; -3.603%]
unstable
[-3.172ms; +0.461ms] or [-10.180%; +1.480%]
unstable
[-12.009op/s; +43.884op/s] or [-4.931%; +18.020%]
17.319ms 29.799ms 259.469op/s 18.652ms 31.155ms 243.531op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.173 ms) : 1161, 1184
.   : milestone, 1173,
iast (3.193 ms) : 3150, 3237
.   : milestone, 3193,
iast_FULL (5.916 ms) : 5856, 5976
.   : milestone, 5916,
iast_GLOBAL (3.355 ms) : 3306, 3405
.   : milestone, 3355,
profiling (2.0 ms) : 1982, 2018
.   : milestone, 2000,
tracing (1.775 ms) : 1761, 1789
.   : milestone, 1775,
section candidate
no_agent (1.169 ms) : 1158, 1180
.   : milestone, 1169,
iast (3.193 ms) : 3151, 3235
.   : milestone, 3193,
iast_FULL (5.88 ms) : 5821, 5940
.   : milestone, 5880,
iast_GLOBAL (3.451 ms) : 3396, 3506
.   : milestone, 3451,
profiling (1.93 ms) : 1913, 1947
.   : milestone, 1930,
tracing (1.839 ms) : 1822, 1855
.   : milestone, 1839,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.173 ms [1.161 ms, 1.184 ms] -
iast 3.193 ms [3.15 ms, 3.237 ms] 2.021 ms (172.3%)
iast_FULL 5.916 ms [5.856 ms, 5.976 ms] 4.743 ms (404.4%)
iast_GLOBAL 3.355 ms [3.306 ms, 3.405 ms] 2.183 ms (186.1%)
profiling 2.0 ms [1.982 ms, 2.018 ms] 827.264 µs (70.5%)
tracing 1.775 ms [1.761 ms, 1.789 ms] 601.935 µs (51.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.169 ms [1.158 ms, 1.18 ms] -
iast 3.193 ms [3.151 ms, 3.235 ms] 2.024 ms (173.1%)
iast_FULL 5.88 ms [5.821 ms, 5.94 ms] 4.711 ms (403.0%)
iast_GLOBAL 3.451 ms [3.396 ms, 3.506 ms] 2.282 ms (195.2%)
profiling 1.93 ms [1.913 ms, 1.947 ms] 761.201 µs (65.1%)
tracing 1.839 ms [1.822 ms, 1.855 ms] 669.748 µs (57.3%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.171 ms) : 18973, 19369
.   : milestone, 19171,
appsec (19.712 ms) : 19508, 19916
.   : milestone, 19712,
code_origins (17.725 ms) : 17547, 17903
.   : milestone, 17725,
iast (18.121 ms) : 17943, 18299
.   : milestone, 18121,
profiling (18.675 ms) : 18493, 18856
.   : milestone, 18675,
tracing (17.66 ms) : 17486, 17834
.   : milestone, 17660,
section candidate
no_agent (17.982 ms) : 17796, 18168
.   : milestone, 17982,
appsec (19.534 ms) : 19338, 19730
.   : milestone, 19534,
code_origins (17.615 ms) : 17440, 17790
.   : milestone, 17615,
iast (18.595 ms) : 18407, 18784
.   : milestone, 18595,
profiling (18.945 ms) : 18756, 19135
.   : milestone, 18945,
tracing (17.729 ms) : 17554, 17904
.   : milestone, 17729,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.171 ms [18.973 ms, 19.369 ms] -
appsec 19.712 ms [19.508 ms, 19.916 ms] 541.029 µs (2.8%)
code_origins 17.725 ms [17.547 ms, 17.903 ms] -1.446 ms (-7.5%)
iast 18.121 ms [17.943 ms, 18.299 ms] -1.05 ms (-5.5%)
profiling 18.675 ms [18.493 ms, 18.856 ms] -496.319 µs (-2.6%)
tracing 17.66 ms [17.486 ms, 17.834 ms] -1.511 ms (-7.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.982 ms [17.796 ms, 18.168 ms] -
appsec 19.534 ms [19.338 ms, 19.73 ms] 1.552 ms (8.6%)
code_origins 17.615 ms [17.44 ms, 17.79 ms] -367.346 µs (-2.0%)
iast 18.595 ms [18.407 ms, 18.784 ms] 613.29 µs (3.4%)
profiling 18.945 ms [18.756 ms, 19.135 ms] 963.103 µs (5.4%)
tracing 17.729 ms [17.554 ms, 17.904 ms] -253.253 µs (-1.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-smoke-test-latest-versions-20260315
git_commit_date 1773553395 1773553390
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773554891 1773554891
ci_job_id 1506810972 1506810972
ci_pipeline_id 102554312 102554312
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_sha 185dcf699b 185dcf699b
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ao1rr6yg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ao1rr6yg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
release_version 1.61.0-SNAPSHOT~8185dcf699b 1.61.0-SNAPSHOT~8185dcf699b

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.447ms; -1.102ms] or [-38.295%; -29.156%]
2.504ms 3.779ms
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (3.779 ms) : 3559, 3999
.   : milestone, 3779,
iast (2.238 ms) : 2170, 2307
.   : milestone, 2238,
iast_GLOBAL (2.291 ms) : 2222, 2360
.   : milestone, 2291,
profiling (2.498 ms) : 2285, 2712
.   : milestone, 2498,
tracing (2.066 ms) : 2013, 2120
.   : milestone, 2066,
section candidate
no_agent (1.47 ms) : 1458, 1481
.   : milestone, 1470,
appsec (2.504 ms) : 2450, 2559
.   : milestone, 2504,
iast (2.242 ms) : 2173, 2311
.   : milestone, 2242,
iast_GLOBAL (2.292 ms) : 2222, 2361
.   : milestone, 2292,
profiling (2.088 ms) : 2032, 2144
.   : milestone, 2088,
tracing (2.044 ms) : 1991, 2097
.   : milestone, 2044,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 3.779 ms [3.559 ms, 3.999 ms] 2.305 ms (156.5%)
iast 2.238 ms [2.17 ms, 2.307 ms] 764.801 µs (51.9%)
iast_GLOBAL 2.291 ms [2.222 ms, 2.36 ms] 817.622 µs (55.5%)
profiling 2.498 ms [2.285 ms, 2.712 ms] 1.025 ms (69.6%)
tracing 2.066 ms [2.013 ms, 2.12 ms] 593.043 µs (40.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.481 ms] -
appsec 2.504 ms [2.45 ms, 2.559 ms] 1.035 ms (70.4%)
iast 2.242 ms [2.173 ms, 2.311 ms] 772.477 µs (52.6%)
iast_GLOBAL 2.292 ms [2.222 ms, 2.361 ms] 821.846 µs (55.9%)
profiling 2.088 ms [2.032 ms, 2.144 ms] 617.861 µs (42.0%)
tracing 2.044 ms [1.991 ms, 2.097 ms] 574.421 µs (39.1%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.059 s) : 15059000, 15059000
.   : milestone, 15059000,
appsec (14.913 s) : 14913000, 14913000
.   : milestone, 14913000,
iast (18.115 s) : 18115000, 18115000
.   : milestone, 18115000,
iast_GLOBAL (17.792 s) : 17792000, 17792000
.   : milestone, 17792000,
profiling (15.06 s) : 15060000, 15060000
.   : milestone, 15060000,
tracing (15.074 s) : 15074000, 15074000
.   : milestone, 15074000,
section candidate
no_agent (15.262 s) : 15262000, 15262000
.   : milestone, 15262000,
appsec (15.011 s) : 15011000, 15011000
.   : milestone, 15011000,
iast (18.135 s) : 18135000, 18135000
.   : milestone, 18135000,
iast_GLOBAL (17.675 s) : 17675000, 17675000
.   : milestone, 17675000,
profiling (15.179 s) : 15179000, 15179000
.   : milestone, 15179000,
tracing (15.076 s) : 15076000, 15076000
.   : milestone, 15076000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.059 s [15.059 s, 15.059 s] -
appsec 14.913 s [14.913 s, 14.913 s] -146.0 ms (-1.0%)
iast 18.115 s [18.115 s, 18.115 s] 3.056 s (20.3%)
iast_GLOBAL 17.792 s [17.792 s, 17.792 s] 2.733 s (18.1%)
profiling 15.06 s [15.06 s, 15.06 s] 1.0 ms (0.0%)
tracing 15.074 s [15.074 s, 15.074 s] 15.0 ms (0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.262 s [15.262 s, 15.262 s] -
appsec 15.011 s [15.011 s, 15.011 s] -251.0 ms (-1.6%)
iast 18.135 s [18.135 s, 18.135 s] 2.873 s (18.8%)
iast_GLOBAL 17.675 s [17.675 s, 17.675 s] 2.413 s (15.8%)
profiling 15.179 s [15.179 s, 15.179 s] -83.0 ms (-0.5%)
tracing 15.076 s [15.076 s, 15.076 s] -186.0 ms (-1.2%)

@daniel-mohedano
Copy link
Copy Markdown
Contributor

Good bot, but we want to keep testing against the non-final release version in Maven. Closing until a real upgrade.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant