Test against new karate groupId by daniel-mohedano · Pull Request #11210 · DataDog/dd-trace-java

daniel-mohedano · 2026-04-27T13:37:33Z

What Does This Do

Updates build file for karate instrumentation to use the updated io.karatelabs groupId when resolving latest versions instead of the old com.intuit.karate.
Adds a test target for the latest version released under the old groupId

Motivation

Better testing coverage

Additional Notes

With the new groupId, Karate has also released a new major 2.x version. Support for this version will come in a followup PR as it will probably require major changes to the instrumentation.

test-environment-trigger: skip

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

pr-commenter · 2026-04-27T14:54:46Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/karate-org-change
git_commit_date	1777291161	1777298880
git_commit_sha	`515d17b`	`d56cf6e`
release_version	1.62.0-SNAPSHOT~515d17b72e	1.62.0-SNAPSHOT~d56cf6edb9

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1777300629	1777300629
ci_job_id	1633699612	1633699612
ci_pipeline_id	109905539	109905539
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-nlermgjo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-nlermgjo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 60 metrics, 10 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:petclinic:iast:Debugger	worse [+2.043ms; +8.141ms] or [+3.214%; +12.806%]	68.667ms	63.575ms

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~d56cf6edb9, baseline=1.62.0-SNAPSHOT~515d17b72e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1056727
Total [baseline] (8.814 s) : 0, 8814208
Agent [candidate] (1.06 s) : 0, 1059901
Total [candidate] (8.866 s) : 0, 8865940
section iast
Agent [baseline] (1.234 s) : 0, 1234093
Total [baseline] (9.551 s) : 0, 9550963
Agent [candidate] (1.241 s) : 0, 1241488
Total [candidate] (9.573 s) : 0, 9572805

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	iast	1.234 s	177.366 ms (16.8%)
Total	tracing	8.814 s	-
Total	iast	9.551 s	736.756 ms (8.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.06 s	-
Agent	iast	1.241 s	181.587 ms (17.1%)
Total	tracing	8.866 s	-
Total	iast	9.573 s	706.865 ms (8.0%)

gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~d56cf6edb9, baseline=1.62.0-SNAPSHOT~515d17b72e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.231 ms) : 0, 1231
crashtracking [candidate] (1.229 ms) : 0, 1229
BytebuddyAgent [baseline] (635.835 ms) : 0, 635835
BytebuddyAgent [candidate] (636.784 ms) : 0, 636784
AgentMeter [baseline] (29.531 ms) : 0, 29531
AgentMeter [candidate] (29.662 ms) : 0, 29662
GlobalTracer [baseline] (248.989 ms) : 0, 248989
GlobalTracer [candidate] (249.097 ms) : 0, 249097
AppSec [baseline] (32.285 ms) : 0, 32285
AppSec [candidate] (32.408 ms) : 0, 32408
Debugger [baseline] (59.672 ms) : 0, 59672
Debugger [candidate] (59.722 ms) : 0, 59722
Remote Config [baseline] (598.881 µs) : 0, 599
Remote Config [candidate] (595.22 µs) : 0, 595
Telemetry [baseline] (8.785 ms) : 0, 8785
Telemetry [candidate] (10.394 ms) : 0, 10394
Flare Poller [baseline] (3.589 ms) : 0, 3589
Flare Poller [candidate] (3.639 ms) : 0, 3639
section iast
crashtracking [baseline] (1.224 ms) : 0, 1224
crashtracking [candidate] (1.237 ms) : 0, 1237
BytebuddyAgent [baseline] (810.581 ms) : 0, 810581
BytebuddyAgent [candidate] (817.857 ms) : 0, 817857
AgentMeter [baseline] (11.361 ms) : 0, 11361
AgentMeter [candidate] (11.468 ms) : 0, 11468
GlobalTracer [baseline] (239.591 ms) : 0, 239591
GlobalTracer [candidate] (240.261 ms) : 0, 240261
AppSec [baseline] (30.651 ms) : 0, 30651
AppSec [candidate] (27.662 ms) : 0, 27662
Debugger [baseline] (65.178 ms) : 0, 65178
Debugger [candidate] (65.686 ms) : 0, 65686
Remote Config [baseline] (538.954 µs) : 0, 539
Remote Config [candidate] (528.329 µs) : 0, 528
Telemetry [baseline] (7.857 ms) : 0, 7857
Telemetry [candidate] (7.81 ms) : 0, 7810
Flare Poller [baseline] (3.47 ms) : 0, 3470
Flare Poller [candidate] (3.398 ms) : 0, 3398
IAST [baseline] (27.493 ms) : 0, 27493
IAST [candidate] (29.31 ms) : 0, 29310

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~d56cf6edb9, baseline=1.62.0-SNAPSHOT~515d17b72e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058235
Total [baseline] (11.074 s) : 0, 11074112
Agent [candidate] (1.057 s) : 0, 1056978
Total [candidate] (11.09 s) : 0, 11090371
section appsec
Agent [baseline] (1.265 s) : 0, 1265141
Total [baseline] (11.141 s) : 0, 11141217
Agent [candidate] (1.265 s) : 0, 1264882
Total [candidate] (11.088 s) : 0, 11087542
section iast
Agent [baseline] (1.233 s) : 0, 1233128
Total [baseline] (11.271 s) : 0, 11271215
Agent [candidate] (1.244 s) : 0, 1244055
Total [candidate] (11.286 s) : 0, 11286494
section profiling
Agent [baseline] (1.188 s) : 0, 1188136
Total [baseline] (11.067 s) : 0, 11066587
Agent [candidate] (1.186 s) : 0, 1185627
Total [candidate] (10.954 s) : 0, 10953685

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	appsec	1.265 s	206.906 ms (19.6%)
Agent	iast	1.233 s	174.893 ms (16.5%)
Agent	profiling	1.188 s	129.901 ms (12.3%)
Total	tracing	11.074 s	-
Total	appsec	11.141 s	67.105 ms (0.6%)
Total	iast	11.271 s	197.103 ms (1.8%)
Total	profiling	11.067 s	-7.525 ms (-0.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	appsec	1.265 s	207.904 ms (19.7%)
Agent	iast	1.244 s	187.077 ms (17.7%)
Agent	profiling	1.186 s	128.649 ms (12.2%)
Total	tracing	11.09 s	-
Total	appsec	11.088 s	-2.829 ms (-0.0%)
Total	iast	11.286 s	196.122 ms (1.8%)
Total	profiling	10.954 s	-136.686 ms (-1.2%)

gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~d56cf6edb9, baseline=1.62.0-SNAPSHOT~515d17b72e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.228 ms) : 0, 1228
crashtracking [candidate] (1.24 ms) : 0, 1240
BytebuddyAgent [baseline] (635.993 ms) : 0, 635993
BytebuddyAgent [candidate] (635.608 ms) : 0, 635608
AgentMeter [baseline] (29.559 ms) : 0, 29559
AgentMeter [candidate] (29.462 ms) : 0, 29462
GlobalTracer [baseline] (249.289 ms) : 0, 249289
GlobalTracer [candidate] (248.804 ms) : 0, 248804
AppSec [baseline] (32.335 ms) : 0, 32335
AppSec [candidate] (32.204 ms) : 0, 32204
Debugger [baseline] (60.47 ms) : 0, 60470
Debugger [candidate] (60.361 ms) : 0, 60361
Remote Config [baseline] (608.459 µs) : 0, 608
Remote Config [candidate] (592.982 µs) : 0, 593
Telemetry [baseline] (8.872 ms) : 0, 8872
Telemetry [candidate] (8.754 ms) : 0, 8754
Flare Poller [baseline] (3.677 ms) : 0, 3677
Flare Poller [candidate] (3.532 ms) : 0, 3532
section appsec
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.214 ms) : 0, 1214
BytebuddyAgent [baseline] (676.496 ms) : 0, 676496
BytebuddyAgent [candidate] (675.164 ms) : 0, 675164
AgentMeter [baseline] (12.333 ms) : 0, 12333
AgentMeter [candidate] (12.337 ms) : 0, 12337
GlobalTracer [baseline] (249.697 ms) : 0, 249697
GlobalTracer [candidate] (250.271 ms) : 0, 250271
IAST [baseline] (24.318 ms) : 0, 24318
IAST [candidate] (24.322 ms) : 0, 24322
AppSec [baseline] (186.651 ms) : 0, 186651
AppSec [candidate] (186.761 ms) : 0, 186761
Debugger [baseline] (66.001 ms) : 0, 66001
Debugger [candidate] (66.412 ms) : 0, 66412
Remote Config [baseline] (595.923 µs) : 0, 596
Remote Config [candidate] (585.985 µs) : 0, 586
Telemetry [baseline] (7.918 ms) : 0, 7918
Telemetry [candidate] (7.974 ms) : 0, 7974
Flare Poller [baseline] (3.462 ms) : 0, 3462
Flare Poller [candidate] (3.493 ms) : 0, 3493
section iast
crashtracking [baseline] (1.237 ms) : 0, 1237
crashtracking [candidate] (1.229 ms) : 0, 1229
BytebuddyAgent [baseline] (810.829 ms) : 0, 810829
BytebuddyAgent [candidate] (816.504 ms) : 0, 816504
AgentMeter [baseline] (11.397 ms) : 0, 11397
AgentMeter [candidate] (11.487 ms) : 0, 11487
GlobalTracer [baseline] (239.417 ms) : 0, 239417
GlobalTracer [candidate] (241.987 ms) : 0, 241987
IAST [baseline] (31.614 ms) : 0, 31614
IAST [candidate] (27.044 ms) : 0, 27044
AppSec [baseline] (27.334 ms) : 0, 27334
AppSec [candidate] (29.062 ms) : 0, 29062
Debugger [baseline] (63.575 ms) : 0, 63575
Debugger [candidate] (68.667 ms) : 0, 68667
Remote Config [baseline] (521.483 µs) : 0, 521
Remote Config [candidate] (538.717 µs) : 0, 539
Telemetry [baseline] (7.747 ms) : 0, 7747
Telemetry [candidate] (7.838 ms) : 0, 7838
Flare Poller [baseline] (3.42 ms) : 0, 3420
Flare Poller [candidate] (3.459 ms) : 0, 3459
section profiling
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (692.761 ms) : 0, 692761
BytebuddyAgent [candidate] (692.282 ms) : 0, 692282
AgentMeter [baseline] (8.977 ms) : 0, 8977
AgentMeter [candidate] (8.961 ms) : 0, 8961
GlobalTracer [baseline] (208.194 ms) : 0, 208194
GlobalTracer [candidate] (207.414 ms) : 0, 207414
AppSec [baseline] (32.923 ms) : 0, 32923
AppSec [candidate] (32.618 ms) : 0, 32618
Debugger [baseline] (65.412 ms) : 0, 65412
Debugger [candidate] (65.935 ms) : 0, 65935
Remote Config [baseline] (578.129 µs) : 0, 578
Remote Config [candidate] (584.526 µs) : 0, 585
Telemetry [baseline] (8.61 ms) : 0, 8610
Telemetry [candidate] (7.82 ms) : 0, 7820
Flare Poller [baseline] (3.543 ms) : 0, 3543
Flare Poller [candidate] (3.5 ms) : 0, 3500
ProfilingAgent [baseline] (94.381 ms) : 0, 94381
ProfilingAgent [candidate] (93.651 ms) : 0, 93651
Profiling [baseline] (94.953 ms) : 0, 94953
Profiling [candidate] (94.204 ms) : 0, 94204

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/karate-org-change
git_commit_date	1777291161	1777298880
git_commit_sha	`515d17b`	`d56cf6e`
release_version	1.62.0-SNAPSHOT~515d17b72e	1.62.0-SNAPSHOT~d56cf6edb9

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1777301110	1777301110
ci_job_id	1633699614	1633699614
ci_pipeline_id	109905539	109905539
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-cqwgucbu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-cqwgucbu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 16 metrics, 18 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	better [-166.426µs; -61.537µs] or [-5.566%; -2.058%]	unstable [-3.872ms; +10.193ms] or [-46.158%; +121.521%]	unstable [-88.503op/s; +186.940op/s] or [-7.262%; +15.339%]	2.876ms	11.548ms	1267.969op/s	2.990ms	8.388ms	1218.750op/s
scenario:load:insecure-bank:iast:high_load	better [-212.552µs; -125.657µs] or [-7.797%; -4.609%]	unstable [-1121.544µs; -306.774µs] or [-13.872%; -3.794%]	unstable [-72.289op/s; +241.039op/s] or [-5.516%; +18.392%]	2.557ms	7.371ms	1394.906op/s	2.726ms	8.085ms	1310.531op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~d56cf6edb9, baseline=1.62.0-SNAPSHOT~515d17b72e
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.989 ms) : 17808, 18169
.   : milestone, 17989,
appsec (18.302 ms) : 18117, 18487
.   : milestone, 18302,
code_origins (18.149 ms) : 17968, 18330
.   : milestone, 18149,
iast (18.146 ms) : 17966, 18326
.   : milestone, 18146,
profiling (18.221 ms) : 18039, 18402
.   : milestone, 18221,
tracing (17.975 ms) : 17797, 18153
.   : milestone, 17975,
section candidate
no_agent (18.053 ms) : 17870, 18236
.   : milestone, 18053,
appsec (18.602 ms) : 18412, 18792
.   : milestone, 18602,
code_origins (17.819 ms) : 17646, 17993
.   : milestone, 17819,
iast (18.264 ms) : 18082, 18447
.   : milestone, 18264,
profiling (18.396 ms) : 18215, 18576
.   : milestone, 18396,
tracing (17.949 ms) : 17770, 18128
.   : milestone, 17949,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.989 ms [17.808 ms, 18.169 ms]	-
appsec	18.302 ms [18.117 ms, 18.487 ms]	313.384 µs (1.7%)
code_origins	18.149 ms [17.968 ms, 18.33 ms]	160.469 µs (0.9%)
iast	18.146 ms [17.966 ms, 18.326 ms]	156.992 µs (0.9%)
profiling	18.221 ms [18.039 ms, 18.402 ms]	231.951 µs (1.3%)
tracing	17.975 ms [17.797 ms, 18.153 ms]	-13.857 µs (-0.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.053 ms [17.87 ms, 18.236 ms]	-
appsec	18.602 ms [18.412 ms, 18.792 ms]	549.38 µs (3.0%)
code_origins	17.819 ms [17.646 ms, 17.993 ms]	-233.263 µs (-1.3%)
iast	18.264 ms [18.082 ms, 18.447 ms]	211.707 µs (1.2%)
profiling	18.396 ms [18.215 ms, 18.576 ms]	342.873 µs (1.9%)
tracing	17.949 ms [17.77 ms, 18.128 ms]	-103.963 µs (-0.6%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~d56cf6edb9, baseline=1.62.0-SNAPSHOT~515d17b72e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.245 ms) : 1232, 1257
.   : milestone, 1245,
iast (3.496 ms) : 3445, 3547
.   : milestone, 3496,
iast_FULL (6.304 ms) : 6239, 6370
.   : milestone, 6304,
iast_GLOBAL (3.766 ms) : 3700, 3831
.   : milestone, 3766,
profiling (2.21 ms) : 2190, 2230
.   : milestone, 2210,
tracing (1.892 ms) : 1876, 1908
.   : milestone, 1892,
section candidate
no_agent (1.242 ms) : 1230, 1254
.   : milestone, 1242,
iast (3.28 ms) : 3231, 3330
.   : milestone, 3280,
iast_FULL (6.031 ms) : 5970, 6092
.   : milestone, 6031,
iast_GLOBAL (3.629 ms) : 3568, 3690
.   : milestone, 3629,
profiling (2.328 ms) : 2305, 2350
.   : milestone, 2328,
tracing (1.886 ms) : 1870, 1901
.   : milestone, 1886,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.245 ms [1.232 ms, 1.257 ms]	-
iast	3.496 ms [3.445 ms, 3.547 ms]	2.251 ms (180.9%)
iast_FULL	6.304 ms [6.239 ms, 6.37 ms]	5.06 ms (406.6%)
iast_GLOBAL	3.766 ms [3.7 ms, 3.831 ms]	2.521 ms (202.6%)
profiling	2.21 ms [2.19 ms, 2.23 ms]	965.611 µs (77.6%)
tracing	1.892 ms [1.876 ms, 1.908 ms]	647.67 µs (52.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.242 ms [1.23 ms, 1.254 ms]	-
iast	3.28 ms [3.231 ms, 3.33 ms]	2.038 ms (164.1%)
iast_FULL	6.031 ms [5.97 ms, 6.092 ms]	4.789 ms (385.7%)
iast_GLOBAL	3.629 ms [3.568 ms, 3.69 ms]	2.387 ms (192.2%)
profiling	2.328 ms [2.305 ms, 2.35 ms]	1.086 ms (87.4%)
tracing	1.886 ms [1.87 ms, 1.901 ms]	643.961 µs (51.9%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/karate-org-change
git_commit_date	1777291161	1777298880
git_commit_sha	`515d17b`	`d56cf6e`
release_version	1.62.0-SNAPSHOT~515d17b72e	1.62.0-SNAPSHOT~d56cf6edb9

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1777300879	1777300879
ci_job_id	1633699615	1633699615
ci_pipeline_id	109905539	109905539
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-vg6xs2ds 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-vg6xs2ds 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~d56cf6edb9, baseline=1.62.0-SNAPSHOT~515d17b72e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.107 s) : 15107000, 15107000
.   : milestone, 15107000,
appsec (14.462 s) : 14462000, 14462000
.   : milestone, 14462000,
iast (18.509 s) : 18509000, 18509000
.   : milestone, 18509000,
iast_GLOBAL (17.866 s) : 17866000, 17866000
.   : milestone, 17866000,
profiling (15.055 s) : 15055000, 15055000
.   : milestone, 15055000,
tracing (14.657 s) : 14657000, 14657000
.   : milestone, 14657000,
section candidate
no_agent (15.685 s) : 15685000, 15685000
.   : milestone, 15685000,
appsec (14.948 s) : 14948000, 14948000
.   : milestone, 14948000,
iast (18.624 s) : 18624000, 18624000
.   : milestone, 18624000,
iast_GLOBAL (17.692 s) : 17692000, 17692000
.   : milestone, 17692000,
profiling (15.071 s) : 15071000, 15071000
.   : milestone, 15071000,
tracing (14.859 s) : 14859000, 14859000
.   : milestone, 14859000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.107 s [15.107 s, 15.107 s]	-
appsec	14.462 s [14.462 s, 14.462 s]	-645.0 ms (-4.3%)
iast	18.509 s [18.509 s, 18.509 s]	3.402 s (22.5%)
iast_GLOBAL	17.866 s [17.866 s, 17.866 s]	2.759 s (18.3%)
profiling	15.055 s [15.055 s, 15.055 s]	-52.0 ms (-0.3%)
tracing	14.657 s [14.657 s, 14.657 s]	-450.0 ms (-3.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.685 s [15.685 s, 15.685 s]	-
appsec	14.948 s [14.948 s, 14.948 s]	-737.0 ms (-4.7%)
iast	18.624 s [18.624 s, 18.624 s]	2.939 s (18.7%)
iast_GLOBAL	17.692 s [17.692 s, 17.692 s]	2.007 s (12.8%)
profiling	15.071 s [15.071 s, 15.071 s]	-614.0 ms (-3.9%)
tracing	14.859 s [14.859 s, 14.859 s]	-826.0 ms (-5.3%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~d56cf6edb9, baseline=1.62.0-SNAPSHOT~515d17b72e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.486 ms) : 1475, 1498
.   : milestone, 1486,
appsec (2.549 ms) : 2494, 2605
.   : milestone, 2549,
iast (2.283 ms) : 2213, 2353
.   : milestone, 2283,
iast_GLOBAL (2.323 ms) : 2252, 2394
.   : milestone, 2323,
profiling (2.106 ms) : 2050, 2162
.   : milestone, 2106,
tracing (2.077 ms) : 2023, 2131
.   : milestone, 2077,
section candidate
no_agent (1.487 ms) : 1475, 1498
.   : milestone, 1487,
appsec (3.838 ms) : 3616, 4061
.   : milestone, 3838,
iast (2.274 ms) : 2204, 2344
.   : milestone, 2274,
iast_GLOBAL (2.331 ms) : 2261, 2402
.   : milestone, 2331,
profiling (2.114 ms) : 2059, 2170
.   : milestone, 2114,
tracing (2.076 ms) : 2022, 2130
.   : milestone, 2076,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.486 ms [1.475 ms, 1.498 ms]	-
appsec	2.549 ms [2.494 ms, 2.605 ms]	1.063 ms (71.5%)
iast	2.283 ms [2.213 ms, 2.353 ms]	796.773 µs (53.6%)
iast_GLOBAL	2.323 ms [2.252 ms, 2.394 ms]	836.989 µs (56.3%)
profiling	2.106 ms [2.05 ms, 2.162 ms]	619.799 µs (41.7%)
tracing	2.077 ms [2.023 ms, 2.131 ms]	590.937 µs (39.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.487 ms [1.475 ms, 1.498 ms]	-
appsec	3.838 ms [3.616 ms, 4.061 ms]	2.352 ms (158.2%)
iast	2.274 ms [2.204 ms, 2.344 ms]	787.537 µs (53.0%)
iast_GLOBAL	2.331 ms [2.261 ms, 2.402 ms]	844.981 µs (56.8%)
profiling	2.114 ms [2.059 ms, 2.17 ms]	627.686 µs (42.2%)
tracing	2.076 ms [2.022 ms, 2.13 ms]	589.561 µs (39.7%)

daniel-mohedano · 2026-04-27T14:58:28Z

/merge

gh-worker-devflow-routing-ef8351 · 2026-04-27T14:58:32Z

View all feedbacks in Devflow UI.

2026-04-27 14:58:32 UTC ℹ️ Start processing command /merge

2026-04-27 14:58:37 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).

2026-04-27 16:09:12 UTC ℹ️ MergeQueue: This merge request was merged

fix: test against new karate groupId

4ac65fd

daniel-mohedano added type: bug Bug report and fix tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Apr 27, 2026

daniel-mohedano requested a review from a team as a code owner April 27, 2026 13:37

fix: java version comparison

d56cf6e

gnufede approved these changes Apr 27, 2026

View reviewed changes

gh-worker-dd-mergequeue-cf854d Bot merged commit 346672f into master Apr 27, 2026
571 checks passed

gh-worker-dd-mergequeue-cf854d Bot deleted the daniel.mohedano/karate-org-change branch April 27, 2026 16:09

github-actions Bot added this to the 1.62.0 milestone Apr 27, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Test against new karate groupId#11210

Test against new karate groupId#11210
gh-worker-dd-mergequeue-cf854d[bot] merged 2 commits intomasterfrom
daniel.mohedano/karate-org-change

daniel-mohedano commented Apr 27, 2026

Uh oh!

pr-commenter Bot commented Apr 27, 2026

Uh oh!

daniel-mohedano commented Apr 27, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 Bot commented Apr 27, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

daniel-mohedano commented Apr 27, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter Bot commented Apr 27, 2026

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

daniel-mohedano commented Apr 27, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 Bot commented Apr 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

gh-worker-devflow-routing-ef8351 Bot commented Apr 27, 2026 •

edited

Loading