🍒 10896 - fix(muzzle): temporarily excluded broken versions. by sarahchen6 · Pull Request #10900 · DataDog/dd-trace-java

sarahchen6 · 2026-03-18T23:37:12Z

Backport #10896 to release/v1.60.x

fix(muzzle): temporarily excluded broken versions. Co-authored-by: alexey.kuznetsov <alexey.kuznetsov@datadoghq.com> (cherry picked from commit 2604968)

pr-commenter · 2026-03-19T00:11:54Z

Kafka / producer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	release/v1.60.x	sarah.chen/backport-pr-10896
git_commit_date	1773874434	1773877029
git_commit_sha	`571a19e`	`377f92b`

See matching parameters

	Baseline	Candidate
ci_job_date	1773878017	1773878017
ci_job_id	1520016221	1520016221
ci_pipeline_id	103410824	103410824
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion	11.0.25	11.0.25
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.25+9-post-Ubuntu-1ubuntu122.04	11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce	same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce	unsure [-5639.703op/s; -668.465op/s] or [-3.149%; -0.373%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce	same

pr-commenter · 2026-03-19T00:24:43Z

Kafka / consumer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	release/v1.60.x	sarah.chen/backport-pr-10896
git_commit_date	1773874434	1773877029
git_commit_sha	`571a19e`	`377f92b`

See matching parameters

	Baseline	Candidate
ci_job_date	1773878090	1773878090
ci_job_id	1520016222	1520016222
ci_pipeline_id	103410824	103410824
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion	11.0.25	11.0.25
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.25+9-post-Ubuntu-1ubuntu122.04	11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 2 metrics, 0 unstable metrics.

scenario	Δ mean throughput
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume	worse [-13222.052op/s; -4824.897op/s] or [-6.998%; -2.554%]

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume	same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume	same

pr-commenter · 2026-03-19T00:27:33Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarah.chen/backport-pr-10896
git_commit_date	1772492986	1773877029
git_commit_sha	`0f5d84f`	`377f92b`
release_version	1.60.0~0f5d84f2c4	1.61.0-SNAPSHOT~377f92b2c4

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1773878837	1773878837
ci_job_id	1520016217	1520016217
ci_pipeline_id	103410824	103410824
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-3-7j4bipih 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-3-7j4bipih 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~377f92b2c4, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.067 s) : 0, 1067498
Total [baseline] (8.759 s) : 0, 8759071
Agent [candidate] (1.065 s) : 0, 1064624
Total [candidate] (8.735 s) : 0, 8734575
section iast
Agent [baseline] (1.232 s) : 0, 1232219
Total [baseline] (9.382 s) : 0, 9382334
Agent [candidate] (1.233 s) : 0, 1233018
Total [candidate] (9.377 s) : 0, 9377167

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.067 s	-
Agent	iast	1.232 s	164.721 ms (15.4%)
Total	tracing	8.759 s	-
Total	iast	9.382 s	623.264 ms (7.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.065 s	-
Agent	iast	1.233 s	168.395 ms (15.8%)
Total	tracing	8.735 s	-
Total	iast	9.377 s	642.592 ms (7.4%)

gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~377f92b2c4, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (629.479 ms) : 0, 629479
BytebuddyAgent [candidate] (627.905 ms) : 0, 627905
AgentMeter [baseline] (29.226 ms) : 0, 29226
AgentMeter [candidate] (28.986 ms) : 0, 28986
GlobalTracer [baseline] (257.805 ms) : 0, 257805
GlobalTracer [candidate] (257.795 ms) : 0, 257795
AppSec [baseline] (33.047 ms) : 0, 33047
AppSec [candidate] (33.074 ms) : 0, 33074
Debugger [baseline] (63.87 ms) : 0, 63870
Debugger [candidate] (63.685 ms) : 0, 63685
Remote Config [baseline] (619.111 µs) : 0, 619
Remote Config [candidate] (615.63 µs) : 0, 616
Telemetry [baseline] (10.748 ms) : 0, 10748
Telemetry [candidate] (9.137 ms) : 0, 9137
Flare Poller [baseline] (5.324 ms) : 0, 5324
Flare Poller [candidate] (6.125 ms) : 0, 6125
section iast
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.213 ms) : 0, 1213
BytebuddyAgent [baseline] (796.025 ms) : 0, 796025
BytebuddyAgent [candidate] (797.042 ms) : 0, 797042
AgentMeter [baseline] (11.35 ms) : 0, 11350
AgentMeter [candidate] (11.286 ms) : 0, 11286
GlobalTracer [baseline] (248.17 ms) : 0, 248170
GlobalTracer [candidate] (247.302 ms) : 0, 247302
IAST [baseline] (27.098 ms) : 0, 27098
IAST [candidate] (27.094 ms) : 0, 27094
AppSec [baseline] (34.73 ms) : 0, 34730
AppSec [candidate] (32.664 ms) : 0, 32664
Debugger [baseline] (64.938 ms) : 0, 64938
Debugger [candidate] (67.542 ms) : 0, 67542
Remote Config [baseline] (545.908 µs) : 0, 546
Remote Config [candidate] (534.693 µs) : 0, 535
Telemetry [baseline] (8.645 ms) : 0, 8645
Telemetry [candidate] (8.645 ms) : 0, 8645
Flare Poller [baseline] (3.41 ms) : 0, 3410
Flare Poller [candidate] (3.445 ms) : 0, 3445

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~377f92b2c4, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.074 s) : 0, 1074229
Total [baseline] (10.933 s) : 0, 10932910
Agent [candidate] (1.073 s) : 0, 1073428
Total [candidate] (10.999 s) : 0, 10998649
section appsec
Agent [baseline] (1.248 s) : 0, 1248359
Total [baseline] (11.052 s) : 0, 11052277
Agent [candidate] (1.237 s) : 0, 1236774
Total [candidate] (11.112 s) : 0, 11111915
section iast
Agent [baseline] (1.232 s) : 0, 1232160
Total [baseline] (11.149 s) : 0, 11149310
Agent [candidate] (1.239 s) : 0, 1238638
Total [candidate] (11.289 s) : 0, 11289461
section profiling
Agent [baseline] (1.2 s) : 0, 1200486
Total [baseline] (10.937 s) : 0, 10937070
Agent [candidate] (1.209 s) : 0, 1208726
Total [candidate] (11.127 s) : 0, 11126624

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.074 s	-
Agent	appsec	1.248 s	174.13 ms (16.2%)
Agent	iast	1.232 s	157.932 ms (14.7%)
Agent	profiling	1.2 s	126.257 ms (11.8%)
Total	tracing	10.933 s	-
Total	appsec	11.052 s	119.367 ms (1.1%)
Total	iast	11.149 s	216.399 ms (2.0%)
Total	profiling	10.937 s	4.159 ms (0.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.073 s	-
Agent	appsec	1.237 s	163.347 ms (15.2%)
Agent	iast	1.239 s	165.21 ms (15.4%)
Agent	profiling	1.209 s	135.298 ms (12.6%)
Total	tracing	10.999 s	-
Total	appsec	11.112 s	113.265 ms (1.0%)
Total	iast	11.289 s	290.812 ms (2.6%)
Total	profiling	11.127 s	127.975 ms (1.2%)

gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~377f92b2c4, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.204 ms) : 0, 1204
BytebuddyAgent [baseline] (632.541 ms) : 0, 632541
BytebuddyAgent [candidate] (631.996 ms) : 0, 631996
AgentMeter [baseline] (29.293 ms) : 0, 29293
AgentMeter [candidate] (29.321 ms) : 0, 29321
GlobalTracer [baseline] (259.686 ms) : 0, 259686
GlobalTracer [candidate] (259.518 ms) : 0, 259518
AppSec [baseline] (33.195 ms) : 0, 33195
AppSec [candidate] (33.147 ms) : 0, 33147
Debugger [baseline] (65.371 ms) : 0, 65371
Debugger [candidate] (65.869 ms) : 0, 65869
Remote Config [baseline] (626.372 µs) : 0, 626
Remote Config [candidate] (636.633 µs) : 0, 637
Telemetry [baseline] (9.876 ms) : 0, 9876
Telemetry [candidate] (10.108 ms) : 0, 10108
Flare Poller [baseline] (6.178 ms) : 0, 6178
Flare Poller [candidate] (5.321 ms) : 0, 5321
section appsec
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (663.269 ms) : 0, 663269
BytebuddyAgent [candidate] (656.143 ms) : 0, 656143
AgentMeter [baseline] (12.098 ms) : 0, 12098
AgentMeter [candidate] (12.032 ms) : 0, 12032
GlobalTracer [baseline] (260.555 ms) : 0, 260555
GlobalTracer [candidate] (258.201 ms) : 0, 258201
IAST [baseline] (25.699 ms) : 0, 25699
IAST [candidate] (25.402 ms) : 0, 25402
AppSec [baseline] (169.501 ms) : 0, 169501
AppSec [candidate] (167.497 ms) : 0, 167497
Debugger [baseline] (66.074 ms) : 0, 66074
Debugger [candidate] (66.663 ms) : 0, 66663
Remote Config [baseline] (691.107 µs) : 0, 691
Remote Config [candidate] (704.472 µs) : 0, 704
Telemetry [baseline] (9.381 ms) : 0, 9381
Telemetry [candidate] (9.286 ms) : 0, 9286
Flare Poller [baseline] (3.652 ms) : 0, 3652
Flare Poller [candidate] (3.607 ms) : 0, 3607
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (795.225 ms) : 0, 795225
BytebuddyAgent [candidate] (798.971 ms) : 0, 798971
AgentMeter [baseline] (11.343 ms) : 0, 11343
AgentMeter [candidate] (11.382 ms) : 0, 11382
GlobalTracer [baseline] (247.332 ms) : 0, 247332
GlobalTracer [candidate] (248.813 ms) : 0, 248813
IAST [baseline] (26.896 ms) : 0, 26896
IAST [candidate] (27.461 ms) : 0, 27461
AppSec [baseline] (34.055 ms) : 0, 34055
AppSec [candidate] (32.305 ms) : 0, 32305
Debugger [baseline] (67.143 ms) : 0, 67143
Debugger [candidate] (69.698 ms) : 0, 69698
Remote Config [baseline] (546.488 µs) : 0, 546
Remote Config [candidate] (538.428 µs) : 0, 538
Telemetry [baseline] (8.81 ms) : 0, 8810
Telemetry [candidate] (8.684 ms) : 0, 8684
Flare Poller [baseline] (3.533 ms) : 0, 3533
Flare Poller [candidate] (3.461 ms) : 0, 3461
section profiling
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (688.27 ms) : 0, 688270
BytebuddyAgent [candidate] (691.871 ms) : 0, 691871
AgentMeter [baseline] (8.609 ms) : 0, 8609
AgentMeter [candidate] (8.72 ms) : 0, 8720
GlobalTracer [baseline] (217.269 ms) : 0, 217269
GlobalTracer [candidate] (219.315 ms) : 0, 219315
AppSec [baseline] (32.904 ms) : 0, 32904
AppSec [candidate] (33.33 ms) : 0, 33330
Debugger [baseline] (67.693 ms) : 0, 67693
Debugger [candidate] (68.331 ms) : 0, 68331
Remote Config [baseline] (639.643 µs) : 0, 640
Remote Config [candidate] (658.321 µs) : 0, 658
Telemetry [baseline] (8.89 ms) : 0, 8890
Telemetry [candidate] (9.066 ms) : 0, 9066
Flare Poller [baseline] (3.776 ms) : 0, 3776
Flare Poller [candidate] (3.883 ms) : 0, 3883
ProfilingAgent [baseline] (99.929 ms) : 0, 99929
ProfilingAgent [candidate] (100.885 ms) : 0, 100885
Profiling [baseline] (100.504 ms) : 0, 100504
Profiling [candidate] (101.472 ms) : 0, 101472

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarah.chen/backport-pr-10896
git_commit_date	1772492986	1773877029
git_commit_sha	`0f5d84f`	`377f92b`
release_version	1.60.0~0f5d84f2c4	1.61.0-SNAPSHOT~377f92b2c4

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1773879477	1773879477
ci_job_id	1520016218	1520016218
ci_pipeline_id	103410824	103410824
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-4-43xjjh28 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-4-43xjjh28 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 19 metrics, 15 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:iast:high_load	better [-844.908µs; -401.921µs] or [-4.738%; -2.254%]	unsure [-1615.687µs; -300.800µs] or [-5.478%; -1.020%]	unstable [-15.162op/s; +33.850op/s] or [-5.929%; +13.235%]	17.210ms	28.535ms	265.094op/s	17.834ms	29.494ms	255.750op/s
scenario:load:petclinic:no_agent:high_load	worse [+0.574ms; +1.980ms] or [+3.290%; +11.350%]	same [-784.278µs; +2110.972µs] or [-2.612%; +7.030%]	unstable [-40.925op/s; +9.738op/s] or [-15.820%; +3.764%]	18.720ms	30.691ms	243.094op/s	17.444ms	30.027ms	258.688op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~377f92b2c4, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.207 ms) : 1194, 1219
.   : milestone, 1207,
iast (3.322 ms) : 3277, 3368
.   : milestone, 3322,
iast_FULL (5.783 ms) : 5725, 5841
.   : milestone, 5783,
iast_GLOBAL (3.637 ms) : 3578, 3696
.   : milestone, 3637,
profiling (1.986 ms) : 1967, 2006
.   : milestone, 1986,
tracing (1.794 ms) : 1780, 1808
.   : milestone, 1794,
section candidate
no_agent (1.174 ms) : 1162, 1185
.   : milestone, 1174,
iast (3.266 ms) : 3217, 3315
.   : milestone, 3266,
iast_FULL (5.734 ms) : 5677, 5791
.   : milestone, 5734,
iast_GLOBAL (3.524 ms) : 3463, 3585
.   : milestone, 3524,
profiling (2.01 ms) : 1991, 2029
.   : milestone, 2010,
tracing (1.772 ms) : 1758, 1787
.   : milestone, 1772,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.207 ms [1.194 ms, 1.219 ms]	-
iast	3.322 ms [3.277 ms, 3.368 ms]	2.116 ms (175.4%)
iast_FULL	5.783 ms [5.725 ms, 5.841 ms]	4.576 ms (379.3%)
iast_GLOBAL	3.637 ms [3.578 ms, 3.696 ms]	2.43 ms (201.4%)
profiling	1.986 ms [1.967 ms, 2.006 ms]	779.674 µs (64.6%)
tracing	1.794 ms [1.78 ms, 1.808 ms]	587.195 µs (48.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.174 ms [1.162 ms, 1.185 ms]	-
iast	3.266 ms [3.217 ms, 3.315 ms]	2.092 ms (178.2%)
iast_FULL	5.734 ms [5.677 ms, 5.791 ms]	4.56 ms (388.5%)
iast_GLOBAL	3.524 ms [3.463 ms, 3.585 ms]	2.35 ms (200.2%)
profiling	2.01 ms [1.991 ms, 2.029 ms]	836.228 µs (71.2%)
tracing	1.772 ms [1.758 ms, 1.787 ms]	598.304 µs (51.0%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~377f92b2c4, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.04 ms) : 17856, 18225
.   : milestone, 18040,
appsec (18.658 ms) : 18469, 18848
.   : milestone, 18658,
code_origins (17.835 ms) : 17660, 18011
.   : milestone, 17835,
iast (18.244 ms) : 18057, 18431
.   : milestone, 18244,
profiling (19.103 ms) : 18912, 19294
.   : milestone, 19103,
tracing (17.7 ms) : 17524, 17877
.   : milestone, 17700,
section candidate
no_agent (19.203 ms) : 19007, 19398
.   : milestone, 19203,
appsec (18.704 ms) : 18514, 18893
.   : milestone, 18704,
code_origins (17.71 ms) : 17534, 17887
.   : milestone, 17710,
iast (17.598 ms) : 17420, 17775
.   : milestone, 17598,
profiling (19.626 ms) : 19430, 19821
.   : milestone, 19626,
tracing (17.465 ms) : 17291, 17638
.   : milestone, 17465,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.04 ms [17.856 ms, 18.225 ms]	-
appsec	18.658 ms [18.469 ms, 18.848 ms]	618.035 µs (3.4%)
code_origins	17.835 ms [17.66 ms, 18.011 ms]	-205.001 µs (-1.1%)
iast	18.244 ms [18.057 ms, 18.431 ms]	203.908 µs (1.1%)
profiling	19.103 ms [18.912 ms, 19.294 ms]	1.062 ms (5.9%)
tracing	17.7 ms [17.524 ms, 17.877 ms]	-340.044 µs (-1.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.203 ms [19.007 ms, 19.398 ms]	-
appsec	18.704 ms [18.514 ms, 18.893 ms]	-499.046 µs (-2.6%)
code_origins	17.71 ms [17.534 ms, 17.887 ms]	-1.492 ms (-7.8%)
iast	17.598 ms [17.42 ms, 17.775 ms]	-1.605 ms (-8.4%)
profiling	19.626 ms [19.43 ms, 19.821 ms]	423.15 µs (2.2%)
tracing	17.465 ms [17.291 ms, 17.638 ms]	-1.738 ms (-9.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarah.chen/backport-pr-10896
git_commit_date	1772492986	1773877029
git_commit_sha	`0f5d84f`	`377f92b`
release_version	1.60.0~0f5d84f2c4	1.61.0-SNAPSHOT~377f92b2c4

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1773879208	1773879208
ci_job_id	1520016219	1520016219
ci_pipeline_id	103410824	103410824
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-5-vtzz0jz7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-5-vtzz0jz7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.314ms; -0.973ms] or [-35.434%; -26.241%]	2.564ms	3.708ms

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~377f92b2c4, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.895 s) : 14895000, 14895000
.   : milestone, 14895000,
appsec (14.892 s) : 14892000, 14892000
.   : milestone, 14892000,
iast (17.982 s) : 17982000, 17982000
.   : milestone, 17982000,
iast_GLOBAL (17.743 s) : 17743000, 17743000
.   : milestone, 17743000,
profiling (14.987 s) : 14987000, 14987000
.   : milestone, 14987000,
tracing (14.8 s) : 14800000, 14800000
.   : milestone, 14800000,
section candidate
no_agent (14.74 s) : 14740000, 14740000
.   : milestone, 14740000,
appsec (14.665 s) : 14665000, 14665000
.   : milestone, 14665000,
iast (17.786 s) : 17786000, 17786000
.   : milestone, 17786000,
iast_GLOBAL (17.826 s) : 17826000, 17826000
.   : milestone, 17826000,
profiling (14.919 s) : 14919000, 14919000
.   : milestone, 14919000,
tracing (14.887 s) : 14887000, 14887000
.   : milestone, 14887000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.895 s [14.895 s, 14.895 s]	-
appsec	14.892 s [14.892 s, 14.892 s]	-3.0 ms (-0.0%)
iast	17.982 s [17.982 s, 17.982 s]	3.087 s (20.7%)
iast_GLOBAL	17.743 s [17.743 s, 17.743 s]	2.848 s (19.1%)
profiling	14.987 s [14.987 s, 14.987 s]	92.0 ms (0.6%)
tracing	14.8 s [14.8 s, 14.8 s]	-95.0 ms (-0.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.74 s [14.74 s, 14.74 s]	-
appsec	14.665 s [14.665 s, 14.665 s]	-75.0 ms (-0.5%)
iast	17.786 s [17.786 s, 17.786 s]	3.046 s (20.7%)
iast_GLOBAL	17.826 s [17.826 s, 17.826 s]	3.086 s (20.9%)
profiling	14.919 s [14.919 s, 14.919 s]	179.0 ms (1.2%)
tracing	14.887 s [14.887 s, 14.887 s]	147.0 ms (1.0%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~377f92b2c4, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (3.708 ms) : 3491, 3924
.   : milestone, 3708,
iast (2.251 ms) : 2181, 2320
.   : milestone, 2251,
iast_GLOBAL (2.294 ms) : 2224, 2363
.   : milestone, 2294,
profiling (2.499 ms) : 2339, 2660
.   : milestone, 2499,
tracing (2.051 ms) : 1998, 2105
.   : milestone, 2051,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.564 ms) : 2506, 2622
.   : milestone, 2564,
iast (2.248 ms) : 2179, 2317
.   : milestone, 2248,
iast_GLOBAL (2.289 ms) : 2220, 2359
.   : milestone, 2289,
profiling (2.086 ms) : 2030, 2142
.   : milestone, 2086,
tracing (2.05 ms) : 1996, 2103
.   : milestone, 2050,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.46 ms, 1.483 ms]	-
appsec	3.708 ms [3.491 ms, 3.924 ms]	2.236 ms (151.9%)
iast	2.251 ms [2.181 ms, 2.32 ms]	778.966 µs (52.9%)
iast_GLOBAL	2.294 ms [2.224 ms, 2.363 ms]	821.858 µs (55.8%)
profiling	2.499 ms [2.339 ms, 2.66 ms]	1.028 ms (69.8%)
tracing	2.051 ms [1.998 ms, 2.105 ms]	579.612 µs (39.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.46 ms, 1.483 ms]	-
appsec	2.564 ms [2.506 ms, 2.622 ms]	1.093 ms (74.3%)
iast	2.248 ms [2.179 ms, 2.317 ms]	776.202 µs (52.8%)
iast_GLOBAL	2.289 ms [2.22 ms, 2.359 ms]	817.847 µs (55.6%)
profiling	2.086 ms [2.03 ms, 2.142 ms]	614.466 µs (41.8%)
tracing	2.05 ms [1.996 ms, 2.103 ms]	578.412 µs (39.3%)

fix(muzzle): temporarily excluded broken versions. (#10896)

377f92b

fix(muzzle): temporarily excluded broken versions. Co-authored-by: alexey.kuznetsov <alexey.kuznetsov@datadoghq.com> (cherry picked from commit 2604968)

sarahchen6 requested a review from a team as a code owner March 18, 2026 23:37

sarahchen6 added type: bug Bug report and fix tag: no release notes Changes to exclude from release notes labels Mar 18, 2026

sarahchen6 requested a review from a team as a code owner March 18, 2026 23:37

sarahchen6 added the inst: kafka Kafka instrumentation label Mar 18, 2026

AlexeyKuznetsov-DD approved these changes Mar 19, 2026

View reviewed changes

sarahchen6 merged commit e88257d into release/v1.60.x Mar 19, 2026
734 of 739 checks passed

sarahchen6 deleted the sarah.chen/backport-pr-10896 branch March 19, 2026 00:35

github-actions bot added this to the 1.60.2 milestone Mar 19, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

🍒 10896 - fix(muzzle): temporarily excluded broken versions.#10900

🍒 10896 - fix(muzzle): temporarily excluded broken versions.#10900
sarahchen6 merged 1 commit intorelease/v1.60.xfrom
sarah.chen/backport-pr-10896

sarahchen6 commented Mar 18, 2026

Uh oh!

pr-commenter bot commented Mar 19, 2026

Uh oh!

pr-commenter bot commented Mar 19, 2026

Uh oh!

pr-commenter bot commented Mar 19, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

sarahchen6 commented Mar 18, 2026

Uh oh!

pr-commenter bot commented Mar 19, 2026

Kafka / producer-benchmark

Parameters

Summary

Uh oh!

pr-commenter bot commented Mar 19, 2026

Kafka / consumer-benchmark

Parameters

Summary

Uh oh!

pr-commenter bot commented Mar 19, 2026

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants