Skip to content

🍒 10897 - Disable outdated RMI instrumentation#10899

Closed
PerfectSlayer wants to merge 1 commit intorelease/v1.60.xfrom
bruce.bujon/backport-pr-10897
Closed

🍒 10897 - Disable outdated RMI instrumentation#10899
PerfectSlayer wants to merge 1 commit intorelease/v1.60.xfrom
bruce.bujon/backport-pr-10897

Conversation

@PerfectSlayer
Copy link
Copy Markdown
Contributor

@PerfectSlayer PerfectSlayer commented Mar 18, 2026

Backport #10897 to release/v1.60.x

@PerfectSlayer PerfectSlayer requested a review from a team as a code owner March 18, 2026 18:55
@PerfectSlayer PerfectSlayer added type: refactoring inst: java Core Java language instrumentation labels Mar 18, 2026
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Mar 18, 2026

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch release/v1.60.x bruce.bujon/backport-pr-10897
git_commit_date 1773846743 1773860140
git_commit_sha c1e6a13 b833317
See matching parameters
Baseline Candidate
ci_job_date 1773861194 1773861194
ci_job_id 1519083420 1519083420
ci_pipeline_id 103357310 103357310
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce unsure
[-3873.243op/s; -144.389op/s] or [-2.164%; -0.081%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Mar 18, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bruce.bujon/backport-pr-10897
git_commit_date 1772492986 1773860140
git_commit_sha 0f5d84f b833317
release_version 1.60.0~0f5d84f2c4 1.61.0-SNAPSHOT~b833317adc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773861899 1773861899
ci_job_id 1519083412 1519083412
ci_pipeline_id 103357310 103357310
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-fziz5vxf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-fziz5vxf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~b833317adc, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066331
Total [baseline] (10.78 s) : 0, 10779503
Agent [candidate] (1.071 s) : 0, 1071102
Total [candidate] (11.011 s) : 0, 11011029
section appsec
Agent [baseline] (1.236 s) : 0, 1235808
Total [baseline] (10.957 s) : 0, 10956559
Agent [candidate] (1.248 s) : 0, 1247852
Total [candidate] (11.058 s) : 0, 11057535
section iast
Agent [baseline] (1.231 s) : 0, 1231144
Total [baseline] (11.251 s) : 0, 11251448
Agent [candidate] (1.231 s) : 0, 1231317
Total [candidate] (11.132 s) : 0, 11132282
section profiling
Agent [baseline] (1.201 s) : 0, 1200748
Total [baseline] (11.005 s) : 0, 11004773
Agent [candidate] (1.19 s) : 0, 1190390
Total [candidate] (10.905 s) : 0, 10905116
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.236 s 169.477 ms (15.9%)
Agent iast 1.231 s 164.813 ms (15.5%)
Agent profiling 1.201 s 134.417 ms (12.6%)
Total tracing 10.78 s -
Total appsec 10.957 s 177.056 ms (1.6%)
Total iast 11.251 s 471.945 ms (4.4%)
Total profiling 11.005 s 225.27 ms (2.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent appsec 1.248 s 176.75 ms (16.5%)
Agent iast 1.231 s 160.215 ms (15.0%)
Agent profiling 1.19 s 119.288 ms (11.1%)
Total tracing 11.011 s -
Total appsec 11.058 s 46.505 ms (0.4%)
Total iast 11.132 s 121.252 ms (1.1%)
Total profiling 10.905 s -105.913 ms (-1.0%) 
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~b833317adc, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (627.464 ms) : 0, 627464
BytebuddyAgent [candidate] (632.152 ms) : 0, 632152
AgentMeter [baseline] (29.195 ms) : 0, 29195
AgentMeter [candidate] (29.143 ms) : 0, 29143
GlobalTracer [baseline] (257.886 ms) : 0, 257886
GlobalTracer [candidate] (258.809 ms) : 0, 258809
AppSec [baseline] (33.139 ms) : 0, 33139
AppSec [candidate] (33.164 ms) : 0, 33164
Debugger [baseline] (63.676 ms) : 0, 63676
Debugger [candidate] (63.781 ms) : 0, 63781
Remote Config [baseline] (634.545 µs) : 0, 635
Remote Config [candidate] (616.488 µs) : 0, 616
Telemetry [baseline] (11.465 ms) : 0, 11465
Telemetry [candidate] (11.387 ms) : 0, 11387
Flare Poller [baseline] (5.504 ms) : 0, 5504
Flare Poller [candidate] (4.561 ms) : 0, 4561
section appsec
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.207 ms) : 0, 1207
BytebuddyAgent [baseline] (655.688 ms) : 0, 655688
BytebuddyAgent [candidate] (661.597 ms) : 0, 661597
AgentMeter [baseline] (11.938 ms) : 0, 11938
AgentMeter [candidate] (12.148 ms) : 0, 12148
GlobalTracer [baseline] (257.644 ms) : 0, 257644
GlobalTracer [candidate] (261.003 ms) : 0, 261003
AppSec [baseline] (167.73 ms) : 0, 167730
AppSec [candidate] (169.017 ms) : 0, 169017
Debugger [baseline] (66.399 ms) : 0, 66399
Debugger [candidate] (67.282 ms) : 0, 67282
Remote Config [baseline] (683.63 µs) : 0, 684
Remote Config [candidate] (668.317 µs) : 0, 668
Telemetry [baseline] (9.378 ms) : 0, 9378
Telemetry [candidate] (9.397 ms) : 0, 9397
Flare Poller [baseline] (3.682 ms) : 0, 3682
Flare Poller [candidate] (3.609 ms) : 0, 3609
IAST [baseline] (25.408 ms) : 0, 25408
IAST [candidate] (25.763 ms) : 0, 25763
section iast
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.205 ms) : 0, 1205
BytebuddyAgent [baseline] (795.035 ms) : 0, 795035
BytebuddyAgent [candidate] (794.785 ms) : 0, 794785
AgentMeter [baseline] (11.305 ms) : 0, 11305
AgentMeter [candidate] (11.315 ms) : 0, 11315
GlobalTracer [baseline] (247.418 ms) : 0, 247418
GlobalTracer [candidate] (247.281 ms) : 0, 247281
AppSec [baseline] (35.84 ms) : 0, 35840
AppSec [candidate] (34.102 ms) : 0, 34102
Debugger [baseline] (64.651 ms) : 0, 64651
Debugger [candidate] (66.724 ms) : 0, 66724
Remote Config [baseline] (529.494 µs) : 0, 529
Remote Config [candidate] (529.454 µs) : 0, 529
Telemetry [baseline] (8.685 ms) : 0, 8685
Telemetry [candidate] (8.627 ms) : 0, 8627
Flare Poller [baseline] (3.453 ms) : 0, 3453
Flare Poller [candidate] (3.468 ms) : 0, 3468
IAST [baseline] (27.021 ms) : 0, 27021
IAST [candidate] (27.05 ms) : 0, 27050
section profiling
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.163 ms) : 0, 1163
BytebuddyAgent [baseline] (688.753 ms) : 0, 688753
BytebuddyAgent [candidate] (681.766 ms) : 0, 681766
AgentMeter [baseline] (8.64 ms) : 0, 8640
AgentMeter [candidate] (8.578 ms) : 0, 8578
GlobalTracer [baseline] (217.313 ms) : 0, 217313
GlobalTracer [candidate] (216.36 ms) : 0, 216360
AppSec [baseline] (32.899 ms) : 0, 32899
AppSec [candidate] (32.532 ms) : 0, 32532
Debugger [baseline] (67.654 ms) : 0, 67654
Debugger [candidate] (67.326 ms) : 0, 67326
Remote Config [baseline] (634.169 µs) : 0, 634
Remote Config [candidate] (635.604 µs) : 0, 636
Telemetry [baseline] (8.959 ms) : 0, 8959
Telemetry [candidate] (8.971 ms) : 0, 8971
Flare Poller [baseline] (3.796 ms) : 0, 3796
Flare Poller [candidate] (3.702 ms) : 0, 3702
ProfilingAgent [baseline] (99.501 ms) : 0, 99501
ProfilingAgent [candidate] (98.573 ms) : 0, 98573
Profiling [baseline] (100.086 ms) : 0, 100086
Profiling [candidate] (99.143 ms) : 0, 99143
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~b833317adc, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.074 s) : 0, 1074493
Total [baseline] (8.783 s) : 0, 8783059
Agent [candidate] (1.067 s) : 0, 1066765
Total [candidate] (8.732 s) : 0, 8731547
section iast
Agent [baseline] (1.248 s) : 0, 1248020
Total [baseline] (9.413 s) : 0, 9413224
Agent [candidate] (1.234 s) : 0, 1234254
Total [candidate] (9.396 s) : 0, 9395695
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent iast 1.248 s 173.527 ms (16.1%)
Total tracing 8.783 s -
Total iast 9.413 s 630.165 ms (7.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent iast 1.234 s 167.489 ms (15.7%)
Total tracing 8.732 s -
Total iast 9.396 s 664.148 ms (7.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~b833317adc, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.217 ms) : 0, 1217
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (633.549 ms) : 0, 633549
BytebuddyAgent [candidate] (629.38 ms) : 0, 629380
AgentMeter [baseline] (29.325 ms) : 0, 29325
AgentMeter [candidate] (29.028 ms) : 0, 29028
GlobalTracer [baseline] (259.144 ms) : 0, 259144
GlobalTracer [candidate] (258.737 ms) : 0, 258737
AppSec [baseline] (33.194 ms) : 0, 33194
AppSec [candidate] (32.963 ms) : 0, 32963
Debugger [baseline] (65.044 ms) : 0, 65044
Debugger [candidate] (63.388 ms) : 0, 63388
Remote Config [baseline] (596.582 µs) : 0, 597
Remote Config [candidate] (599.624 µs) : 0, 600
Telemetry [baseline] (10.58 ms) : 0, 10580
Telemetry [candidate] (9.801 ms) : 0, 9801
Flare Poller [baseline] (5.393 ms) : 0, 5393
Flare Poller [candidate] (5.385 ms) : 0, 5385
section iast
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.211 ms) : 0, 1211
BytebuddyAgent [baseline] (807.728 ms) : 0, 807728
BytebuddyAgent [candidate] (797.093 ms) : 0, 797093
AgentMeter [baseline] (11.762 ms) : 0, 11762
AgentMeter [candidate] (11.369 ms) : 0, 11369
GlobalTracer [baseline] (249.873 ms) : 0, 249873
GlobalTracer [candidate] (247.954 ms) : 0, 247954
AppSec [baseline] (36.417 ms) : 0, 36417
AppSec [candidate] (34.074 ms) : 0, 34074
Debugger [baseline] (64.33 ms) : 0, 64330
Debugger [candidate] (66.398 ms) : 0, 66398
Remote Config [baseline] (539.311 µs) : 0, 539
Remote Config [candidate] (550.207 µs) : 0, 550
Telemetry [baseline] (8.699 ms) : 0, 8699
Telemetry [candidate] (8.673 ms) : 0, 8673
Flare Poller [baseline] (3.439 ms) : 0, 3439
Flare Poller [candidate] (3.503 ms) : 0, 3503
IAST [baseline] (27.679 ms) : 0, 27679
IAST [candidate] (27.241 ms) : 0, 27241
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bruce.bujon/backport-pr-10897
git_commit_date 1772492986 1773860140
git_commit_sha 0f5d84f b833317
release_version 1.60.0~0f5d84f2c4 1.61.0-SNAPSHOT~b833317adc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773862482 1773862482
ci_job_id 1519083414 1519083414
ci_pipeline_id 103357310 103357310
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-enmpl1z2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-enmpl1z2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 1 performance regressions! Performance is the same for 17 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+94.700µs; +174.271µs] or [+3.439%; +6.329%]		 unsure
[+71.653µs; +400.261µs] or [+0.914%; +5.105%]		 unstable
[-163.404op/s; +93.279op/s] or [-12.618%; +7.203%]		 2.888ms 8.076ms 1259.906op/s 2.754ms 7.840ms 1294.969op/s
scenario:load:petclinic:code_origins:high_load better
[-1019.168µs; -456.511µs] or [-5.751%; -2.576%]		 unsure
[-1017.972µs; -117.870µs] or [-3.542%; -0.410%]		 unstable
[-20.180op/s; +38.180op/s] or [-7.769%; +14.699%]		 16.983ms 28.175ms 268.750op/s 17.721ms 28.742ms 259.750op/s
scenario:load:petclinic:appsec:high_load better
[-1.807ms; -0.524ms] or [-9.301%; -2.698%]		 unsure
[-2.841ms; -0.539ms] or [-9.028%; -1.712%]		 unstable
[-13.118op/s; +42.118op/s] or [-5.531%; +17.760%]		 18.266ms 29.775ms 251.656op/s 19.432ms 31.465ms 237.156op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~b833317adc, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.894 ms) : 17713, 18074
.   : milestone, 17894,
appsec (19.683 ms) : 19476, 19890
.   : milestone, 19683,
code_origins (17.961 ms) : 17782, 18139
.   : milestone, 17961,
iast (17.671 ms) : 17493, 17848
.   : milestone, 17671,
profiling (19.137 ms) : 18941, 19333
.   : milestone, 19137,
tracing (17.656 ms) : 17480, 17832
.   : milestone, 17656,
section candidate
no_agent (17.328 ms) : 17153, 17503
.   : milestone, 17328,
appsec (18.543 ms) : 18356, 18730
.   : milestone, 18543,
code_origins (17.361 ms) : 17189, 17534
.   : milestone, 17361,
iast (17.541 ms) : 17366, 17716
.   : milestone, 17541,
profiling (18.712 ms) : 18527, 18897
.   : milestone, 18712,
tracing (17.547 ms) : 17372, 17722
.   : milestone, 17547,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.894 ms [17.713 ms, 18.074 ms] -
appsec 19.683 ms [19.476 ms, 19.89 ms] 1.789 ms (10.0%)
code_origins 17.961 ms [17.782 ms, 18.139 ms] 66.83 µs (0.4%)
iast 17.671 ms [17.493 ms, 17.848 ms] -222.904 µs (-1.2%)
profiling 19.137 ms [18.941 ms, 19.333 ms] 1.243 ms (6.9%)
tracing 17.656 ms [17.48 ms, 17.832 ms] -237.981 µs (-1.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.328 ms [17.153 ms, 17.503 ms] -
appsec 18.543 ms [18.356 ms, 18.73 ms] 1.215 ms (7.0%)
code_origins 17.361 ms [17.189 ms, 17.534 ms] 33.339 µs (0.2%)
iast 17.541 ms [17.366 ms, 17.716 ms] 213.135 µs (1.2%)
profiling 18.712 ms [18.527 ms, 18.897 ms] 1.384 ms (8.0%)
tracing 17.547 ms [17.372 ms, 17.722 ms] 219.259 µs (1.3%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~b833317adc, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.174 ms) : 1163, 1186
.   : milestone, 1174,
iast (3.213 ms) : 3170, 3256
.   : milestone, 3213,
iast_FULL (5.68 ms) : 5623, 5737
.   : milestone, 5680,
iast_GLOBAL (3.54 ms) : 3481, 3599
.   : milestone, 3540,
profiling (2.236 ms) : 2215, 2258
.   : milestone, 2236,
tracing (1.815 ms) : 1799, 1831
.   : milestone, 1815,
section candidate
no_agent (1.166 ms) : 1155, 1177
.   : milestone, 1166,
iast (3.323 ms) : 3278, 3368
.   : milestone, 3323,
iast_FULL (5.82 ms) : 5762, 5877
.   : milestone, 5820,
iast_GLOBAL (3.639 ms) : 3583, 3696
.   : milestone, 3639,
profiling (2.115 ms) : 2095, 2134
.   : milestone, 2115,
tracing (1.806 ms) : 1790, 1821
.   : milestone, 1806,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.174 ms [1.163 ms, 1.186 ms] -
iast 3.213 ms [3.17 ms, 3.256 ms] 2.039 ms (173.6%)
iast_FULL 5.68 ms [5.623 ms, 5.737 ms] 4.506 ms (383.6%)
iast_GLOBAL 3.54 ms [3.481 ms, 3.599 ms] 2.366 ms (201.4%)
profiling 2.236 ms [2.215 ms, 2.258 ms] 1.062 ms (90.4%)
tracing 1.815 ms [1.799 ms, 1.831 ms] 640.519 µs (54.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.166 ms [1.155 ms, 1.177 ms] -
iast 3.323 ms [3.278 ms, 3.368 ms] 2.157 ms (185.0%)
iast_FULL 5.82 ms [5.762 ms, 5.877 ms] 4.653 ms (399.1%)
iast_GLOBAL 3.639 ms [3.583 ms, 3.696 ms] 2.473 ms (212.1%)
profiling 2.115 ms [2.095 ms, 2.134 ms] 948.625 µs (81.4%)
tracing 1.806 ms [1.79 ms, 1.821 ms] 639.712 µs (54.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bruce.bujon/backport-pr-10897
git_commit_date 1772492986 1773860140
git_commit_sha 0f5d84f b833317
release_version 1.60.0~0f5d84f2c4 1.61.0-SNAPSHOT~b833317adc
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773862119 1773862119
ci_job_id 1519083417 1519083417
ci_pipeline_id 103357310 103357310
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-aerfkjgj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-aerfkjgj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.369ms; -1.023ms] or [-36.271%; -27.099%]		 2.578ms 3.773ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~b833317adc, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.773 ms) : 3553, 3993
.   : milestone, 3773,
iast (2.254 ms) : 2185, 2324
.   : milestone, 2254,
iast_GLOBAL (2.289 ms) : 2220, 2358
.   : milestone, 2289,
profiling (2.093 ms) : 2037, 2149
.   : milestone, 2093,
tracing (2.055 ms) : 2001, 2109
.   : milestone, 2055,
section candidate
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (2.578 ms) : 2520, 2636
.   : milestone, 2578,
iast (2.25 ms) : 2181, 2319
.   : milestone, 2250,
iast_GLOBAL (2.285 ms) : 2216, 2355
.   : milestone, 2285,
profiling (2.071 ms) : 2017, 2126
.   : milestone, 2071,
tracing (2.049 ms) : 1996, 2103
.   : milestone, 2049,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 3.773 ms [3.553 ms, 3.993 ms] 2.303 ms (156.7%)
iast 2.254 ms [2.185 ms, 2.324 ms] 784.25 µs (53.3%)
iast_GLOBAL 2.289 ms [2.22 ms, 2.358 ms] 818.751 µs (55.7%)
profiling 2.093 ms [2.037 ms, 2.149 ms] 623.056 µs (42.4%)
tracing 2.055 ms [2.001 ms, 2.109 ms] 584.725 µs (39.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 2.578 ms [2.52 ms, 2.636 ms] 1.101 ms (74.6%)
iast 2.25 ms [2.181 ms, 2.319 ms] 773.291 µs (52.4%)
iast_GLOBAL 2.285 ms [2.216 ms, 2.355 ms] 808.736 µs (54.8%)
profiling 2.071 ms [2.017 ms, 2.126 ms] 594.897 µs (40.3%)
tracing 2.049 ms [1.996 ms, 2.103 ms] 572.925 µs (38.8%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~b833317adc, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.555 s) : 15555000, 15555000
.   : milestone, 15555000,
appsec (14.917 s) : 14917000, 14917000
.   : milestone, 14917000,
iast (17.988 s) : 17988000, 17988000
.   : milestone, 17988000,
iast_GLOBAL (17.622 s) : 17622000, 17622000
.   : milestone, 17622000,
profiling (15.407 s) : 15407000, 15407000
.   : milestone, 15407000,
tracing (14.638 s) : 14638000, 14638000
.   : milestone, 14638000,
section candidate
no_agent (15.101 s) : 15101000, 15101000
.   : milestone, 15101000,
appsec (14.995 s) : 14995000, 14995000
.   : milestone, 14995000,
iast (18.079 s) : 18079000, 18079000
.   : milestone, 18079000,
iast_GLOBAL (17.94 s) : 17940000, 17940000
.   : milestone, 17940000,
profiling (14.918 s) : 14918000, 14918000
.   : milestone, 14918000,
tracing (14.97 s) : 14970000, 14970000
.   : milestone, 14970000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.555 s [15.555 s, 15.555 s] -
appsec 14.917 s [14.917 s, 14.917 s] -638.0 ms (-4.1%)
iast 17.988 s [17.988 s, 17.988 s] 2.433 s (15.6%)
iast_GLOBAL 17.622 s [17.622 s, 17.622 s] 2.067 s (13.3%)
profiling 15.407 s [15.407 s, 15.407 s] -148.0 ms (-1.0%)
tracing 14.638 s [14.638 s, 14.638 s] -917.0 ms (-5.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.101 s [15.101 s, 15.101 s] -
appsec 14.995 s [14.995 s, 14.995 s] -106.0 ms (-0.7%)
iast 18.079 s [18.079 s, 18.079 s] 2.978 s (19.7%)
iast_GLOBAL 17.94 s [17.94 s, 17.94 s] 2.839 s (18.8%)
profiling 14.918 s [14.918 s, 14.918 s] -183.0 ms (-1.2%)
tracing 14.97 s [14.97 s, 14.97 s] -131.0 ms (-0.9%)

@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Mar 18, 2026

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch release/v1.60.x bruce.bujon/backport-pr-10897
git_commit_date 1773846743 1773860140
git_commit_sha c1e6a13 b833317
See matching parameters
Baseline Candidate
ci_job_date 1773861247 1773861247
ci_job_id 1519083423 1519083423
ci_pipeline_id 103357310 103357310
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@sarahchen6 sarahchen6 added the tag: do not merge Do not merge changes label Mar 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@sarahchen6 sarahchen6 sarahchen6 approved these changes

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

Assignees

No one assigned

Labels

inst: java Core Java language instrumentation tag: do not merge Do not merge changes type: refactoring

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@PerfectSlayer @sarahchen6 @AlexeyKuznetsov-DD