Skip to content

Migrate dd-trace-core groovy files to java part 4 #11146

Open
jpbempel wants to merge 2 commits intomasterfrom
jpbempel/g2j-core-pt4
Open

Migrate dd-trace-core groovy files to java part 4 #11146
jpbempel wants to merge 2 commits intomasterfrom
jpbempel/g2j-core-pt4

Conversation

@jpbempel
Copy link
Copy Markdown
Member

@jpbempel jpbempel commented Apr 17, 2026 •
edited
Loading

What Does This Do

we migrate 3 tests:

  • CoreSpanBuilderTest
  • CoreTracerTest
  • DDSpanContextPropagationTagsTest

Motivation

this is part of the effort to migrate groovy tests to Java/JUnit
part1: #11053
part2: #11062
part3: #11085

Additional Notes

fix some still existing groovy tests regarding ServieNameCollector singleton. see commit

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

jpbempel added 2 commits April 17, 2026 10:31
@jpbempel
Migrate dd-trace-core groovy files to java part 4
76ff002 
we migrate 3 tests:
 - CoreSpanBuilderTest
 - CoreTracerTest
 - DDSpanContextPropagationTagsTest
@jpbempel
fix ServiceNameCollector singleton
fcfc49d 
we save the original instance before replaced by mock to restore it
Some tests rely on having. the original, and depending on the order
the class my keep the mocks instead resulting in errors
@jpbempel jpbempel requested a review from a team as a code owner April 17, 2026 11:32
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 17, 2026 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@jpbempel jpbempel added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Apr 17, 2026
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 17, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/g2j-core-pt4
git_commit_date 1776286005 1776425445
git_commit_sha 42f154d fcfc49d
release_version 1.62.0-SNAPSHOT~42f154d2f6 1.62.0-SNAPSHOT~fcfc49dad9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776427143 1776427143
ci_job_id 1605140784 1605140784
ci_pipeline_id 108209636 108209636
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-yiqt1tpi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-yiqt1tpi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~fcfc49dad9, baseline=1.62.0-SNAPSHOT~42f154d2f6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1053415
Total [baseline] (8.854 s) : 0, 8854161
Agent [candidate] (1.056 s) : 0, 1056142
Total [candidate] (8.817 s) : 0, 8817094
section iast
Agent [baseline] (1.229 s) : 0, 1229474
Total [baseline] (9.578 s) : 0, 9577790
Agent [candidate] (1.222 s) : 0, 1222441
Total [candidate] (9.588 s) : 0, 9588408
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent iast 1.229 s 176.059 ms (16.7%)
Total tracing 8.854 s -
Total iast 9.578 s 723.63 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.222 s 166.3 ms (15.7%)
Total tracing 8.817 s -
Total iast 9.588 s 771.314 ms (8.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~fcfc49dad9, baseline=1.62.0-SNAPSHOT~42f154d2f6

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.24 ms) : 0, 1240
BytebuddyAgent [baseline] (630.794 ms) : 0, 630794
BytebuddyAgent [candidate] (632.179 ms) : 0, 632179
AgentMeter [baseline] (29.323 ms) : 0, 29323
AgentMeter [candidate] (29.306 ms) : 0, 29306
GlobalTracer [baseline] (247.848 ms) : 0, 247848
GlobalTracer [candidate] (248.265 ms) : 0, 248265
AppSec [baseline] (32.235 ms) : 0, 32235
AppSec [candidate] (32.306 ms) : 0, 32306
Debugger [baseline] (59.022 ms) : 0, 59022
Debugger [candidate] (59.196 ms) : 0, 59196
Remote Config [baseline] (604.763 µs) : 0, 605
Remote Config [candidate] (589.584 µs) : 0, 590
Telemetry [baseline] (8.014 ms) : 0, 8014
Telemetry [candidate] (8.065 ms) : 0, 8065
Flare Poller [baseline] (8.27 ms) : 0, 8270
Flare Poller [candidate] (9.012 ms) : 0, 9012
section iast
crashtracking [baseline] (1.237 ms) : 0, 1237
crashtracking [candidate] (1.232 ms) : 0, 1232
BytebuddyAgent [baseline] (807.538 ms) : 0, 807538
BytebuddyAgent [candidate] (800.387 ms) : 0, 800387
AgentMeter [baseline] (11.492 ms) : 0, 11492
AgentMeter [candidate] (11.329 ms) : 0, 11329
GlobalTracer [baseline] (238.863 ms) : 0, 238863
GlobalTracer [candidate] (238.708 ms) : 0, 238708
AppSec [baseline] (32.711 ms) : 0, 32711
AppSec [candidate] (31.384 ms) : 0, 31384
Debugger [baseline] (59.947 ms) : 0, 59947
Debugger [candidate] (61.714 ms) : 0, 61714
Remote Config [baseline] (532.4 µs) : 0, 532
Remote Config [candidate] (1.175 ms) : 0, 1175
Telemetry [baseline] (11.694 ms) : 0, 11694
Telemetry [candidate] (11.221 ms) : 0, 11221
Flare Poller [baseline] (3.509 ms) : 0, 3509
Flare Poller [candidate] (3.437 ms) : 0, 3437
IAST [baseline] (25.716 ms) : 0, 25716
IAST [candidate] (25.78 ms) : 0, 25780
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~fcfc49dad9, baseline=1.62.0-SNAPSHOT~42f154d2f6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1059201
Total [baseline] (11.003 s) : 0, 11002880
Agent [candidate] (1.057 s) : 0, 1056879
Total [candidate] (11.092 s) : 0, 11092482
section appsec
Agent [baseline] (1.25 s) : 0, 1250117
Total [baseline] (11.058 s) : 0, 11058055
Agent [candidate] (1.248 s) : 0, 1248246
Total [candidate] (11.094 s) : 0, 11094235
section iast
Agent [baseline] (1.223 s) : 0, 1223417
Total [baseline] (11.347 s) : 0, 11347244
Agent [candidate] (1.225 s) : 0, 1224651
Total [candidate] (11.218 s) : 0, 11218162
section profiling
Agent [baseline] (1.185 s) : 0, 1185432
Total [baseline] (11.038 s) : 0, 11038135
Agent [candidate] (1.196 s) : 0, 1196203
Total [candidate] (11.041 s) : 0, 11041237
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.25 s 190.915 ms (18.0%)
Agent iast 1.223 s 164.215 ms (15.5%)
Agent profiling 1.185 s 126.231 ms (11.9%)
Total tracing 11.003 s -
Total appsec 11.058 s 55.175 ms (0.5%)
Total iast 11.347 s 344.365 ms (3.1%)
Total profiling 11.038 s 35.256 ms (0.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent appsec 1.248 s 191.367 ms (18.1%)
Agent iast 1.225 s 167.772 ms (15.9%)
Agent profiling 1.196 s 139.324 ms (13.2%)
Total tracing 11.092 s -
Total appsec 11.094 s 1.753 ms (0.0%)
Total iast 11.218 s 125.68 ms (1.1%)
Total profiling 11.041 s -51.244 ms (-0.5%) 
gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~fcfc49dad9, baseline=1.62.0-SNAPSHOT~42f154d2f6

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.225 ms) : 0, 1225
crashtracking [candidate] (1.235 ms) : 0, 1235
BytebuddyAgent [baseline] (634.17 ms) : 0, 634170
BytebuddyAgent [candidate] (632.075 ms) : 0, 632075
AgentMeter [baseline] (29.457 ms) : 0, 29457
AgentMeter [candidate] (29.386 ms) : 0, 29386
GlobalTracer [baseline] (249.164 ms) : 0, 249164
GlobalTracer [candidate] (248.837 ms) : 0, 248837
AppSec [baseline] (32.296 ms) : 0, 32296
AppSec [candidate] (32.364 ms) : 0, 32364
Debugger [baseline] (59.756 ms) : 0, 59756
Debugger [candidate] (60.004 ms) : 0, 60004
Remote Config [baseline] (590.368 µs) : 0, 590
Remote Config [candidate] (589.454 µs) : 0, 589
Telemetry [baseline] (8.065 ms) : 0, 8065
Telemetry [candidate] (8.085 ms) : 0, 8085
Flare Poller [baseline] (8.247 ms) : 0, 8247
Flare Poller [candidate] (8.211 ms) : 0, 8211
section appsec
crashtracking [baseline] (1.225 ms) : 0, 1225
crashtracking [candidate] (1.224 ms) : 0, 1224
BytebuddyAgent [baseline] (662.875 ms) : 0, 662875
BytebuddyAgent [candidate] (661.66 ms) : 0, 661660
AgentMeter [baseline] (12.104 ms) : 0, 12104
AgentMeter [candidate] (12.042 ms) : 0, 12042
GlobalTracer [baseline] (248.933 ms) : 0, 248933
GlobalTracer [candidate] (248.744 ms) : 0, 248744
AppSec [baseline] (185.241 ms) : 0, 185241
AppSec [candidate] (184.992 ms) : 0, 184992
Debugger [baseline] (65.954 ms) : 0, 65954
Debugger [candidate] (66.019 ms) : 0, 66019
Remote Config [baseline] (622.065 µs) : 0, 622
Remote Config [candidate] (631.213 µs) : 0, 631
Telemetry [baseline] (8.495 ms) : 0, 8495
Telemetry [candidate] (8.421 ms) : 0, 8421
Flare Poller [baseline] (3.559 ms) : 0, 3559
Flare Poller [candidate] (3.58 ms) : 0, 3580
IAST [baseline] (24.602 ms) : 0, 24602
IAST [candidate] (24.541 ms) : 0, 24541
section iast
crashtracking [baseline] (1.248 ms) : 0, 1248
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (799.622 ms) : 0, 799622
BytebuddyAgent [candidate] (802.094 ms) : 0, 802094
AgentMeter [baseline] (11.379 ms) : 0, 11379
AgentMeter [candidate] (11.391 ms) : 0, 11391
GlobalTracer [baseline] (238.834 ms) : 0, 238834
GlobalTracer [candidate] (238.959 ms) : 0, 238959
AppSec [baseline] (33.84 ms) : 0, 33840
AppSec [candidate] (31.161 ms) : 0, 31161
Debugger [baseline] (60.101 ms) : 0, 60101
Debugger [candidate] (62.134 ms) : 0, 62134
Remote Config [baseline] (547.875 µs) : 0, 548
Remote Config [candidate] (1.122 ms) : 0, 1122
Telemetry [baseline] (12.262 ms) : 0, 12262
Telemetry [candidate] (11.044 ms) : 0, 11044
Flare Poller [baseline] (3.494 ms) : 0, 3494
Flare Poller [candidate] (3.456 ms) : 0, 3456
IAST [baseline] (25.823 ms) : 0, 25823
IAST [candidate] (25.842 ms) : 0, 25842
section profiling
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (692.229 ms) : 0, 692229
BytebuddyAgent [candidate] (699.381 ms) : 0, 699381
AgentMeter [baseline] (9.098 ms) : 0, 9098
AgentMeter [candidate] (9.249 ms) : 0, 9249
GlobalTracer [baseline] (206.999 ms) : 0, 206999
GlobalTracer [candidate] (208.569 ms) : 0, 208569
AppSec [baseline] (32.785 ms) : 0, 32785
AppSec [candidate] (33.199 ms) : 0, 33199
Debugger [baseline] (65.441 ms) : 0, 65441
Debugger [candidate] (65.925 ms) : 0, 65925
Remote Config [baseline] (570.36 µs) : 0, 570
Remote Config [candidate] (579.539 µs) : 0, 580
Telemetry [baseline] (7.822 ms) : 0, 7822
Telemetry [candidate] (7.871 ms) : 0, 7871
Flare Poller [baseline] (3.6 ms) : 0, 3600
Flare Poller [candidate] (3.636 ms) : 0, 3636
ProfilingAgent [baseline] (94.391 ms) : 0, 94391
ProfilingAgent [candidate] (94.5 ms) : 0, 94500
Profiling [baseline] (94.967 ms) : 0, 94967
Profiling [candidate] (95.073 ms) : 0, 95073
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/g2j-core-pt4
git_commit_date 1776286005 1776425445
git_commit_sha 42f154d fcfc49d
release_version 1.62.0-SNAPSHOT~42f154d2f6 1.62.0-SNAPSHOT~fcfc49dad9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776427710 1776427710
ci_job_id 1605140785 1605140785
ci_pipeline_id 108209636 108209636
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-3a047dky 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-3a047dky 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-248.390µs; -84.293µs] or [-13.032%; -4.423%]		 unstable
[-1392.994µs; -484.746µs] or [-23.261%; -8.094%]		 unstable
[+63.399op/s; +491.601op/s] or [+3.476%; +26.956%]		 1.740ms 5.050ms 2101.219op/s 1.906ms 5.989ms 1823.719op/s
scenario:load:insecure-bank:iast_FULL:high_load unsure
[-324.638µs; -105.663µs] or [-5.966%; -1.942%]		 better
[-1077.436µs; -383.076µs] or [-8.153%; -2.899%]		 unstable
[-41.777op/s; +102.902op/s] or [-5.531%; +13.623%]		 5.226ms 12.485ms 785.906op/s 5.442ms 13.215ms 755.344op/s
scenario:load:petclinic:iast:high_load better
[-1.430ms; -0.663ms] or [-7.565%; -3.508%]		 unsure
[-2.316ms; -0.592ms] or [-7.557%; -1.934%]		 unstable
[-11.630op/s; +36.442op/s] or [-4.794%; +15.022%]		 17.862ms 29.187ms 255.000op/s 18.909ms 30.641ms 242.594op/s
scenario:load:petclinic:profiling:high_load worse
[+508.727µs; +1255.941µs] or [+2.874%; +7.096%]		 same
[-321.588µs; +1012.664µs] or [-1.100%; +3.463%]		 unstable
[-34.267op/s; +14.767op/s] or [-13.317%; +5.739%]		 18.581ms 29.587ms 247.562op/s 17.699ms 29.241ms 257.312op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~fcfc49dad9, baseline=1.62.0-SNAPSHOT~42f154d2f6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.292 ms) : 1278, 1307
.   : milestone, 1292,
iast (3.318 ms) : 3271, 3366
.   : milestone, 3318,
iast_FULL (6.123 ms) : 6058, 6187
.   : milestone, 6123,
iast_GLOBAL (3.693 ms) : 3632, 3753
.   : milestone, 3693,
profiling (2.491 ms) : 2465, 2516
.   : milestone, 2491,
tracing (1.949 ms) : 1932, 1966
.   : milestone, 1949,
section candidate
no_agent (1.257 ms) : 1245, 1269
.   : milestone, 1257,
iast (3.266 ms) : 3220, 3312
.   : milestone, 3266,
iast_FULL (5.883 ms) : 5824, 5942
.   : milestone, 5883,
iast_GLOBAL (3.744 ms) : 3681, 3807
.   : milestone, 3744,
profiling (2.153 ms) : 2133, 2173
.   : milestone, 2153,
tracing (1.917 ms) : 1901, 1934
.   : milestone, 1917,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.292 ms [1.278 ms, 1.307 ms] -
iast 3.318 ms [3.271 ms, 3.366 ms] 2.026 ms (156.8%)
iast_FULL 6.123 ms [6.058 ms, 6.187 ms] 4.83 ms (373.7%)
iast_GLOBAL 3.693 ms [3.632 ms, 3.753 ms] 2.4 ms (185.7%)
profiling 2.491 ms [2.465 ms, 2.516 ms] 1.198 ms (92.7%)
tracing 1.949 ms [1.932 ms, 1.966 ms] 656.994 µs (50.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.257 ms [1.245 ms, 1.269 ms] -
iast 3.266 ms [3.22 ms, 3.312 ms] 2.009 ms (159.8%)
iast_FULL 5.883 ms [5.824 ms, 5.942 ms] 4.626 ms (368.0%)
iast_GLOBAL 3.744 ms [3.681 ms, 3.807 ms] 2.487 ms (197.9%)
profiling 2.153 ms [2.133 ms, 2.173 ms] 895.942 µs (71.3%)
tracing 1.917 ms [1.901 ms, 1.934 ms] 660.581 µs (52.6%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~fcfc49dad9, baseline=1.62.0-SNAPSHOT~42f154d2f6
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.023 ms) : 17838, 18208
.   : milestone, 18023,
appsec (18.807 ms) : 18613, 19002
.   : milestone, 18807,
code_origins (17.927 ms) : 17748, 18106
.   : milestone, 17927,
iast (19.24 ms) : 19049, 19431
.   : milestone, 19240,
profiling (18.13 ms) : 17949, 18310
.   : milestone, 18130,
tracing (17.632 ms) : 17457, 17807
.   : milestone, 17632,
section candidate
no_agent (17.414 ms) : 17241, 17586
.   : milestone, 17414,
appsec (18.706 ms) : 18514, 18898
.   : milestone, 18706,
code_origins (17.868 ms) : 17691, 18045
.   : milestone, 17868,
iast (18.299 ms) : 18117, 18481
.   : milestone, 18299,
profiling (18.852 ms) : 18667, 19037
.   : milestone, 18852,
tracing (17.759 ms) : 17584, 17934
.   : milestone, 17759,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.023 ms [17.838 ms, 18.208 ms] -
appsec 18.807 ms [18.613 ms, 19.002 ms] 784.424 µs (4.4%)
code_origins 17.927 ms [17.748 ms, 18.106 ms] -96.139 µs (-0.5%)
iast 19.24 ms [19.049 ms, 19.431 ms] 1.217 ms (6.8%)
profiling 18.13 ms [17.949 ms, 18.31 ms] 106.601 µs (0.6%)
tracing 17.632 ms [17.457 ms, 17.807 ms] -390.906 µs (-2.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.414 ms [17.241 ms, 17.586 ms] -
appsec 18.706 ms [18.514 ms, 18.898 ms] 1.293 ms (7.4%)
code_origins 17.868 ms [17.691 ms, 18.045 ms] 454.124 µs (2.6%)
iast 18.299 ms [18.117 ms, 18.481 ms] 885.47 µs (5.1%)
profiling 18.852 ms [18.667 ms, 19.037 ms] 1.438 ms (8.3%)
tracing 17.759 ms [17.584 ms, 17.934 ms] 345.112 µs (2.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/g2j-core-pt4
git_commit_date 1776286005 1776425445
git_commit_sha 42f154d fcfc49d
release_version 1.62.0-SNAPSHOT~42f154d2f6 1.62.0-SNAPSHOT~fcfc49dad9
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1776427437 1776427437
ci_job_id 1605140786 1605140786
ci_pipeline_id 108209636 108209636
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-qf17aqnn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-qf17aqnn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.484ms; -1.137ms] or [-38.568%; -29.547%]		 2.537ms 3.848ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~fcfc49dad9, baseline=1.62.0-SNAPSHOT~42f154d2f6
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.484 s) : 15484000, 15484000
.   : milestone, 15484000,
appsec (14.629 s) : 14629000, 14629000
.   : milestone, 14629000,
iast (18.702 s) : 18702000, 18702000
.   : milestone, 18702000,
iast_GLOBAL (18.074 s) : 18074000, 18074000
.   : milestone, 18074000,
profiling (14.868 s) : 14868000, 14868000
.   : milestone, 14868000,
tracing (14.993 s) : 14993000, 14993000
.   : milestone, 14993000,
section candidate
no_agent (15.496 s) : 15496000, 15496000
.   : milestone, 15496000,
appsec (14.751 s) : 14751000, 14751000
.   : milestone, 14751000,
iast (18.557 s) : 18557000, 18557000
.   : milestone, 18557000,
iast_GLOBAL (18.306 s) : 18306000, 18306000
.   : milestone, 18306000,
profiling (14.831 s) : 14831000, 14831000
.   : milestone, 14831000,
tracing (14.843 s) : 14843000, 14843000
.   : milestone, 14843000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.484 s [15.484 s, 15.484 s] -
appsec 14.629 s [14.629 s, 14.629 s] -855.0 ms (-5.5%)
iast 18.702 s [18.702 s, 18.702 s] 3.218 s (20.8%)
iast_GLOBAL 18.074 s [18.074 s, 18.074 s] 2.59 s (16.7%)
profiling 14.868 s [14.868 s, 14.868 s] -616.0 ms (-4.0%)
tracing 14.993 s [14.993 s, 14.993 s] -491.0 ms (-3.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.496 s [15.496 s, 15.496 s] -
appsec 14.751 s [14.751 s, 14.751 s] -745.0 ms (-4.8%)
iast 18.557 s [18.557 s, 18.557 s] 3.061 s (19.8%)
iast_GLOBAL 18.306 s [18.306 s, 18.306 s] 2.81 s (18.1%)
profiling 14.831 s [14.831 s, 14.831 s] -665.0 ms (-4.3%)
tracing 14.843 s [14.843 s, 14.843 s] -653.0 ms (-4.2%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~fcfc49dad9, baseline=1.62.0-SNAPSHOT~42f154d2f6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.489 ms) : 1477, 1501
.   : milestone, 1489,
appsec (3.848 ms) : 3627, 4069
.   : milestone, 3848,
iast (2.277 ms) : 2208, 2347
.   : milestone, 2277,
iast_GLOBAL (2.326 ms) : 2256, 2395
.   : milestone, 2326,
profiling (2.11 ms) : 2055, 2165
.   : milestone, 2110,
tracing (2.078 ms) : 2024, 2132
.   : milestone, 2078,
section candidate
no_agent (1.489 ms) : 1477, 1500
.   : milestone, 1489,
appsec (2.537 ms) : 2483, 2592
.   : milestone, 2537,
iast (2.279 ms) : 2210, 2348
.   : milestone, 2279,
iast_GLOBAL (2.328 ms) : 2258, 2398
.   : milestone, 2328,
profiling (2.11 ms) : 2055, 2166
.   : milestone, 2110,
tracing (2.089 ms) : 2035, 2143
.   : milestone, 2089,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.489 ms [1.477 ms, 1.501 ms] -
appsec 3.848 ms [3.627 ms, 4.069 ms] 2.359 ms (158.4%)
iast 2.277 ms [2.208 ms, 2.347 ms] 788.311 µs (52.9%)
iast_GLOBAL 2.326 ms [2.256 ms, 2.395 ms] 836.405 µs (56.2%)
profiling 2.11 ms [2.055 ms, 2.165 ms] 620.905 µs (41.7%)
tracing 2.078 ms [2.024 ms, 2.132 ms] 588.938 µs (39.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.489 ms [1.477 ms, 1.5 ms] -
appsec 2.537 ms [2.483 ms, 2.592 ms] 1.049 ms (70.4%)
iast 2.279 ms [2.21 ms, 2.348 ms] 790.443 µs (53.1%)
iast_GLOBAL 2.328 ms [2.258 ms, 2.398 ms] 839.396 µs (56.4%)
profiling 2.11 ms [2.055 ms, 2.166 ms] 621.694 µs (41.8%)
tracing 2.089 ms [2.035 ms, 2.143 ms] 600.599 µs (40.3%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@manuel-alvarez-alvarez manuel-alvarez-alvarez Awaiting requested review from manuel-alvarez-alvarez manuel-alvarez-alvarez is a code owner automatically assigned from DataDog/apm-java

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@jpbempel