Skip to content

Introduce environment component#8919

Closed
PerfectSlayer wants to merge 0 commit intomasterfrom
bbujon/environment
Closed

Introduce environment component#8919
PerfectSlayer wants to merge 0 commit intomasterfrom
bbujon/environment

Conversation

@PerfectSlayer
Copy link
Copy Markdown
Contributor

@PerfectSlayer PerfectSlayer commented Jun 4, 2025

What Does This Do

DRAFT ONLY

Motivation

Additional Notes

Contributor Checklist

Jira ticket: LANGPLAT-458

@PerfectSlayer PerfectSlayer added the tag: do not merge Do not merge changes label Jun 4, 2025
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Jun 4, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1751342160 1751342531
end_time 2025-07-01T03:57:22 2025-07-01T04:03:32
git_branch master bbujon/environment
git_commit_sha 848b075 359dc42703ae1272739b607020ad58dc0d01cf13
start_time 2025-07-01T03:56:01 2025-07-01T04:02:12
See matching parameters
Baseline Candidate
ci_job_id 1006643614 1006643614
ci_pipeline_id 69250024 69250024
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1751341544 1751341544

Summary

Found 0 performance improvements and 3 performance regressions! Performance is the same for 4 metrics, 8 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop worse
[+143.896µs; +237.783µs] or [+1.434%; +2.369%]
worse
[+144.310µs; +264.421µs] or [+1.416%; +2.595%]
worse
[+111.545µs; +265.561µs] or [+1.083%; +2.579%]
same unsure
[-2.623op/s; -0.137op/s] or [-2.715%; -0.142%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-62.520µs; +24.004µs] or [-21.145%; +8.118%]
unstable
[-81.678µs; +29.669µs] or [-24.041%; +8.733%]
unstable
[-92.432µs; +35.294µs] or [-26.019%; +9.935%]
unstable
[-934.107µs; +330.371µs] or [-72.719%; +25.719%]
unstable
[-98.333op/s; +158.556op/s] or [-4.032%; +6.501%]
scenario:basic same same unstable
[-22.667µs; +13.351µs] or [-6.839%; +4.028%]
unstable
[-254.872µs; +137.809µs] or [-27.103%; +14.654%]
unstable
[-107.370op/s; +223.514op/s] or [-4.510%; +9.388%]
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (339.739 µs) : 269, 411
.   : milestone, 340,
basic (320.033 µs) : 302, 338
.   : milestone, 320,
loop (10.19 ms) : 10149, 10230
.   : milestone, 10190,
section candidate
noprobe (313.735 µs) : 290, 337
.   : milestone, 314,
basic (315.272 µs) : 307, 324
.   : milestone, 315,
loop (10.394 ms) : 10326, 10462
.   : milestone, 10394,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 339.739 µs [268.583 µs, 410.895 µs]
basic 320.033 µs [302.329 µs, 337.738 µs]
loop 10.19 ms [10.149 ms, 10.23 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 313.735 µs [290.247 µs, 337.223 µs]
basic 315.272 µs [306.888 µs, 323.656 µs]
loop 10.394 ms [10.326 ms, 10.462 ms]

@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Jun 4, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/environment
git_commit_date 1751341275 1751341544
git_commit_sha 848b075 359dc42703
release_version 1.51.0-SNAPSHOT~848b0754aa 1.51.0-SNAPSHOT~359dc42703
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751343310 1751343310
ci_job_id 1006643607 1006643607
ci_pipeline_id 69250024 69250024
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-5i3ajscr-project-304-concurrent-0-6oem83pz 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-5i3ajscr-project-304-concurrent-0-6oem83pz 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 5 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.001 s) : 0, 1001321
Total [baseline] (8.626 s) : 0, 8625667
Agent [candidate] (999.244 ms) : 0, 999244
Total [candidate] (8.57 s) : 0, 8570287
section iast
Agent [baseline] (1.136 s) : 0, 1136278
Total [baseline] (9.314 s) : 0, 9314322
Agent [candidate] (1.151 s) : 0, 1150908
Total [candidate] (9.32 s) : 0, 9319988
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.001 s -
Agent iast 1.136 s 134.957 ms (13.5%)
Total tracing 8.626 s -
Total iast 9.314 s 688.655 ms (8.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 999.244 ms -
Agent iast 1.151 s 151.665 ms (15.2%)
Total tracing 8.57 s -
Total iast 9.32 s 749.701 ms (8.7%)
gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (691.731 ms) : 0, 691731
BytebuddyAgent [candidate] (689.747 ms) : 0, 689747
GlobalTracer [baseline] (243.161 ms) : 0, 243161
GlobalTracer [candidate] (243.282 ms) : 0, 243282
AppSec [baseline] (30.682 ms) : 0, 30682
AppSec [candidate] (30.263 ms) : 0, 30263
Debugger [baseline] (6.067 ms) : 0, 6067
Debugger [candidate] (6.092 ms) : 0, 6092
Remote Config [baseline] (682.498 µs) : 0, 682
Remote Config [candidate] (686.839 µs) : 0, 687
Telemetry [baseline] (8.244 ms) : 0, 8244
Telemetry [candidate] (8.286 ms) : 0, 8286
section iast
BytebuddyAgent [baseline] (812.397 ms) : 0, 812397
BytebuddyAgent [candidate] (821.992 ms) : 0, 821992
GlobalTracer [baseline] (232.884 ms) : 0, 232884
GlobalTracer [candidate] (236.364 ms) : 0, 236364
AppSec [baseline] (29.388 ms) : 0, 29388
AppSec [candidate] (31.55 ms) : 0, 31550
Debugger [baseline] (5.832 ms) : 0, 5832
Debugger [candidate] (5.914 ms) : 0, 5914
Remote Config [baseline] (577.838 µs) : 0, 578
Remote Config [candidate] (584.109 µs) : 0, 584
Telemetry [baseline] (8.018 ms) : 0, 8018
Telemetry [candidate] (8.115 ms) : 0, 8115
IAST [baseline] (26.316 ms) : 0, 26316
IAST [candidate] (25.149 ms) : 0, 25149
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (997.399 ms) : 0, 997399
Total [baseline] (10.646 s) : 0, 10645923
Agent [candidate] (1.007 s) : 0, 1007365
Total [candidate] (10.817 s) : 0, 10817032
section appsec
Agent [baseline] (1.172 s) : 0, 1172431
Total [baseline] (10.758 s) : 0, 10757912
Agent [candidate] (1.188 s) : 0, 1187947
Total [candidate] (10.818 s) : 0, 10817540
section iast
Agent [baseline] (1.141 s) : 0, 1140748
Total [baseline] (4.426 s) : 0, 4426350
Agent [candidate] (1.141 s) : 0, 1140669
Total [candidate] (10.873 s) : 0, 10872841
section profiling
Agent [baseline] (1.245 s) : 0, 1244847
Total [baseline] (10.98 s) : 0, 10980194
Agent [candidate] (1.25 s) : 0, 1249946
Total [candidate] (11.02 s) : 0, 11020369
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 997.399 ms -
Agent appsec 1.172 s 175.032 ms (17.5%)
Agent iast 1.141 s 143.348 ms (14.4%)
Agent profiling 1.245 s 247.448 ms (24.8%)
Total tracing 10.646 s -
Total appsec 10.758 s 111.989 ms (1.1%)
Total iast 4.426 s -6.22 s (-58.4%)
Total profiling 10.98 s 334.271 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.007 s -
Agent appsec 1.188 s 180.583 ms (17.9%)
Agent iast 1.141 s 133.305 ms (13.2%)
Agent profiling 1.25 s 242.582 ms (24.1%)
Total tracing 10.817 s -
Total appsec 10.818 s 508.472 µs (0.0%)
Total iast 10.873 s 55.809 ms (0.5%)
Total profiling 11.02 s 203.337 ms (1.9%)
gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.588 ms) : 0, 688588
BytebuddyAgent [candidate] (696.128 ms) : 0, 696128
GlobalTracer [baseline] (242.452 ms) : 0, 242452
GlobalTracer [candidate] (244.438 ms) : 0, 244438
AppSec [baseline] (30.562 ms) : 0, 30562
AppSec [candidate] (30.687 ms) : 0, 30687
Debugger [baseline] (6.055 ms) : 0, 6055
Debugger [candidate] (6.114 ms) : 0, 6114
Remote Config [baseline] (677.313 µs) : 0, 677
Remote Config [candidate] (688.675 µs) : 0, 689
Telemetry [baseline] (8.215 ms) : 0, 8215
Telemetry [candidate] (8.331 ms) : 0, 8331
section appsec
BytebuddyAgent [baseline] (709.832 ms) : 0, 709832
BytebuddyAgent [candidate] (718.023 ms) : 0, 718023
GlobalTracer [baseline] (235.16 ms) : 0, 235160
GlobalTracer [candidate] (239.526 ms) : 0, 239526
AppSec [baseline] (170.279 ms) : 0, 170279
AppSec [candidate] (172.101 ms) : 0, 172101
Debugger [baseline] (5.79 ms) : 0, 5790
Debugger [candidate] (5.834 ms) : 0, 5834
Remote Config [baseline] (606.879 µs) : 0, 607
Remote Config [candidate] (611.749 µs) : 0, 612
Telemetry [baseline] (8.086 ms) : 0, 8086
Telemetry [candidate] (8.184 ms) : 0, 8184
IAST [baseline] (21.963 ms) : 0, 21963
IAST [candidate] (22.565 ms) : 0, 22565
section iast
BytebuddyAgent [baseline] (814.279 ms) : 0, 814279
BytebuddyAgent [candidate] (813.935 ms) : 0, 813935
GlobalTracer [baseline] (234.591 ms) : 0, 234591
GlobalTracer [candidate] (235.245 ms) : 0, 235245
AppSec [baseline] (32.522 ms) : 0, 32522
AppSec [candidate] (28.722 ms) : 0, 28722
Debugger [baseline] (5.795 ms) : 0, 5795
Debugger [candidate] (5.883 ms) : 0, 5883
Remote Config [baseline] (574.379 µs) : 0, 574
Remote Config [candidate] (582.917 µs) : 0, 583
Telemetry [baseline] (8.14 ms) : 0, 8140
Telemetry [candidate] (8.02 ms) : 0, 8020
IAST [baseline] (23.844 ms) : 0, 23844
IAST [candidate] (27.322 ms) : 0, 27322
section profiling
BytebuddyAgent [baseline] (679.291 ms) : 0, 679291
BytebuddyAgent [candidate] (680.797 ms) : 0, 680797
GlobalTracer [baseline] (361.421 ms) : 0, 361421
GlobalTracer [candidate] (362.864 ms) : 0, 362864
AppSec [baseline] (32.998 ms) : 0, 32998
AppSec [candidate] (31.129 ms) : 0, 31129
Debugger [baseline] (10.68 ms) : 0, 10680
Debugger [candidate] (12.112 ms) : 0, 12112
Remote Config [baseline] (678.719 µs) : 0, 679
Remote Config [candidate] (660.674 µs) : 0, 661
Telemetry [baseline] (7.99 ms) : 0, 7990
Telemetry [candidate] (9.523 ms) : 0, 9523
ProfilingAgent [baseline] (102.453 ms) : 0, 102453
ProfilingAgent [candidate] (104.229 ms) : 0, 104229
Profiling [baseline] (102.477 ms) : 0, 102477
Profiling [candidate] (104.254 ms) : 0, 104254
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/environment
git_commit_date 1751341275 1751341544
git_commit_sha 848b075 359dc42703
release_version 1.51.0-SNAPSHOT~848b0754aa 1.51.0-SNAPSHOT~359dc42703
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751343094 1751343094
ci_job_id 1006643608 1006643608
ci_pipeline_id 69250024 69250024
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-asxyngdr-project-304-concurrent-0-yggw0rs8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-asxyngdr-project-304-concurrent-0-yggw0rs8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:iast:high_load better
[-2.244ms; -1.395ms] or [-4.915%; -3.055%]
unstable
[-2.983op/s; +11.408op/s] or [-2.911%; +11.132%]
43.840ms 106.700op/s 45.660ms 102.487op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.416 ms) : 4366, 4465
.   : milestone, 4416,
iast (9.128 ms) : 8977, 9279
.   : milestone, 9128,
iast_FULL (13.735 ms) : 13466, 14005
.   : milestone, 13735,
iast_GLOBAL (10.141 ms) : 9966, 10315
.   : milestone, 10141,
profiling (8.803 ms) : 8657, 8948
.   : milestone, 8803,
tracing (7.676 ms) : 7568, 7783
.   : milestone, 7676,
section candidate
no_agent (4.291 ms) : 4241, 4340
.   : milestone, 4291,
iast (9.134 ms) : 8987, 9282
.   : milestone, 9134,
iast_FULL (13.933 ms) : 13657, 14209
.   : milestone, 13933,
iast_GLOBAL (10.194 ms) : 10015, 10373
.   : milestone, 10194,
profiling (8.879 ms) : 8736, 9022
.   : milestone, 8879,
tracing (7.613 ms) : 7507, 7719
.   : milestone, 7613,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.416 ms [4.366 ms, 4.465 ms] -
iast 9.128 ms [8.977 ms, 9.279 ms] 4.712 ms (106.7%)
iast_FULL 13.735 ms [13.466 ms, 14.005 ms] 9.32 ms (211.1%)
iast_GLOBAL 10.141 ms [9.966 ms, 10.315 ms] 5.725 ms (129.7%)
profiling 8.803 ms [8.657 ms, 8.948 ms] 4.387 ms (99.4%)
tracing 7.676 ms [7.568 ms, 7.783 ms] 3.26 ms (73.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.291 ms [4.241 ms, 4.34 ms] -
iast 9.134 ms [8.987 ms, 9.282 ms] 4.843 ms (112.9%)
iast_FULL 13.933 ms [13.657 ms, 14.209 ms] 9.642 ms (224.7%)
iast_GLOBAL 10.194 ms [10.015 ms, 10.373 ms] 5.903 ms (137.6%)
profiling 8.879 ms [8.736 ms, 9.022 ms] 4.588 ms (106.9%)
tracing 7.613 ms [7.507 ms, 7.719 ms] 3.322 ms (77.4%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.975 ms) : 36681, 37270
.   : milestone, 36975,
appsec (46.75 ms) : 46322, 47177
.   : milestone, 46750,
code_origins (44.034 ms) : 43645, 44422
.   : milestone, 44034,
iast (45.66 ms) : 45260, 46060
.   : milestone, 45660,
profiling (49.866 ms) : 49372, 50360
.   : milestone, 49866,
tracing (43.359 ms) : 42978, 43740
.   : milestone, 43359,
section candidate
no_agent (37.144 ms) : 36840, 37447
.   : milestone, 37144,
appsec (45.827 ms) : 45424, 46231
.   : milestone, 45827,
code_origins (42.812 ms) : 42457, 43168
.   : milestone, 42812,
iast (43.84 ms) : 43451, 44230
.   : milestone, 43840,
profiling (48.622 ms) : 48199, 49045
.   : milestone, 48622,
tracing (42.314 ms) : 41959, 42668
.   : milestone, 42314,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.975 ms [36.681 ms, 37.27 ms] -
appsec 46.75 ms [46.322 ms, 47.177 ms] 9.774 ms (26.4%)
code_origins 44.034 ms [43.645 ms, 44.422 ms] 7.058 ms (19.1%)
iast 45.66 ms [45.26 ms, 46.06 ms] 8.685 ms (23.5%)
profiling 49.866 ms [49.372 ms, 50.36 ms] 12.891 ms (34.9%)
tracing 43.359 ms [42.978 ms, 43.74 ms] 6.384 ms (17.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.144 ms [36.84 ms, 37.447 ms] -
appsec 45.827 ms [45.424 ms, 46.231 ms] 8.684 ms (23.4%)
code_origins 42.812 ms [42.457 ms, 43.168 ms] 5.669 ms (15.3%)
iast 43.84 ms [43.451 ms, 44.23 ms] 6.697 ms (18.0%)
profiling 48.622 ms [48.199 ms, 49.045 ms] 11.478 ms (30.9%)
tracing 42.314 ms [41.959 ms, 42.668 ms] 5.17 ms (13.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/environment
git_commit_date 1751341275 1751341544
git_commit_sha 848b075 359dc42703
release_version 1.51.0-SNAPSHOT~848b0754aa 1.51.0-SNAPSHOT~359dc42703
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1751343566 1751343566
ci_job_id 1006643609 1006643609
ci_pipeline_id 69250024 69250024
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-fj2rtzmv-project-304-concurrent-0-rc52v0w8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-fj2rtzmv-project-304-concurrent-0-rc52v0w8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.573 s) : 15573000, 15573000
.   : milestone, 15573000,
appsec (14.736 s) : 14736000, 14736000
.   : milestone, 14736000,
iast (18.598 s) : 18598000, 18598000
.   : milestone, 18598000,
iast_GLOBAL (18.156 s) : 18156000, 18156000
.   : milestone, 18156000,
profiling (15.372 s) : 15372000, 15372000
.   : milestone, 15372000,
tracing (14.96 s) : 14960000, 14960000
.   : milestone, 14960000,
section candidate
no_agent (15.275 s) : 15275000, 15275000
.   : milestone, 15275000,
appsec (14.881 s) : 14881000, 14881000
.   : milestone, 14881000,
iast (18.308 s) : 18308000, 18308000
.   : milestone, 18308000,
iast_GLOBAL (17.994 s) : 17994000, 17994000
.   : milestone, 17994000,
profiling (15.713 s) : 15713000, 15713000
.   : milestone, 15713000,
tracing (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.573 s [15.573 s, 15.573 s] -
appsec 14.736 s [14.736 s, 14.736 s] -837.0 ms (-5.4%)
iast 18.598 s [18.598 s, 18.598 s] 3.025 s (19.4%)
iast_GLOBAL 18.156 s [18.156 s, 18.156 s] 2.583 s (16.6%)
profiling 15.372 s [15.372 s, 15.372 s] -201.0 ms (-1.3%)
tracing 14.96 s [14.96 s, 14.96 s] -613.0 ms (-3.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.275 s [15.275 s, 15.275 s] -
appsec 14.881 s [14.881 s, 14.881 s] -394.0 ms (-2.6%)
iast 18.308 s [18.308 s, 18.308 s] 3.033 s (19.9%)
iast_GLOBAL 17.994 s [17.994 s, 17.994 s] 2.719 s (17.8%)
profiling 15.713 s [15.713 s, 15.713 s] 438.0 ms (2.9%)
tracing 14.965 s [14.965 s, 14.965 s] -310.0 ms (-2.0%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~359dc42703, baseline=1.51.0-SNAPSHOT~848b0754aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1470, 1493
.   : milestone, 1481,
appsec (2.399 ms) : 2351, 2448
.   : milestone, 2399,
iast (2.187 ms) : 2125, 2248
.   : milestone, 2187,
iast_GLOBAL (2.237 ms) : 2175, 2299
.   : milestone, 2237,
profiling (2.026 ms) : 1977, 2076
.   : milestone, 2026,
tracing (2.014 ms) : 1966, 2063
.   : milestone, 2014,
section candidate
no_agent (1.479 ms) : 1467, 1491
.   : milestone, 1479,
appsec (2.409 ms) : 2360, 2458
.   : milestone, 2409,
iast (2.194 ms) : 2132, 2255
.   : milestone, 2194,
iast_GLOBAL (2.243 ms) : 2180, 2306
.   : milestone, 2243,
profiling (2.051 ms) : 2001, 2102
.   : milestone, 2051,
tracing (2.002 ms) : 1954, 2049
.   : milestone, 2002,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.47 ms, 1.493 ms] -
appsec 2.399 ms [2.351 ms, 2.448 ms] 918.046 µs (62.0%)
iast 2.187 ms [2.125 ms, 2.248 ms] 705.186 µs (47.6%)
iast_GLOBAL 2.237 ms [2.175 ms, 2.299 ms] 755.83 µs (51.0%)
profiling 2.026 ms [1.977 ms, 2.076 ms] 544.656 µs (36.8%)
tracing 2.014 ms [1.966 ms, 2.063 ms] 532.972 µs (36.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.491 ms] -
appsec 2.409 ms [2.36 ms, 2.458 ms] 930.205 µs (62.9%)
iast 2.194 ms [2.132 ms, 2.255 ms] 714.717 µs (48.3%)
iast_GLOBAL 2.243 ms [2.18 ms, 2.306 ms] 763.899 µs (51.7%)
profiling 2.051 ms [2.001 ms, 2.102 ms] 572.138 µs (38.7%)
tracing 2.002 ms [1.954 ms, 2.049 ms] 522.708 µs (35.3%)

@PerfectSlayer PerfectSlayer force-pushed the bbujon/environment branch 2 times, most recently from 3edbbb7 to 1d156ba Compare June 17, 2025 06:07
@PerfectSlayer PerfectSlayer force-pushed the bbujon/environment branch 3 times, most recently from e1d7b71 to 08a110e Compare June 25, 2025 07:56
Comment on lines 5 to 7
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
import bootstrap.environment.EnvironmentVariables;
import bootstrap.environment.JavaVirtualMachine;
import bootstrap.environment.SystemProperties;
import datadog.trace.bootstrap.environment.EnvironmentVariables;
import datadog.trace.bootstrap.environment.JavaVirtualMachine;
import datadog.trace.bootstrap.environment.SystemProperties;

Comment thread components/environment/build.gradle.kts Outdated
Copy link
Copy Markdown
Contributor

@bric3 bric3 Jun 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bootstrap.environment is not a known excluded package for jacoco instrumentation, this causes the instrumentation of ….core.intr.Instrumenter ….core.internal.instr.ClassInstrumenter to fail.

Relocating under a known excluded prefix solves the issue.

https://github.com/DataDog/dd-trace-java/blob/3dc0c20c31408d6ee23df6aab6a68fe51bb31d8f/dd-trace-api/src/main/java/datadog/trace/api/ConfigDefaults.java#L165-L167

Suggested change
relocate("datadog.environment", "bootstrap.environment")
relocate("datadog.environment", "datadog.trace.bootstrap.environment")

FYI datadog.trace.bootstrap is already used for relocation purpose as well, e.g. her

https://github.com/DataDog/dd-trace-java/blob/3dc0c20c31408d6ee23df6aab6a68fe51bb31d8f/dd-java-agent/build.gradle#L81-L81

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: do not merge Do not merge changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants