Skip to content

Add unit and instrumentation test documentation for JUnit#11097

Open
PerfectSlayer wants to merge 1 commit intobbujon/groovy-to-java-instrumented-testsfrom
bbujon/groovy-to-java-doc
Open

Add unit and instrumentation test documentation for JUnit#11097
PerfectSlayer wants to merge 1 commit intobbujon/groovy-to-java-instrumented-testsfrom
bbujon/groovy-to-java-doc

Conversation

@PerfectSlayer
Copy link
Copy Markdown
Contributor

@PerfectSlayer PerfectSlayer commented Apr 13, 2026 •
edited
Loading

What Does This Do

This PR introduces documentation about JUnit testing tools for instrumentation tests.
It can help refining the usage and the API. It's still very early but it's getting progress.

I would recommend to use the "..." menu and use "view file" while reviewing to render the markdown.

Motivation

Help discovering the new testing features.

Additional Notes

This PR is part of some bigger improvements in stacked PRs:

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@PerfectSlayer PerfectSlayer requested a review from a team as a code owner April 13, 2026 14:00
@PerfectSlayer PerfectSlayer requested a review from dougqh April 13, 2026 14:00
@PerfectSlayer PerfectSlayer added type: documentation tag: no release notes Changes to exclude from release notes tag: ai generated Largely based on code generated by an AI or LLM labels Apr 13, 2026
This was referenced Apr 13, 2026
Open
Open
Draft
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 13, 2026 •
edited
Loading

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/groovy-to-java-doc
git_commit_date 1775834061 1776088566
git_commit_sha 5ab378f b087d2c
release_version 1.62.0-SNAPSHOT~5ab378f780 1.62.0-SNAPSHOT~b087d2c815
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776091316 1776091316
ci_job_id 1589763255 1589763255
ci_pipeline_id 107370244 107370244
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-ycqq5bpv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-ycqq5bpv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 12 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~b087d2c815, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066449
Total [baseline] (11.046 s) : 0, 11045882
Agent [candidate] (1.055 s) : 0, 1054998
Total [candidate] (11.088 s) : 0, 11087931
section appsec
Agent [baseline] (1.251 s) : 0, 1250925
Total [baseline] (11.058 s) : 0, 11057562
Agent [candidate] (1.25 s) : 0, 1250155
Total [candidate] (11.165 s) : 0, 11164844
section iast
Agent [baseline] (1.228 s) : 0, 1228317
Total [baseline] (11.294 s) : 0, 11293722
Agent [candidate] (1.231 s) : 0, 1230651
Total [candidate] (11.284 s) : 0, 11284065
section profiling
Agent [baseline] (1.193 s) : 0, 1192690
Total [baseline] (11.087 s) : 0, 11086543
Agent [candidate] (1.187 s) : 0, 1186698
Total [candidate] (11.117 s) : 0, 11117400
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.251 s 184.476 ms (17.3%)
Agent iast 1.228 s 161.868 ms (15.2%)
Agent profiling 1.193 s 126.242 ms (11.8%)
Total tracing 11.046 s -
Total appsec 11.058 s 11.681 ms (0.1%)
Total iast 11.294 s 247.84 ms (2.2%)
Total profiling 11.087 s 40.662 ms (0.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.25 s 195.157 ms (18.5%)
Agent iast 1.231 s 175.653 ms (16.6%)
Agent profiling 1.187 s 131.7 ms (12.5%)
Total tracing 11.088 s -
Total appsec 11.165 s 76.913 ms (0.7%)
Total iast 11.284 s 196.134 ms (1.8%)
Total profiling 11.117 s 29.469 ms (0.3%) 
gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~b087d2c815, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.255 ms) : 0, 1255
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (638.699 ms) : 0, 638699
BytebuddyAgent [candidate] (630.927 ms) : 0, 630927
AgentMeter [baseline] (29.596 ms) : 0, 29596
AgentMeter [candidate] (29.463 ms) : 0, 29463
GlobalTracer [baseline] (249.627 ms) : 0, 249627
GlobalTracer [candidate] (248.52 ms) : 0, 248520
AppSec [baseline] (31.848 ms) : 0, 31848
AppSec [candidate] (31.863 ms) : 0, 31863
Debugger [baseline] (60.266 ms) : 0, 60266
Debugger [candidate] (59.877 ms) : 0, 59877
Remote Config [baseline] (604.194 µs) : 0, 604
Remote Config [candidate] (593.086 µs) : 0, 593
Telemetry [baseline] (8.099 ms) : 0, 8099
Telemetry [candidate] (8.065 ms) : 0, 8065
Flare Poller [baseline] (9.963 ms) : 0, 9963
Flare Poller [candidate] (8.253 ms) : 0, 8253
section appsec
crashtracking [baseline] (1.243 ms) : 0, 1243
crashtracking [candidate] (1.238 ms) : 0, 1238
BytebuddyAgent [baseline] (663.374 ms) : 0, 663374
BytebuddyAgent [candidate] (664.032 ms) : 0, 664032
AgentMeter [baseline] (12.096 ms) : 0, 12096
AgentMeter [candidate] (12.179 ms) : 0, 12179
GlobalTracer [baseline] (249.552 ms) : 0, 249552
GlobalTracer [candidate] (249.076 ms) : 0, 249076
IAST [baseline] (24.543 ms) : 0, 24543
IAST [candidate] (24.553 ms) : 0, 24553
AppSec [baseline] (184.908 ms) : 0, 184908
AppSec [candidate] (184.238 ms) : 0, 184238
Debugger [baseline] (65.762 ms) : 0, 65762
Debugger [candidate] (65.53 ms) : 0, 65530
Remote Config [baseline] (608.828 µs) : 0, 609
Remote Config [candidate] (594.606 µs) : 0, 595
Telemetry [baseline] (8.65 ms) : 0, 8650
Telemetry [candidate] (8.528 ms) : 0, 8528
Flare Poller [baseline] (3.534 ms) : 0, 3534
Flare Poller [candidate] (3.543 ms) : 0, 3543
section iast
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.235 ms) : 0, 1235
BytebuddyAgent [baseline] (803.625 ms) : 0, 803625
BytebuddyAgent [candidate] (806.267 ms) : 0, 806267
AgentMeter [baseline] (11.499 ms) : 0, 11499
AgentMeter [candidate] (11.483 ms) : 0, 11483
GlobalTracer [baseline] (240.611 ms) : 0, 240611
GlobalTracer [candidate] (239.715 ms) : 0, 239715
IAST [baseline] (26.055 ms) : 0, 26055
IAST [candidate] (25.897 ms) : 0, 25897
AppSec [baseline] (32.454 ms) : 0, 32454
AppSec [candidate] (31.053 ms) : 0, 31053
Debugger [baseline] (60.886 ms) : 0, 60886
Debugger [candidate] (62.264 ms) : 0, 62264
Remote Config [baseline] (538.944 µs) : 0, 539
Remote Config [candidate] (528.823 µs) : 0, 529
Telemetry [baseline] (11.593 ms) : 0, 11593
Telemetry [candidate] (12.24 ms) : 0, 12240
Flare Poller [baseline] (3.442 ms) : 0, 3442
Flare Poller [candidate] (3.578 ms) : 0, 3578
section profiling
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.169 ms) : 0, 1169
BytebuddyAgent [baseline] (694.758 ms) : 0, 694758
BytebuddyAgent [candidate] (692.277 ms) : 0, 692277
AgentMeter [baseline] (9.122 ms) : 0, 9122
AgentMeter [candidate] (9.165 ms) : 0, 9165
GlobalTracer [baseline] (209.318 ms) : 0, 209318
GlobalTracer [candidate] (207.716 ms) : 0, 207716
AppSec [baseline] (33.112 ms) : 0, 33112
AppSec [candidate] (32.594 ms) : 0, 32594
Debugger [baseline] (66.497 ms) : 0, 66497
Debugger [candidate] (65.735 ms) : 0, 65735
Remote Config [baseline] (571.96 µs) : 0, 572
Remote Config [candidate] (572.176 µs) : 0, 572
Telemetry [baseline] (7.827 ms) : 0, 7827
Telemetry [candidate] (7.813 ms) : 0, 7813
Flare Poller [baseline] (3.554 ms) : 0, 3554
Flare Poller [candidate] (3.55 ms) : 0, 3550
ProfilingAgent [baseline] (94.905 ms) : 0, 94905
ProfilingAgent [candidate] (94.729 ms) : 0, 94729
Profiling [baseline] (95.474 ms) : 0, 95474
Profiling [candidate] (95.294 ms) : 0, 95294
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~b087d2c815, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054796
Total [baseline] (8.871 s) : 0, 8870974
Agent [candidate] (1.055 s) : 0, 1055473
Total [candidate] (8.858 s) : 0, 8857691
section iast
Agent [baseline] (1.224 s) : 0, 1223680
Total [baseline] (9.564 s) : 0, 9564223
Agent [candidate] (1.223 s) : 0, 1223151
Total [candidate] (9.598 s) : 0, 9597560
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.224 s 168.885 ms (16.0%)
Total tracing 8.871 s -
Total iast 9.564 s 693.248 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.223 s 167.678 ms (15.9%)
Total tracing 8.858 s -
Total iast 9.598 s 739.869 ms (8.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~b087d2c815, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.243 ms) : 0, 1243
crashtracking [candidate] (1.23 ms) : 0, 1230
BytebuddyAgent [baseline] (632.345 ms) : 0, 632345
BytebuddyAgent [candidate] (631.647 ms) : 0, 631647
AgentMeter [baseline] (29.53 ms) : 0, 29530
AgentMeter [candidate] (29.549 ms) : 0, 29549
GlobalTracer [baseline] (249.308 ms) : 0, 249308
GlobalTracer [candidate] (248.98 ms) : 0, 248980
AppSec [baseline] (32.139 ms) : 0, 32139
AppSec [candidate] (32.232 ms) : 0, 32232
Debugger [baseline] (59.431 ms) : 0, 59431
Debugger [candidate] (59.42 ms) : 0, 59420
Remote Config [baseline] (601.279 µs) : 0, 601
Remote Config [candidate] (600.19 µs) : 0, 600
Telemetry [baseline] (8.096 ms) : 0, 8096
Telemetry [candidate] (8.106 ms) : 0, 8106
Flare Poller [baseline] (5.9 ms) : 0, 5900
Flare Poller [candidate] (7.564 ms) : 0, 7564
section iast
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.228 ms) : 0, 1228
BytebuddyAgent [baseline] (800.366 ms) : 0, 800366
BytebuddyAgent [candidate] (799.948 ms) : 0, 799948
AgentMeter [baseline] (11.445 ms) : 0, 11445
AgentMeter [candidate] (11.388 ms) : 0, 11388
GlobalTracer [baseline] (240.344 ms) : 0, 240344
GlobalTracer [candidate] (239.381 ms) : 0, 239381
IAST [baseline] (25.88 ms) : 0, 25880
IAST [candidate] (26.517 ms) : 0, 26517
AppSec [baseline] (32.056 ms) : 0, 32056
AppSec [candidate] (31.077 ms) : 0, 31077
Debugger [baseline] (60.586 ms) : 0, 60586
Debugger [candidate] (60.938 ms) : 0, 60938
Remote Config [baseline] (1.12 ms) : 0, 1120
Remote Config [candidate] (531.44 µs) : 0, 531
Telemetry [baseline] (10.938 ms) : 0, 10938
Telemetry [candidate] (12.165 ms) : 0, 12165
Flare Poller [baseline] (3.399 ms) : 0, 3399
Flare Poller [candidate] (3.772 ms) : 0, 3772
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/groovy-to-java-doc
git_commit_date 1775834061 1776088566
git_commit_sha 5ab378f b087d2c
release_version 1.62.0-SNAPSHOT~5ab378f780 1.62.0-SNAPSHOT~b087d2c815
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776091888 1776091888
ci_job_id 1589763268 1589763268
ci_pipeline_id 107370244 107370244
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-0vz2we38 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-0vz2we38 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 6 performance improvements and 2 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-400.984µs; -152.441µs] or [-12.597%; -4.789%]		 better
[-1040.754µs; -413.253µs] or [-11.848%; -4.704%]		 unstable
[-55.203op/s; +225.266op/s] or [-4.738%; +19.334%]		 2.907ms 8.057ms 1250.156op/s 3.183ms 8.784ms 1165.125op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+228.903µs; +431.609µs] or [+4.357%; +8.215%]		 worse
[+484.716µs; +1184.096µs] or [+3.886%; +9.492%]		 unstable
[-120.320op/s; +41.007op/s] or [-15.400%; +5.248%]		 5.584ms 13.309ms 741.656op/s 5.254ms 12.475ms 781.312op/s
scenario:load:petclinic:iast:high_load better
[-1.456ms; -0.858ms] or [-7.793%; -4.595%]		 better
[-1.931ms; -0.823ms] or [-6.400%; -2.727%]		 unstable
[-13.134op/s; +43.072op/s] or [-5.342%; +17.518%]		 17.521ms 28.796ms 260.844op/s 18.678ms 30.173ms 245.875op/s
scenario:load:petclinic:profiling:high_load better
[-2.088ms; -0.900ms] or [-10.916%; -4.706%]		 better
[-2.268ms; -0.786ms] or [-7.440%; -2.579%]		 unstable
[-11.257op/s; +45.069op/s] or [-4.640%; +18.576%]		 17.634ms 28.953ms 259.531op/s 19.128ms 30.479ms 242.625op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~b087d2c815, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.273 ms) : 1260, 1285
.   : milestone, 1273,
iast (3.346 ms) : 3300, 3393
.   : milestone, 3346,
iast_FULL (5.917 ms) : 5857, 5977
.   : milestone, 5917,
iast_GLOBAL (3.942 ms) : 3879, 4005
.   : milestone, 3942,
profiling (2.252 ms) : 2230, 2273
.   : milestone, 2252,
tracing (1.9 ms) : 1883, 1916
.   : milestone, 1900,
section candidate
no_agent (1.238 ms) : 1227, 1250
.   : milestone, 1238,
iast (3.326 ms) : 3281, 3371
.   : milestone, 3326,
iast_FULL (6.237 ms) : 6172, 6301
.   : milestone, 6237,
iast_GLOBAL (3.669 ms) : 3603, 3735
.   : milestone, 3669,
profiling (2.189 ms) : 2167, 2210
.   : milestone, 2189,
tracing (1.875 ms) : 1860, 1891
.   : milestone, 1875,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.273 ms [1.26 ms, 1.285 ms] -
iast 3.346 ms [3.3 ms, 3.393 ms] 2.074 ms (163.0%)
iast_FULL 5.917 ms [5.857 ms, 5.977 ms] 4.644 ms (365.0%)
iast_GLOBAL 3.942 ms [3.879 ms, 4.005 ms] 2.669 ms (209.7%)
profiling 2.252 ms [2.23 ms, 2.273 ms] 979.224 µs (76.9%)
tracing 1.9 ms [1.883 ms, 1.916 ms] 627.194 µs (49.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.238 ms [1.227 ms, 1.25 ms] -
iast 3.326 ms [3.281 ms, 3.371 ms] 2.088 ms (168.6%)
iast_FULL 6.237 ms [6.172 ms, 6.301 ms] 4.998 ms (403.6%)
iast_GLOBAL 3.669 ms [3.603 ms, 3.735 ms] 2.43 ms (196.3%)
profiling 2.189 ms [2.167 ms, 2.21 ms] 950.128 µs (76.7%)
tracing 1.875 ms [1.86 ms, 1.891 ms] 636.88 µs (51.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~b087d2c815, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.009 ms) : 18815, 19202
.   : milestone, 19009,
appsec (18.599 ms) : 18413, 18786
.   : milestone, 18599,
code_origins (18.006 ms) : 17830, 18182
.   : milestone, 18006,
iast (18.98 ms) : 18791, 19169
.   : milestone, 18980,
profiling (19.235 ms) : 19041, 19429
.   : milestone, 19235,
tracing (17.732 ms) : 17559, 17904
.   : milestone, 17732,
section candidate
no_agent (18.887 ms) : 18692, 19081
.   : milestone, 18887,
appsec (18.229 ms) : 18045, 18413
.   : milestone, 18229,
code_origins (17.768 ms) : 17594, 17941
.   : milestone, 17768,
iast (17.89 ms) : 17712, 18068
.   : milestone, 17890,
profiling (17.976 ms) : 17798, 18154
.   : milestone, 17976,
tracing (18.068 ms) : 17889, 18247
.   : milestone, 18068,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.009 ms [18.815 ms, 19.202 ms] -
appsec 18.599 ms [18.413 ms, 18.786 ms] -409.7 µs (-2.2%)
code_origins 18.006 ms [17.83 ms, 18.182 ms] -1.003 ms (-5.3%)
iast 18.98 ms [18.791 ms, 19.169 ms] -29.052 µs (-0.2%)
profiling 19.235 ms [19.041 ms, 19.429 ms] 226.312 µs (1.2%)
tracing 17.732 ms [17.559 ms, 17.904 ms] -1.277 ms (-6.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.887 ms [18.692 ms, 19.081 ms] -
appsec 18.229 ms [18.045 ms, 18.413 ms] -657.1 µs (-3.5%)
code_origins 17.768 ms [17.594 ms, 17.941 ms] -1.119 ms (-5.9%)
iast 17.89 ms [17.712 ms, 18.068 ms] -996.692 µs (-5.3%)
profiling 17.976 ms [17.798 ms, 18.154 ms] -910.473 µs (-4.8%)
tracing 18.068 ms [17.889 ms, 18.247 ms] -818.775 µs (-4.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/groovy-to-java-doc
git_commit_date 1775834061 1776088566
git_commit_sha 5ab378f b087d2c
release_version 1.62.0-SNAPSHOT~5ab378f780 1.62.0-SNAPSHOT~b087d2c815
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1776091511 1776091511
ci_job_id 1589763280 1589763280
ci_pipeline_id 107370244 107370244
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-ekph55pv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-ekph55pv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~b087d2c815, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.493 ms) : 1482, 1505
.   : milestone, 1493,
appsec (2.535 ms) : 2481, 2590
.   : milestone, 2535,
iast (2.275 ms) : 2206, 2344
.   : milestone, 2275,
iast_GLOBAL (2.327 ms) : 2257, 2397
.   : milestone, 2327,
profiling (2.099 ms) : 2044, 2154
.   : milestone, 2099,
tracing (2.072 ms) : 2019, 2125
.   : milestone, 2072,
section candidate
no_agent (1.489 ms) : 1477, 1501
.   : milestone, 1489,
appsec (3.826 ms) : 3605, 4048
.   : milestone, 3826,
iast (2.284 ms) : 2215, 2353
.   : milestone, 2284,
iast_GLOBAL (2.32 ms) : 2251, 2390
.   : milestone, 2320,
profiling (2.101 ms) : 2045, 2156
.   : milestone, 2101,
tracing (2.082 ms) : 2028, 2135
.   : milestone, 2082,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.493 ms [1.482 ms, 1.505 ms] -
appsec 2.535 ms [2.481 ms, 2.59 ms] 1.042 ms (69.8%)
iast 2.275 ms [2.206 ms, 2.344 ms] 781.928 µs (52.4%)
iast_GLOBAL 2.327 ms [2.257 ms, 2.397 ms] 833.349 µs (55.8%)
profiling 2.099 ms [2.044 ms, 2.154 ms] 605.918 µs (40.6%)
tracing 2.072 ms [2.019 ms, 2.125 ms] 578.582 µs (38.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.489 ms [1.477 ms, 1.501 ms] -
appsec 3.826 ms [3.605 ms, 4.048 ms] 2.337 ms (157.0%)
iast 2.284 ms [2.215 ms, 2.353 ms] 794.695 µs (53.4%)
iast_GLOBAL 2.32 ms [2.251 ms, 2.39 ms] 831.253 µs (55.8%)
profiling 2.101 ms [2.045 ms, 2.156 ms] 611.604 µs (41.1%)
tracing 2.082 ms [2.028 ms, 2.135 ms] 592.585 µs (39.8%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~b087d2c815, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.057 s) : 15057000, 15057000
.   : milestone, 15057000,
appsec (14.852 s) : 14852000, 14852000
.   : milestone, 14852000,
iast (18.468 s) : 18468000, 18468000
.   : milestone, 18468000,
iast_GLOBAL (18.034 s) : 18034000, 18034000
.   : milestone, 18034000,
profiling (15.221 s) : 15221000, 15221000
.   : milestone, 15221000,
tracing (14.919 s) : 14919000, 14919000
.   : milestone, 14919000,
section candidate
no_agent (15.08 s) : 15080000, 15080000
.   : milestone, 15080000,
appsec (14.805 s) : 14805000, 14805000
.   : milestone, 14805000,
iast (18.502 s) : 18502000, 18502000
.   : milestone, 18502000,
iast_GLOBAL (18.203 s) : 18203000, 18203000
.   : milestone, 18203000,
profiling (14.975 s) : 14975000, 14975000
.   : milestone, 14975000,
tracing (14.926 s) : 14926000, 14926000
.   : milestone, 14926000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.057 s [15.057 s, 15.057 s] -
appsec 14.852 s [14.852 s, 14.852 s] -205.0 ms (-1.4%)
iast 18.468 s [18.468 s, 18.468 s] 3.411 s (22.7%)
iast_GLOBAL 18.034 s [18.034 s, 18.034 s] 2.977 s (19.8%)
profiling 15.221 s [15.221 s, 15.221 s] 164.0 ms (1.1%)
tracing 14.919 s [14.919 s, 14.919 s] -138.0 ms (-0.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.08 s [15.08 s, 15.08 s] -
appsec 14.805 s [14.805 s, 14.805 s] -275.0 ms (-1.8%)
iast 18.502 s [18.502 s, 18.502 s] 3.422 s (22.7%)
iast_GLOBAL 18.203 s [18.203 s, 18.203 s] 3.123 s (20.7%)
profiling 14.975 s [14.975 s, 14.975 s] -105.0 ms (-0.7%)
tracing 14.926 s [14.926 s, 14.926 s] -154.0 ms (-1.0%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

tag: ai generated Largely based on code generated by an AI or LLM tag: no release notes Changes to exclude from release notes type: documentation

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@PerfectSlayer