Closed
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 12 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~6df1615e3b, baseline=1.50.0-SNAPSHOT~089cf8fd47
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.029 s) : 0, 1029187
Total [baseline] (8.514 s) : 0, 8513631
Agent [candidate] (1.028 s) : 0, 1028246
Total [candidate] (8.549 s) : 0, 8549169
section iast
Agent [baseline] (1.155 s) : 0, 1154534
Total [baseline] (9.205 s) : 0, 9204825
Agent [candidate] (1.15 s) : 0, 1150016
Total [candidate] (9.171 s) : 0, 9171397
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.15 s) : 0, 1149766
Total [baseline] (9.144 s) : 0, 9143980
Agent [candidate] (1.152 s) : 0, 1152496
Total [candidate] (9.139 s) : 0, 9138885
section iast_TELEMETRY_OFF
Agent [baseline] (1.148 s) : 0, 1148217
Total [baseline] (9.252 s) : 0, 9251795
Agent [candidate] (1.147 s) : 0, 1146627
Total [candidate] (9.221 s) : 0, 9220572
gantt
title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~6df1615e3b, baseline=1.50.0-SNAPSHOT~089cf8fd47
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.816 ms) : 0, 687816
BytebuddyAgent [candidate] (686.904 ms) : 0, 686904
GlobalTracer [baseline] (240.89 ms) : 0, 240890
GlobalTracer [candidate] (241.357 ms) : 0, 241357
AppSec [baseline] (57.019 ms) : 0, 57019
AppSec [candidate] (57.186 ms) : 0, 57186
Debugger [baseline] (6.142 ms) : 0, 6142
Debugger [candidate] (6.195 ms) : 0, 6195
Remote Config [baseline] (736.727 µs) : 0, 737
Remote Config [candidate] (728.186 µs) : 0, 728
Telemetry [baseline] (12.903 ms) : 0, 12903
Telemetry [candidate] (12.163 ms) : 0, 12163
section iast
BytebuddyAgent [baseline] (804.63 ms) : 0, 804630
BytebuddyAgent [candidate] (801.704 ms) : 0, 801704
GlobalTracer [baseline] (231.912 ms) : 0, 231912
GlobalTracer [candidate] (230.841 ms) : 0, 230841
IAST [baseline] (26.301 ms) : 0, 26301
IAST [candidate] (27.682 ms) : 0, 27682
AppSec [baseline] (53.446 ms) : 0, 53446
AppSec [candidate] (51.783 ms) : 0, 51783
Debugger [baseline] (6.045 ms) : 0, 6045
Debugger [candidate] (6.003 ms) : 0, 6003
Remote Config [baseline] (619.157 µs) : 0, 619
Remote Config [candidate] (589.887 µs) : 0, 590
Telemetry [baseline] (7.98 ms) : 0, 7980
Telemetry [candidate] (7.857 ms) : 0, 7857
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (801.346 ms) : 0, 801346
BytebuddyAgent [candidate] (802.949 ms) : 0, 802949
GlobalTracer [baseline] (230.771 ms) : 0, 230771
GlobalTracer [candidate] (231.25 ms) : 0, 231250
IAST [baseline] (29.336 ms) : 0, 29336
IAST [candidate] (26.391 ms) : 0, 26391
AppSec [baseline] (50.284 ms) : 0, 50284
AppSec [candidate] (53.671 ms) : 0, 53671
Debugger [baseline] (5.982 ms) : 0, 5982
Debugger [candidate] (6.022 ms) : 0, 6022
Remote Config [baseline] (595.896 µs) : 0, 596
Remote Config [candidate] (597.872 µs) : 0, 598
Telemetry [baseline] (7.955 ms) : 0, 7955
Telemetry [candidate] (7.992 ms) : 0, 7992
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (800.175 ms) : 0, 800175
BytebuddyAgent [candidate] (798.926 ms) : 0, 798926
GlobalTracer [baseline] (230.926 ms) : 0, 230926
GlobalTracer [candidate] (230.83 ms) : 0, 230830
IAST [baseline] (28.065 ms) : 0, 28065
IAST [candidate] (29.38 ms) : 0, 29380
AppSec [baseline] (50.988 ms) : 0, 50988
AppSec [candidate] (49.5 ms) : 0, 49500
Debugger [baseline] (6.015 ms) : 0, 6015
Debugger [candidate] (5.96 ms) : 0, 5960
Remote Config [baseline] (608.53 µs) : 0, 609
Remote Config [candidate] (589.304 µs) : 0, 589
Telemetry [baseline] (7.886 ms) : 0, 7886
Telemetry [candidate] (7.906 ms) : 0, 7906
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~6df1615e3b, baseline=1.50.0-SNAPSHOT~089cf8fd47
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.03 s) : 0, 1029872
Total [baseline] (11.214 s) : 0, 11213930
Agent [candidate] (1.03 s) : 0, 1030049
Total [candidate] (11.171 s) : 0, 11170976
section appsec
Agent [baseline] (1.162 s) : 0, 1161731
Total [baseline] (11.23 s) : 0, 11230227
Agent [candidate] (1.172 s) : 0, 1171545
Total [candidate] (11.32 s) : 0, 11320159
section iast
Agent [baseline] (1.158 s) : 0, 1157546
Total [baseline] (11.37 s) : 0, 11369940
Agent [candidate] (1.152 s) : 0, 1152094
Total [candidate] (11.394 s) : 0, 11394338
section profiling
Agent [baseline] (1.281 s) : 0, 1280533
Total [baseline] (11.578 s) : 0, 11577615
Agent [candidate] (1.274 s) : 0, 1273773
Total [candidate] (11.543 s) : 0, 11542823
gantt
title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~6df1615e3b, baseline=1.50.0-SNAPSHOT~089cf8fd47
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.4 ms) : 0, 688400
BytebuddyAgent [candidate] (687.751 ms) : 0, 687751
GlobalTracer [baseline] (242.323 ms) : 0, 242323
GlobalTracer [candidate] (241.856 ms) : 0, 241856
AppSec [baseline] (56.744 ms) : 0, 56744
AppSec [candidate] (56.729 ms) : 0, 56729
Debugger [baseline] (6.249 ms) : 0, 6249
Debugger [candidate] (6.229 ms) : 0, 6229
Remote Config [baseline] (736.96 µs) : 0, 737
Remote Config [candidate] (749.827 µs) : 0, 750
Telemetry [baseline] (11.575 ms) : 0, 11575
Telemetry [candidate] (12.979 ms) : 0, 12979
section appsec
BytebuddyAgent [baseline] (698.973 ms) : 0, 698973
BytebuddyAgent [candidate] (706.266 ms) : 0, 706266
GlobalTracer [baseline] (237.319 ms) : 0, 237319
GlobalTracer [candidate] (239.5 ms) : 0, 239500
AppSec [baseline] (177.036 ms) : 0, 177036
AppSec [candidate] (177.016 ms) : 0, 177016
Debugger [baseline] (5.969 ms) : 0, 5969
Debugger [candidate] (6.015 ms) : 0, 6015
Remote Config [baseline] (628.757 µs) : 0, 629
Remote Config [candidate] (631.461 µs) : 0, 631
Telemetry [baseline] (7.365 ms) : 0, 7365
Telemetry [candidate] (7.368 ms) : 0, 7368
IAST [baseline] (21.835 ms) : 0, 21835
IAST [candidate] (21.911 ms) : 0, 21911
section iast
BytebuddyAgent [baseline] (807.19 ms) : 0, 807190
BytebuddyAgent [candidate] (803.121 ms) : 0, 803121
GlobalTracer [baseline] (232.115 ms) : 0, 232115
GlobalTracer [candidate] (231.04 ms) : 0, 231040
AppSec [baseline] (54.464 ms) : 0, 54464
AppSec [candidate] (52.858 ms) : 0, 52858
Debugger [baseline] (6.04 ms) : 0, 6040
Debugger [candidate] (5.997 ms) : 0, 5997
Remote Config [baseline] (588.932 µs) : 0, 589
Remote Config [candidate] (606.063 µs) : 0, 606
Telemetry [baseline] (7.956 ms) : 0, 7956
Telemetry [candidate] (7.977 ms) : 0, 7977
IAST [baseline] (25.511 ms) : 0, 25511
IAST [candidate] (26.897 ms) : 0, 26897
section profiling
ProfilingAgent [baseline] (103.672 ms) : 0, 103672
ProfilingAgent [candidate] (104.114 ms) : 0, 104114
BytebuddyAgent [baseline] (684.634 ms) : 0, 684634
BytebuddyAgent [candidate] (679.564 ms) : 0, 679564
GlobalTracer [baseline] (363.002 ms) : 0, 363002
GlobalTracer [candidate] (361.801 ms) : 0, 361801
AppSec [baseline] (62.504 ms) : 0, 62504
AppSec [candidate] (62.242 ms) : 0, 62242
Debugger [baseline] (6.176 ms) : 0, 6176
Debugger [candidate] (6.175 ms) : 0, 6175
Remote Config [baseline] (672.316 µs) : 0, 672
Remote Config [candidate] (676.828 µs) : 0, 677
Telemetry [baseline] (8.267 ms) : 0, 8267
Telemetry [candidate] (8.202 ms) : 0, 8202
Profiling [baseline] (103.698 ms) : 0, 103698
Profiling [candidate] (104.138 ms) : 0, 104138
LoadParameters
See matching parameters
SummaryFound 2 performance improvements and 6 performance regressions! Performance is the same for 5 metrics, 17 unstable metrics.
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~6df1615e3b, baseline=1.50.0-SNAPSHOT~089cf8fd47
dateFormat X
axisFormat %s
section baseline
no_agent (15.503 s) : 15503000, 15503000
. : milestone, 15503000,
appsec (14.706 s) : 14706000, 14706000
. : milestone, 14706000,
iast (18.778 s) : 18778000, 18778000
. : milestone, 18778000,
iast_GLOBAL (18.091 s) : 18091000, 18091000
. : milestone, 18091000,
profiling (15.233 s) : 15233000, 15233000
. : milestone, 15233000,
tracing (14.865 s) : 14865000, 14865000
. : milestone, 14865000,
section candidate
no_agent (15.66 s) : 15660000, 15660000
. : milestone, 15660000,
appsec (14.909 s) : 14909000, 14909000
. : milestone, 14909000,
iast (18.354 s) : 18354000, 18354000
. : milestone, 18354000,
iast_GLOBAL (18.147 s) : 18147000, 18147000
. : milestone, 18147000,
profiling (15.116 s) : 15116000, 15116000
. : milestone, 15116000,
tracing (14.914 s) : 14914000, 14914000
. : milestone, 14914000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~6df1615e3b, baseline=1.50.0-SNAPSHOT~089cf8fd47
dateFormat X
axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
. : milestone, 1471,
appsec (2.396 ms) : 2348, 2445
. : milestone, 2396,
iast (2.187 ms) : 2125, 2248
. : milestone, 2187,
iast_GLOBAL (2.224 ms) : 2163, 2286
. : milestone, 2224,
profiling (2.043 ms) : 1992, 2093
. : milestone, 2043,
tracing (2.004 ms) : 1956, 2051
. : milestone, 2004,
section candidate
no_agent (1.468 ms) : 1456, 1479
. : milestone, 1468,
appsec (2.395 ms) : 2346, 2443
. : milestone, 2395,
iast (2.185 ms) : 2124, 2247
. : milestone, 2185,
iast_GLOBAL (2.222 ms) : 2160, 2283
. : milestone, 2222,
profiling (2.48 ms) : 2303, 2656
. : milestone, 2480,
tracing (1.995 ms) : 1948, 2043
. : milestone, 1995,
|
511afa2 to
6df1615
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
Try to increase the probability that the JVM will trigger a full gc and unload classes by massively allocating memory
Motivation
Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any usefull labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]