Update smoke test latest tool versions#11203
Closed
dd-octo-sts[bot] wants to merge 1 commit intomasterfrom
Closed
Conversation
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~49514354c2, baseline=1.62.0-SNAPSHOT~c9fa3658295
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1057254
Total [baseline] (11.089 s) : 0, 11089465
Agent [candidate] (1.058 s) : 0, 1057776
Total [candidate] (11.052 s) : 0, 11051539
section appsec
Agent [baseline] (1.263 s) : 0, 1263027
Total [baseline] (11.049 s) : 0, 11049361
Agent [candidate] (1.262 s) : 0, 1262143
Total [candidate] (11.084 s) : 0, 11083968
section iast
Agent [baseline] (1.234 s) : 0, 1234123
Total [baseline] (11.339 s) : 0, 11338751
Agent [candidate] (1.246 s) : 0, 1246168
Total [candidate] (11.283 s) : 0, 11283345
section profiling
Agent [baseline] (1.183 s) : 0, 1183485
Total [baseline] (11.044 s) : 0, 11044479
Agent [candidate] (1.186 s) : 0, 1185645
Total [candidate] (11.04 s) : 0, 11040087
gantt
title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~49514354c2, baseline=1.62.0-SNAPSHOT~c9fa3658295
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.235 ms) : 0, 1235
crashtracking [candidate] (1.216 ms) : 0, 1216
BytebuddyAgent [baseline] (635.471 ms) : 0, 635471
BytebuddyAgent [candidate] (635.76 ms) : 0, 635760
AgentMeter [baseline] (29.373 ms) : 0, 29373
AgentMeter [candidate] (29.395 ms) : 0, 29395
GlobalTracer [baseline] (248.496 ms) : 0, 248496
GlobalTracer [candidate] (249.12 ms) : 0, 249120
AppSec [baseline] (32.329 ms) : 0, 32329
AppSec [candidate] (32.456 ms) : 0, 32456
Debugger [baseline] (60.446 ms) : 0, 60446
Debugger [candidate] (60.699 ms) : 0, 60699
Remote Config [baseline] (598.193 µs) : 0, 598
Remote Config [candidate] (599.86 µs) : 0, 600
Telemetry [baseline] (7.996 ms) : 0, 7996
Telemetry [candidate] (8.11 ms) : 0, 8110
Flare Poller [baseline] (5.189 ms) : 0, 5189
Flare Poller [candidate] (4.362 ms) : 0, 4362
section appsec
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.235 ms) : 0, 1235
BytebuddyAgent [baseline] (676.092 ms) : 0, 676092
BytebuddyAgent [candidate] (675.627 ms) : 0, 675627
AgentMeter [baseline] (12.188 ms) : 0, 12188
AgentMeter [candidate] (12.242 ms) : 0, 12242
GlobalTracer [baseline] (248.767 ms) : 0, 248767
GlobalTracer [candidate] (248.822 ms) : 0, 248822
IAST [baseline] (24.193 ms) : 0, 24193
IAST [candidate] (24.185 ms) : 0, 24185
AppSec [baseline] (187.487 ms) : 0, 187487
AppSec [candidate] (185.74 ms) : 0, 185740
Debugger [baseline] (64.889 ms) : 0, 64889
Debugger [candidate] (65.96 ms) : 0, 65960
Remote Config [baseline] (577.396 µs) : 0, 577
Remote Config [candidate] (582.668 µs) : 0, 583
Telemetry [baseline] (7.874 ms) : 0, 7874
Telemetry [candidate] (7.868 ms) : 0, 7868
Flare Poller [baseline] (3.457 ms) : 0, 3457
Flare Poller [candidate] (3.433 ms) : 0, 3433
section iast
crashtracking [baseline] (1.224 ms) : 0, 1224
crashtracking [candidate] (1.234 ms) : 0, 1234
BytebuddyAgent [baseline] (810.548 ms) : 0, 810548
BytebuddyAgent [candidate] (820.289 ms) : 0, 820289
AgentMeter [baseline] (11.396 ms) : 0, 11396
AgentMeter [candidate] (11.604 ms) : 0, 11604
GlobalTracer [baseline] (239.505 ms) : 0, 239505
GlobalTracer [candidate] (241.129 ms) : 0, 241129
IAST [baseline] (29.072 ms) : 0, 29072
IAST [candidate] (27.517 ms) : 0, 27517
AppSec [baseline] (27.713 ms) : 0, 27713
AppSec [candidate] (29.542 ms) : 0, 29542
Debugger [baseline] (66.831 ms) : 0, 66831
Debugger [candidate] (66.732 ms) : 0, 66732
Remote Config [baseline] (535.333 µs) : 0, 535
Remote Config [candidate] (531.169 µs) : 0, 531
Telemetry [baseline] (7.798 ms) : 0, 7798
Telemetry [candidate] (7.846 ms) : 0, 7846
Flare Poller [baseline] (3.455 ms) : 0, 3455
Flare Poller [candidate] (3.472 ms) : 0, 3472
section profiling
crashtracking [baseline] (1.214 ms) : 0, 1214
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (691.152 ms) : 0, 691152
BytebuddyAgent [candidate] (693.204 ms) : 0, 693204
AgentMeter [baseline] (8.914 ms) : 0, 8914
AgentMeter [candidate] (9.008 ms) : 0, 9008
GlobalTracer [baseline] (207.463 ms) : 0, 207463
GlobalTracer [candidate] (207.444 ms) : 0, 207444
AppSec [baseline] (32.493 ms) : 0, 32493
AppSec [candidate] (32.463 ms) : 0, 32463
Debugger [baseline] (65.498 ms) : 0, 65498
Debugger [candidate] (65.78 ms) : 0, 65780
Remote Config [baseline] (593.055 µs) : 0, 593
Remote Config [candidate] (568.623 µs) : 0, 569
Telemetry [baseline] (7.837 ms) : 0, 7837
Telemetry [candidate] (7.785 ms) : 0, 7785
Flare Poller [baseline] (3.477 ms) : 0, 3477
Flare Poller [candidate] (3.463 ms) : 0, 3463
ProfilingAgent [baseline] (93.383 ms) : 0, 93383
ProfilingAgent [candidate] (93.319 ms) : 0, 93319
Profiling [baseline] (93.94 ms) : 0, 93940
Profiling [candidate] (93.878 ms) : 0, 93878
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~49514354c2, baseline=1.62.0-SNAPSHOT~c9fa3658295
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1055009
Total [baseline] (8.849 s) : 0, 8848823
Agent [candidate] (1.063 s) : 0, 1063041
Total [candidate] (8.835 s) : 0, 8835338
section iast
Agent [baseline] (1.242 s) : 0, 1241739
Total [baseline] (9.558 s) : 0, 9558042
Agent [candidate] (1.232 s) : 0, 1231707
Total [candidate] (9.523 s) : 0, 9523284
gantt
title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~49514354c2, baseline=1.62.0-SNAPSHOT~c9fa3658295
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.231 ms) : 0, 1231
BytebuddyAgent [baseline] (635.201 ms) : 0, 635201
BytebuddyAgent [candidate] (640.175 ms) : 0, 640175
AgentMeter [baseline] (29.25 ms) : 0, 29250
AgentMeter [candidate] (29.617 ms) : 0, 29617
GlobalTracer [baseline] (248.811 ms) : 0, 248811
GlobalTracer [candidate] (250.924 ms) : 0, 250924
AppSec [baseline] (32.268 ms) : 0, 32268
AppSec [candidate] (32.515 ms) : 0, 32515
Debugger [baseline] (59.32 ms) : 0, 59320
Debugger [candidate] (60.1 ms) : 0, 60100
Remote Config [baseline] (614.55 µs) : 0, 615
Remote Config [candidate] (597.393 µs) : 0, 597
Telemetry [baseline] (7.994 ms) : 0, 7994
Telemetry [candidate] (8.062 ms) : 0, 8062
Flare Poller [baseline] (4.289 ms) : 0, 4289
Flare Poller [candidate] (3.566 ms) : 0, 3566
section iast
crashtracking [baseline] (1.226 ms) : 0, 1226
crashtracking [candidate] (1.212 ms) : 0, 1212
BytebuddyAgent [baseline] (816.641 ms) : 0, 816641
BytebuddyAgent [candidate] (810.221 ms) : 0, 810221
AgentMeter [baseline] (11.489 ms) : 0, 11489
AgentMeter [candidate] (11.36 ms) : 0, 11360
GlobalTracer [baseline] (240.525 ms) : 0, 240525
GlobalTracer [candidate] (239.019 ms) : 0, 239019
IAST [baseline] (26.855 ms) : 0, 26855
IAST [candidate] (29.98 ms) : 0, 29980
AppSec [baseline] (28.321 ms) : 0, 28321
AppSec [candidate] (29.094 ms) : 0, 29094
Debugger [baseline] (68.49 ms) : 0, 68490
Debugger [candidate] (63.107 ms) : 0, 63107
Remote Config [baseline] (540.597 µs) : 0, 541
Remote Config [candidate] (530.113 µs) : 0, 530
Telemetry [baseline] (7.895 ms) : 0, 7895
Telemetry [candidate] (7.729 ms) : 0, 7729
Flare Poller [baseline] (3.518 ms) : 0, 3518
Flare Poller [candidate] (3.413 ms) : 0, 3413
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 2 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~49514354c2, baseline=1.62.0-SNAPSHOT~c9fa3658295
dateFormat X
axisFormat %s
section baseline
no_agent (19.39 ms) : 19194, 19586
. : milestone, 19390,
appsec (18.842 ms) : 18648, 19036
. : milestone, 18842,
code_origins (17.913 ms) : 17739, 18087
. : milestone, 17913,
iast (18.061 ms) : 17880, 18242
. : milestone, 18061,
profiling (18.552 ms) : 18366, 18739
. : milestone, 18552,
tracing (17.81 ms) : 17634, 17986
. : milestone, 17810,
section candidate
no_agent (18.305 ms) : 18119, 18491
. : milestone, 18305,
appsec (18.745 ms) : 18552, 18938
. : milestone, 18745,
code_origins (17.889 ms) : 17714, 18064
. : milestone, 17889,
iast (17.807 ms) : 17633, 17982
. : milestone, 17807,
profiling (18.402 ms) : 18221, 18583
. : milestone, 18402,
tracing (18.868 ms) : 18675, 19061
. : milestone, 18868,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~49514354c2, baseline=1.62.0-SNAPSHOT~c9fa3658295
dateFormat X
axisFormat %s
section baseline
no_agent (1.266 ms) : 1253, 1278
. : milestone, 1266,
iast (3.316 ms) : 3269, 3363
. : milestone, 3316,
iast_FULL (6.173 ms) : 6110, 6236
. : milestone, 6173,
iast_GLOBAL (3.884 ms) : 3819, 3949
. : milestone, 3884,
profiling (2.244 ms) : 2223, 2265
. : milestone, 2244,
tracing (1.883 ms) : 1867, 1900
. : milestone, 1883,
section candidate
no_agent (1.239 ms) : 1228, 1250
. : milestone, 1239,
iast (3.325 ms) : 3271, 3379
. : milestone, 3325,
iast_FULL (6.097 ms) : 6035, 6160
. : milestone, 6097,
iast_GLOBAL (3.772 ms) : 3709, 3835
. : milestone, 3772,
profiling (2.285 ms) : 2264, 2307
. : milestone, 2285,
tracing (1.91 ms) : 1893, 1926
. : milestone, 1910,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~49514354c2, baseline=1.62.0-SNAPSHOT~c9fa3658295
dateFormat X
axisFormat %s
section baseline
no_agent (1.488 ms) : 1476, 1499
. : milestone, 1488,
appsec (2.556 ms) : 2501, 2612
. : milestone, 2556,
iast (2.284 ms) : 2214, 2354
. : milestone, 2284,
iast_GLOBAL (2.325 ms) : 2254, 2395
. : milestone, 2325,
profiling (2.101 ms) : 2046, 2156
. : milestone, 2101,
tracing (2.088 ms) : 2034, 2142
. : milestone, 2088,
section candidate
no_agent (1.489 ms) : 1477, 1500
. : milestone, 1489,
appsec (3.822 ms) : 3600, 4044
. : milestone, 3822,
iast (2.276 ms) : 2206, 2347
. : milestone, 2276,
iast_GLOBAL (2.33 ms) : 2259, 2401
. : milestone, 2330,
profiling (2.103 ms) : 2048, 2158
. : milestone, 2103,
tracing (2.087 ms) : 2033, 2141
. : milestone, 2087,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~49514354c2, baseline=1.62.0-SNAPSHOT~c9fa3658295
dateFormat X
axisFormat %s
section baseline
no_agent (15.073 s) : 15073000, 15073000
. : milestone, 15073000,
appsec (14.615 s) : 14615000, 14615000
. : milestone, 14615000,
iast (18.517 s) : 18517000, 18517000
. : milestone, 18517000,
iast_GLOBAL (18.118 s) : 18118000, 18118000
. : milestone, 18118000,
profiling (15.349 s) : 15349000, 15349000
. : milestone, 15349000,
tracing (14.785 s) : 14785000, 14785000
. : milestone, 14785000,
section candidate
no_agent (15.421 s) : 15421000, 15421000
. : milestone, 15421000,
appsec (14.526 s) : 14526000, 14526000
. : milestone, 14526000,
iast (18.694 s) : 18694000, 18694000
. : milestone, 18694000,
iast_GLOBAL (17.75 s) : 17750000, 17750000
. : milestone, 17750000,
profiling (15.008 s) : 15008000, 15008000
. : milestone, 15008000,
tracing (15.145 s) : 15145000, 15145000
. : milestone, 15145000,
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
This PR updates the pinned "latest" tool versions used by CI Visibility smoke tests:
Motivation
Keep smoke tests running against the latest stable versions of build tools.
Contributor Checklist