Update smoke test latest tool versions#10845
Closed
dd-octo-sts[bot] wants to merge 1 commit intomasterfrom
Closed
Conversation
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1061755
Total [baseline] (11.057 s) : 0, 11056962
Agent [candidate] (1.06 s) : 0, 1059549
Total [candidate] (11.032 s) : 0, 11031593
section appsec
Agent [baseline] (1.247 s) : 0, 1246917
Total [baseline] (11.144 s) : 0, 11143746
Agent [candidate] (1.245 s) : 0, 1244962
Total [candidate] (11.247 s) : 0, 11247138
section iast
Agent [baseline] (1.225 s) : 0, 1224682
Total [baseline] (11.343 s) : 0, 11342674
Agent [candidate] (1.224 s) : 0, 1223837
Total [candidate] (11.389 s) : 0, 11388908
section profiling
Agent [baseline] (1.182 s) : 0, 1181889
Total [baseline] (11.066 s) : 0, 11066060
Agent [candidate] (1.203 s) : 0, 1202824
Total [candidate] (11.033 s) : 0, 11032800
gantt
title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (629.026 ms) : 0, 629026
BytebuddyAgent [candidate] (629.229 ms) : 0, 629229
AgentMeter [baseline] (29.135 ms) : 0, 29135
AgentMeter [candidate] (29.159 ms) : 0, 29159
GlobalTracer [baseline] (257.645 ms) : 0, 257645
GlobalTracer [candidate] (256.852 ms) : 0, 256852
AppSec [baseline] (31.654 ms) : 0, 31654
AppSec [candidate] (31.434 ms) : 0, 31434
Debugger [baseline] (59.699 ms) : 0, 59699
Debugger [candidate] (59.219 ms) : 0, 59219
Remote Config [baseline] (613.839 µs) : 0, 614
Remote Config [candidate] (623.781 µs) : 0, 624
Telemetry [baseline] (8.769 ms) : 0, 8769
Telemetry [candidate] (8.655 ms) : 0, 8655
Flare Poller [baseline] (8.023 ms) : 0, 8023
Flare Poller [candidate] (7.247 ms) : 0, 7247
section appsec
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (659.963 ms) : 0, 659963
BytebuddyAgent [candidate] (656.944 ms) : 0, 656944
AgentMeter [baseline] (12.005 ms) : 0, 12005
AgentMeter [candidate] (12.068 ms) : 0, 12068
GlobalTracer [baseline] (257.201 ms) : 0, 257201
GlobalTracer [candidate] (258.68 ms) : 0, 258680
AppSec [baseline] (177.339 ms) : 0, 177339
AppSec [candidate] (176.705 ms) : 0, 176705
Debugger [baseline] (65.646 ms) : 0, 65646
Debugger [candidate] (65.816 ms) : 0, 65816
Remote Config [baseline] (582.872 µs) : 0, 583
Remote Config [candidate] (574.967 µs) : 0, 575
Telemetry [baseline] (9.108 ms) : 0, 9108
Telemetry [candidate] (9.155 ms) : 0, 9155
Flare Poller [baseline] (3.608 ms) : 0, 3608
Flare Poller [candidate] (3.708 ms) : 0, 3708
IAST [baseline] (23.955 ms) : 0, 23955
IAST [candidate] (23.926 ms) : 0, 23926
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (793.865 ms) : 0, 793865
BytebuddyAgent [candidate] (793.405 ms) : 0, 793405
AgentMeter [baseline] (11.3 ms) : 0, 11300
AgentMeter [candidate] (11.307 ms) : 0, 11307
GlobalTracer [baseline] (246.791 ms) : 0, 246791
GlobalTracer [candidate] (246.774 ms) : 0, 246774
AppSec [baseline] (26.432 ms) : 0, 26432
AppSec [candidate] (26.422 ms) : 0, 26422
Debugger [baseline] (63.915 ms) : 0, 63915
Debugger [candidate] (64.233 ms) : 0, 64233
Remote Config [baseline] (515.997 µs) : 0, 516
Remote Config [candidate] (516.444 µs) : 0, 516
Telemetry [baseline] (14.717 ms) : 0, 14717
Telemetry [candidate] (14.229 ms) : 0, 14229
Flare Poller [baseline] (4.905 ms) : 0, 4905
Flare Poller [candidate] (4.782 ms) : 0, 4782
IAST [baseline] (25.128 ms) : 0, 25128
IAST [candidate] (25.043 ms) : 0, 25043
section profiling
ProfilingAgent [baseline] (93.711 ms) : 0, 93711
ProfilingAgent [candidate] (94.238 ms) : 0, 94238
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (682.124 ms) : 0, 682124
BytebuddyAgent [candidate] (695.851 ms) : 0, 695851
AgentMeter [baseline] (8.644 ms) : 0, 8644
AgentMeter [candidate] (8.808 ms) : 0, 8808
GlobalTracer [baseline] (215.662 ms) : 0, 215662
GlobalTracer [candidate] (219.171 ms) : 0, 219171
AppSec [baseline] (31.911 ms) : 0, 31911
AppSec [candidate] (32.752 ms) : 0, 32752
Debugger [baseline] (62.397 ms) : 0, 62397
Debugger [candidate] (65.81 ms) : 0, 65810
Remote Config [baseline] (589.103 µs) : 0, 589
Remote Config [candidate] (587.981 µs) : 0, 588
Telemetry [baseline] (11.352 ms) : 0, 11352
Telemetry [candidate] (9.003 ms) : 0, 9003
Flare Poller [baseline] (3.522 ms) : 0, 3522
Flare Poller [candidate] (3.56 ms) : 0, 3560
Profiling [baseline] (94.284 ms) : 0, 94284
Profiling [candidate] (94.804 ms) : 0, 94804
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1062869
Total [baseline] (8.868 s) : 0, 8867802
Agent [candidate] (1.064 s) : 0, 1063988
Total [candidate] (8.802 s) : 0, 8801859
section iast
Agent [baseline] (1.231 s) : 0, 1231478
Total [baseline] (9.597 s) : 0, 9596984
Agent [candidate] (1.227 s) : 0, 1226878
Total [candidate] (9.544 s) : 0, 9543619
gantt
title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (627.912 ms) : 0, 627912
BytebuddyAgent [candidate] (631.243 ms) : 0, 631243
AgentMeter [baseline] (29.296 ms) : 0, 29296
AgentMeter [candidate] (29.232 ms) : 0, 29232
GlobalTracer [baseline] (258.123 ms) : 0, 258123
GlobalTracer [candidate] (258.099 ms) : 0, 258099
AppSec [baseline] (31.726 ms) : 0, 31726
AppSec [candidate] (31.778 ms) : 0, 31778
Debugger [baseline] (58.942 ms) : 0, 58942
Debugger [candidate] (58.991 ms) : 0, 58991
Remote Config [baseline] (626.707 µs) : 0, 627
Remote Config [candidate] (633.035 µs) : 0, 633
Telemetry [baseline] (8.749 ms) : 0, 8749
Telemetry [candidate] (8.788 ms) : 0, 8788
Flare Poller [baseline] (10.289 ms) : 0, 10289
Flare Poller [candidate] (7.908 ms) : 0, 7908
section iast
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (799.509 ms) : 0, 799509
BytebuddyAgent [candidate] (796.381 ms) : 0, 796381
AgentMeter [baseline] (11.408 ms) : 0, 11408
AgentMeter [candidate] (11.335 ms) : 0, 11335
GlobalTracer [baseline] (248.579 ms) : 0, 248579
GlobalTracer [candidate] (247.218 ms) : 0, 247218
IAST [baseline] (25.201 ms) : 0, 25201
IAST [candidate] (25.192 ms) : 0, 25192
AppSec [baseline] (26.43 ms) : 0, 26430
AppSec [candidate] (26.413 ms) : 0, 26413
Debugger [baseline] (62.691 ms) : 0, 62691
Debugger [candidate] (62.912 ms) : 0, 62912
Remote Config [baseline] (518.16 µs) : 0, 518
Remote Config [candidate] (536.357 µs) : 0, 536
Telemetry [baseline] (14.866 ms) : 0, 14866
Telemetry [candidate] (14.75 ms) : 0, 14750
Flare Poller [baseline] (4.905 ms) : 0, 4905
Flare Poller [candidate] (4.899 ms) : 0, 4899
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 19 metrics, 16 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b
dateFormat X
axisFormat %s
section baseline
no_agent (1.173 ms) : 1161, 1184
. : milestone, 1173,
iast (3.193 ms) : 3150, 3237
. : milestone, 3193,
iast_FULL (5.916 ms) : 5856, 5976
. : milestone, 5916,
iast_GLOBAL (3.355 ms) : 3306, 3405
. : milestone, 3355,
profiling (2.0 ms) : 1982, 2018
. : milestone, 2000,
tracing (1.775 ms) : 1761, 1789
. : milestone, 1775,
section candidate
no_agent (1.169 ms) : 1158, 1180
. : milestone, 1169,
iast (3.193 ms) : 3151, 3235
. : milestone, 3193,
iast_FULL (5.88 ms) : 5821, 5940
. : milestone, 5880,
iast_GLOBAL (3.451 ms) : 3396, 3506
. : milestone, 3451,
profiling (1.93 ms) : 1913, 1947
. : milestone, 1930,
tracing (1.839 ms) : 1822, 1855
. : milestone, 1839,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b
dateFormat X
axisFormat %s
section baseline
no_agent (19.171 ms) : 18973, 19369
. : milestone, 19171,
appsec (19.712 ms) : 19508, 19916
. : milestone, 19712,
code_origins (17.725 ms) : 17547, 17903
. : milestone, 17725,
iast (18.121 ms) : 17943, 18299
. : milestone, 18121,
profiling (18.675 ms) : 18493, 18856
. : milestone, 18675,
tracing (17.66 ms) : 17486, 17834
. : milestone, 17660,
section candidate
no_agent (17.982 ms) : 17796, 18168
. : milestone, 17982,
appsec (19.534 ms) : 19338, 19730
. : milestone, 19534,
code_origins (17.615 ms) : 17440, 17790
. : milestone, 17615,
iast (18.595 ms) : 18407, 18784
. : milestone, 18595,
profiling (18.945 ms) : 18756, 19135
. : milestone, 18945,
tracing (17.729 ms) : 17554, 17904
. : milestone, 17729,
DacapoParameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b
dateFormat X
axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
. : milestone, 1473,
appsec (3.779 ms) : 3559, 3999
. : milestone, 3779,
iast (2.238 ms) : 2170, 2307
. : milestone, 2238,
iast_GLOBAL (2.291 ms) : 2222, 2360
. : milestone, 2291,
profiling (2.498 ms) : 2285, 2712
. : milestone, 2498,
tracing (2.066 ms) : 2013, 2120
. : milestone, 2066,
section candidate
no_agent (1.47 ms) : 1458, 1481
. : milestone, 1470,
appsec (2.504 ms) : 2450, 2559
. : milestone, 2504,
iast (2.242 ms) : 2173, 2311
. : milestone, 2242,
iast_GLOBAL (2.292 ms) : 2222, 2361
. : milestone, 2292,
profiling (2.088 ms) : 2032, 2144
. : milestone, 2088,
tracing (2.044 ms) : 1991, 2097
. : milestone, 2044,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~8185dcf699b, baseline=1.61.0-SNAPSHOT~8185dcf699b
dateFormat X
axisFormat %s
section baseline
no_agent (15.059 s) : 15059000, 15059000
. : milestone, 15059000,
appsec (14.913 s) : 14913000, 14913000
. : milestone, 14913000,
iast (18.115 s) : 18115000, 18115000
. : milestone, 18115000,
iast_GLOBAL (17.792 s) : 17792000, 17792000
. : milestone, 17792000,
profiling (15.06 s) : 15060000, 15060000
. : milestone, 15060000,
tracing (15.074 s) : 15074000, 15074000
. : milestone, 15074000,
section candidate
no_agent (15.262 s) : 15262000, 15262000
. : milestone, 15262000,
appsec (15.011 s) : 15011000, 15011000
. : milestone, 15011000,
iast (18.135 s) : 18135000, 18135000
. : milestone, 18135000,
iast_GLOBAL (17.675 s) : 17675000, 17675000
. : milestone, 17675000,
profiling (15.179 s) : 15179000, 15179000
. : milestone, 15179000,
tracing (15.076 s) : 15076000, 15076000
. : milestone, 15076000,
|
Contributor
|
Good bot, but we want to keep testing against the non-final release version in Maven. Closing until a real upgrade. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
This PR updates the pinned "latest" tool versions used by CI Visibility smoke tests:
Motivation
Keep smoke tests running against the latest stable versions of build tools.
Contributor Checklist