Fix OpenLineage instrumentation for Spark by pawel-big-lebowski · Pull Request #9341 · DataDog/dd-trace-java

pawel-big-lebowski · 2025-08-08T08:44:16Z

Intrumenting OpenLineage listener from within DataDogListener is broken and results in jobs hanging.

Example haning job can be investigated here. Spark driver logs mention:

Spark JVM is stuck under destruction since 519.42s

Hipothesis: OpenLineage listener hangs bcz of not being configured properly: possibly bcz if misconfigured transport.

Why?

OpenLineage listener creates a defensive copy of Spark configuration

 public OpenLineageSparkListener(SparkConf conf) {
    super();
    this.conf = Objects.requireNonNull(conf).clone();
    isDisabled = checkIfDisabled();
  }

OpenLineageInstrumentation tracer applies method advice on constructor and puts conf onto InstanceStore
The tracer then applies changes onto the captured conf but this is not reflected in configuration used by OpenLineage.

Verification

To vefify this, I've created a locally built OpenLineage jar with defensive copy mechanism disabled (simply removed .clone() call). Then:

created PR into dd_analytics with a jar manually uploaded: https://github.com/DataDog/dd-analytics/pull/49502
run the smoke test with Mortar:
verified the smoke test is passing
OpenLineage event in lineage-processor contains tag facet:

{"_producer":"https://github.com/OpenLineage/OpenLineage/tree/1.37.0-SNAPSHOT/integration/spark","_schemaURL":"https://openlineage.io/spec/facets/1-0-0/TagsRunFacet.json#/$defs/TagsRunFacet","tags":[{"key":"_dd.trace_id","value":"8321647777175310319","source":"CONFIG"},{"key":"_dd.ol_intake.emit_spans","value":"false","source":"CONFIG"},{"key":"_dd.ol_service","value":"null","source":"CONFIG"},{"key":"_dd.ol_app_id","value":"spark-69133aa457f94308a2c967f28a562d74","source":"CONFIG"}]},"environment-properties":

This PR contains a workaround for this as it captures conf from private field of OpenLineageListener. The missing part is to verify the java tracer PR with Mortar...

Signed-off-by: Pawel Leszczynski <leszczynski.pawel@gmail.com>

pr-commenter · 2025-08-08T08:54:00Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	pawel.leszczynski/fix-openlineage-instrumentation
git_commit_date	1754639017	1754639989
git_commit_sha	`5dfc6f7`	`b07d7ee`
release_version	1.53.0-SNAPSHOT~5dfc6f71bd	1.53.0-SNAPSHOT~b07d7eec01

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1754642976	1754642976
ci_job_id	1070873039	1070873039
ci_pipeline_id	73077355	73077355
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-wfax8osw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-wfax8osw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 11 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~b07d7eec01, baseline=1.53.0-SNAPSHOT~5dfc6f71bd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.043 s) : 0, 1042761
Total [baseline] (10.66 s) : 0, 10660341
Agent [candidate] (1.048 s) : 0, 1048136
Total [candidate] (10.736 s) : 0, 10735962
section appsec
Agent [baseline] (1.225 s) : 0, 1224893
Total [baseline] (10.756 s) : 0, 10756413
Agent [candidate] (1.225 s) : 0, 1225445
Total [candidate] (10.829 s) : 0, 10828742
section iast
Agent [baseline] (1.178 s) : 0, 1178416
Total [baseline] (10.883 s) : 0, 10883174
Agent [candidate] (1.178 s) : 0, 1177755
Total [candidate] (10.9 s) : 0, 10900268
section profiling
Agent [baseline] (1.2 s) : 0, 1200180
Total [baseline] (10.863 s) : 0, 10862685
Agent [candidate] (1.202 s) : 0, 1201529
Total [candidate] (10.888 s) : 0, 10887743

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.043 s	-
Agent	appsec	1.225 s	182.132 ms (17.5%)
Agent	iast	1.178 s	135.655 ms (13.0%)
Agent	profiling	1.2 s	157.42 ms (15.1%)
Total	tracing	10.66 s	-
Total	appsec	10.756 s	96.073 ms (0.9%)
Total	iast	10.883 s	222.834 ms (2.1%)
Total	profiling	10.863 s	202.345 ms (1.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.048 s	-
Agent	appsec	1.225 s	177.31 ms (16.9%)
Agent	iast	1.178 s	129.62 ms (12.4%)
Agent	profiling	1.202 s	153.394 ms (14.6%)
Total	tracing	10.736 s	-
Total	appsec	10.829 s	92.78 ms (0.9%)
Total	iast	10.9 s	164.305 ms (1.5%)
Total	profiling	10.888 s	151.781 ms (1.4%)

gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~b07d7eec01, baseline=1.53.0-SNAPSHOT~5dfc6f71bd

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.426 ms) : 0, 1426
crashtracking [candidate] (1.428 ms) : 0, 1428
BytebuddyAgent [baseline] (730.709 ms) : 0, 730709
BytebuddyAgent [candidate] (733.154 ms) : 0, 733154
GlobalTracer [baseline] (242.133 ms) : 0, 242133
GlobalTracer [candidate] (243.411 ms) : 0, 243411
AppSec [baseline] (30.081 ms) : 0, 30081
AppSec [candidate] (30.219 ms) : 0, 30219
Debugger [baseline] (6.08 ms) : 0, 6080
Debugger [candidate] (6.078 ms) : 0, 6078
Remote Config [baseline] (650.437 µs) : 0, 650
Remote Config [candidate] (657.383 µs) : 0, 657
Telemetry [baseline] (10.625 ms) : 0, 10625
Telemetry [candidate] (12.148 ms) : 0, 12148
section appsec
crashtracking [baseline] (1.434 ms) : 0, 1434
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (756.242 ms) : 0, 756242
BytebuddyAgent [candidate] (756.426 ms) : 0, 756426
GlobalTracer [baseline] (236.26 ms) : 0, 236260
GlobalTracer [candidate] (235.891 ms) : 0, 235891
IAST [baseline] (23.826 ms) : 0, 23826
IAST [candidate] (23.655 ms) : 0, 23655
AppSec [baseline] (169.873 ms) : 0, 169873
AppSec [candidate] (168.936 ms) : 0, 168936
Debugger [baseline] (7.103 ms) : 0, 7103
Debugger [candidate] (8.108 ms) : 0, 8108
Remote Config [baseline] (635.318 µs) : 0, 635
Remote Config [candidate] (617.514 µs) : 0, 618
Telemetry [baseline] (8.386 ms) : 0, 8386
Telemetry [candidate] (9.229 ms) : 0, 9229
section iast
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (850.352 ms) : 0, 850352
BytebuddyAgent [candidate] (850.186 ms) : 0, 850186
GlobalTracer [baseline] (233.365 ms) : 0, 233365
GlobalTracer [candidate] (233.079 ms) : 0, 233079
IAST [baseline] (28.521 ms) : 0, 28521
IAST [candidate] (29.877 ms) : 0, 29877
AppSec [baseline] (27.324 ms) : 0, 27324
AppSec [candidate] (24.294 ms) : 0, 24294
Debugger [baseline] (7.461 ms) : 0, 7461
Debugger [candidate] (9.102 ms) : 0, 9102
Remote Config [baseline] (585.169 µs) : 0, 585
Remote Config [candidate] (578.245 µs) : 0, 578
Telemetry [baseline] (8.352 ms) : 0, 8352
Telemetry [candidate] (8.18 ms) : 0, 8180
section profiling
crashtracking [baseline] (1.415 ms) : 0, 1415
crashtracking [candidate] (1.42 ms) : 0, 1420
BytebuddyAgent [baseline] (764.373 ms) : 0, 764373
BytebuddyAgent [candidate] (766.08 ms) : 0, 766080
GlobalTracer [baseline] (222.546 ms) : 0, 222546
GlobalTracer [candidate] (222.719 ms) : 0, 222719
AppSec [baseline] (30.114 ms) : 0, 30114
AppSec [candidate] (30.382 ms) : 0, 30382
Debugger [baseline] (6.324 ms) : 0, 6324
Debugger [candidate] (6.325 ms) : 0, 6325
Remote Config [baseline] (687.19 µs) : 0, 687
Remote Config [candidate] (680.975 µs) : 0, 681
Telemetry [baseline] (16.074 ms) : 0, 16074
Telemetry [candidate] (15.921 ms) : 0, 15921
ProfilingAgent [baseline] (108.733 ms) : 0, 108733
ProfilingAgent [candidate] (108.106 ms) : 0, 108106
Profiling [baseline] (109.365 ms) : 0, 109365
Profiling [candidate] (108.737 ms) : 0, 108737

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~b07d7eec01, baseline=1.53.0-SNAPSHOT~5dfc6f71bd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1051989
Total [baseline] (8.609 s) : 0, 8608775
Agent [candidate] (1.043 s) : 0, 1043493
Total [candidate] (8.575 s) : 0, 8575131
section iast
Agent [baseline] (1.175 s) : 0, 1175139
Total [baseline] (9.317 s) : 0, 9317484
Agent [candidate] (1.182 s) : 0, 1182423
Total [candidate] (9.315 s) : 0, 9315269

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.052 s	-
Agent	iast	1.175 s	123.151 ms (11.7%)
Total	tracing	8.609 s	-
Total	iast	9.317 s	708.709 ms (8.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.043 s	-
Agent	iast	1.182 s	138.929 ms (13.3%)
Total	tracing	8.575 s	-
Total	iast	9.315 s	740.138 ms (8.6%)

gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~b07d7eec01, baseline=1.53.0-SNAPSHOT~5dfc6f71bd

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.432 ms) : 0, 1432
crashtracking [candidate] (1.427 ms) : 0, 1427
BytebuddyAgent [baseline] (734.363 ms) : 0, 734363
BytebuddyAgent [candidate] (730.22 ms) : 0, 730220
GlobalTracer [baseline] (245.214 ms) : 0, 245214
GlobalTracer [candidate] (242.118 ms) : 0, 242118
AppSec [baseline] (30.745 ms) : 0, 30745
AppSec [candidate] (30.028 ms) : 0, 30028
Debugger [baseline] (6.134 ms) : 0, 6134
Debugger [candidate] (6.042 ms) : 0, 6042
Remote Config [baseline] (662.35 µs) : 0, 662
Remote Config [candidate] (643.299 µs) : 0, 643
Telemetry [baseline] (12.314 ms) : 0, 12314
Telemetry [candidate] (12.062 ms) : 0, 12062
section iast
crashtracking [baseline] (1.426 ms) : 0, 1426
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (847.869 ms) : 0, 847869
BytebuddyAgent [candidate] (855.095 ms) : 0, 855095
GlobalTracer [baseline] (232.452 ms) : 0, 232452
GlobalTracer [candidate] (233.635 ms) : 0, 233635
IAST [baseline] (28.586 ms) : 0, 28586
IAST [candidate] (28.388 ms) : 0, 28388
AppSec [baseline] (27.422 ms) : 0, 27422
AppSec [candidate] (27.35 ms) : 0, 27350
Debugger [baseline] (7.544 ms) : 0, 7544
Debugger [candidate] (6.577 ms) : 0, 6577
Remote Config [baseline] (577.015 µs) : 0, 577
Remote Config [candidate] (586.377 µs) : 0, 586
Telemetry [baseline] (8.263 ms) : 0, 8263
Telemetry [candidate] (8.208 ms) : 0, 8208

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	pawel.leszczynski/fix-openlineage-instrumentation
git_commit_date	1754639017	1754639989
git_commit_sha	`5dfc6f7`	`b07d7ee`
release_version	1.53.0-SNAPSHOT~5dfc6f71bd	1.53.0-SNAPSHOT~b07d7eec01

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1754642646	1754642646
ci_job_id	1070873040	1070873040
ci_pipeline_id	73077355	73077355
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-zf5onyig 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-zf5onyig 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	worse [+198.777µs; +507.339µs] or [+2.219%; +5.664%]	unstable [-81.033op/s; +41.846op/s] or [-15.642%; +8.077%]	9.310ms	498.469op/s	8.957ms	518.062op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load	better [-613.081µs; -218.406µs] or [-5.734%; -2.043%]	unstable [-31.180op/s; +65.868op/s] or [-7.169%; +15.145%]	10.275ms	452.250op/s	10.691ms	434.906op/s
scenario:load:petclinic:code_origins:high_load	worse [+1.540ms; +2.354ms] or [+3.531%; +5.398%]	unstable [-12.997op/s; +1.230op/s] or [-11.961%; +1.132%]	45.549ms	102.775op/s	43.602ms	108.658op/s
scenario:load:petclinic:profiling:high_load	better [-3.362ms; -2.394ms] or [-6.754%; -4.810%]	unstable [-0.436op/s; +12.107op/s] or [-0.458%; +12.711%]	46.895ms	101.089op/s	49.773ms	95.253op/s
scenario:load:petclinic:appsec:high_load	better [-2.444ms; -1.566ms] or [-5.112%; -3.276%]	unstable [-3.948op/s; +9.994op/s] or [-3.982%; +10.080%]	45.808ms	102.175op/s	47.814ms	99.152op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~b07d7eec01, baseline=1.53.0-SNAPSHOT~5dfc6f71bd
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.412 ms) : 4363, 4462
.   : milestone, 4412,
iast (9.155 ms) : 9000, 9310
.   : milestone, 9155,
iast_FULL (13.621 ms) : 13352, 13890
.   : milestone, 13621,
iast_GLOBAL (10.691 ms) : 10503, 10879
.   : milestone, 10691,
profiling (8.957 ms) : 8809, 9105
.   : milestone, 8957,
tracing (7.733 ms) : 7616, 7849
.   : milestone, 7733,
section candidate
no_agent (4.484 ms) : 4428, 4540
.   : milestone, 4484,
iast (9.488 ms) : 9331, 9645
.   : milestone, 9488,
iast_FULL (13.757 ms) : 13486, 14029
.   : milestone, 13757,
iast_GLOBAL (10.275 ms) : 10097, 10454
.   : milestone, 10275,
profiling (9.31 ms) : 9172, 9449
.   : milestone, 9310,
tracing (7.847 ms) : 7731, 7964
.   : milestone, 7847,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.412 ms [4.363 ms, 4.462 ms]	-
iast	9.155 ms [9.0 ms, 9.31 ms]	4.743 ms (107.5%)
iast_FULL	13.621 ms [13.352 ms, 13.89 ms]	9.209 ms (208.7%)
iast_GLOBAL	10.691 ms [10.503 ms, 10.879 ms]	6.279 ms (142.3%)
profiling	8.957 ms [8.809 ms, 9.105 ms]	4.545 ms (103.0%)
tracing	7.733 ms [7.616 ms, 7.849 ms]	3.321 ms (75.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.484 ms [4.428 ms, 4.54 ms]	-
iast	9.488 ms [9.331 ms, 9.645 ms]	5.004 ms (111.6%)
iast_FULL	13.757 ms [13.486 ms, 14.029 ms]	9.273 ms (206.8%)
iast_GLOBAL	10.275 ms [10.097 ms, 10.454 ms]	5.791 ms (129.2%)
profiling	9.31 ms [9.172 ms, 9.449 ms]	4.826 ms (107.6%)
tracing	7.847 ms [7.731 ms, 7.964 ms]	3.363 ms (75.0%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~b07d7eec01, baseline=1.53.0-SNAPSHOT~5dfc6f71bd
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.763 ms) : 36468, 37058
.   : milestone, 36763,
appsec (47.814 ms) : 47392, 48235
.   : milestone, 47814,
code_origins (43.602 ms) : 43235, 43969
.   : milestone, 43602,
iast (45.757 ms) : 45369, 46145
.   : milestone, 45757,
profiling (49.773 ms) : 49306, 50241
.   : milestone, 49773,
tracing (43.6 ms) : 43224, 43976
.   : milestone, 43600,
section candidate
no_agent (37.246 ms) : 36952, 37541
.   : milestone, 37246,
appsec (45.808 ms) : 45414, 46203
.   : milestone, 45808,
code_origins (45.549 ms) : 45159, 45938
.   : milestone, 45549,
iast (45.361 ms) : 44965, 45756
.   : milestone, 45361,
profiling (46.895 ms) : 46464, 47327
.   : milestone, 46895,
tracing (43.382 ms) : 43019, 43744
.   : milestone, 43382,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.763 ms [36.468 ms, 37.058 ms]	-
appsec	47.814 ms [47.392 ms, 48.235 ms]	11.051 ms (30.1%)
code_origins	43.602 ms [43.235 ms, 43.969 ms]	6.839 ms (18.6%)
iast	45.757 ms [45.369 ms, 46.145 ms]	8.994 ms (24.5%)
profiling	49.773 ms [49.306 ms, 50.241 ms]	13.01 ms (35.4%)
tracing	43.6 ms [43.224 ms, 43.976 ms]	6.837 ms (18.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.246 ms [36.952 ms, 37.541 ms]	-
appsec	45.808 ms [45.414 ms, 46.203 ms]	8.562 ms (23.0%)
code_origins	45.549 ms [45.159 ms, 45.938 ms]	8.302 ms (22.3%)
iast	45.361 ms [44.965 ms, 45.756 ms]	8.114 ms (21.8%)
profiling	46.895 ms [46.464 ms, 47.327 ms]	9.649 ms (25.9%)
tracing	43.382 ms [43.019 ms, 43.744 ms]	6.135 ms (16.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	pawel.leszczynski/fix-openlineage-instrumentation
git_commit_date	1754639017	1754639989
git_commit_sha	`5dfc6f7`	`b07d7ee`
release_version	1.53.0-SNAPSHOT~5dfc6f71bd	1.53.0-SNAPSHOT~b07d7eec01

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1754643145	1754643145
ci_job_id	1070873041	1070873041
ci_pipeline_id	73077355	73077355
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-z1fz392m 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-z1fz392m 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~b07d7eec01, baseline=1.53.0-SNAPSHOT~5dfc6f71bd
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.647 ms) : 3431, 3862
.   : milestone, 3647,
iast (2.186 ms) : 2123, 2248
.   : milestone, 2186,
iast_GLOBAL (2.224 ms) : 2162, 2287
.   : milestone, 2224,
profiling (2.471 ms) : 2302, 2641
.   : milestone, 2471,
tracing (2.016 ms) : 1967, 2064
.   : milestone, 2016,
section candidate
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (3.622 ms) : 3405, 3839
.   : milestone, 3622,
iast (2.193 ms) : 2131, 2256
.   : milestone, 2193,
iast_GLOBAL (2.23 ms) : 2167, 2293
.   : milestone, 2230,
profiling (2.043 ms) : 1992, 2094
.   : milestone, 2043,
tracing (2.012 ms) : 1963, 2060
.   : milestone, 2012,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.46 ms, 1.483 ms]	-
appsec	3.647 ms [3.431 ms, 3.862 ms]	2.176 ms (147.9%)
iast	2.186 ms [2.123 ms, 2.248 ms]	714.48 µs (48.6%)
iast_GLOBAL	2.224 ms [2.162 ms, 2.287 ms]	753.171 µs (51.2%)
profiling	2.471 ms [2.302 ms, 2.641 ms]	1.0 ms (68.0%)
tracing	2.016 ms [1.967 ms, 2.064 ms]	544.43 µs (37.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.469 ms [1.458 ms, 1.481 ms]	-
appsec	3.622 ms [3.405 ms, 3.839 ms]	2.153 ms (146.5%)
iast	2.193 ms [2.131 ms, 2.256 ms]	723.765 µs (49.3%)
iast_GLOBAL	2.23 ms [2.167 ms, 2.293 ms]	760.458 µs (51.8%)
profiling	2.043 ms [1.992 ms, 2.094 ms]	573.706 µs (39.0%)
tracing	2.012 ms [1.963 ms, 2.06 ms]	542.333 µs (36.9%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~b07d7eec01, baseline=1.53.0-SNAPSHOT~5dfc6f71bd
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.533 s) : 15533000, 15533000
.   : milestone, 15533000,
appsec (15.042 s) : 15042000, 15042000
.   : milestone, 15042000,
iast (18.267 s) : 18267000, 18267000
.   : milestone, 18267000,
iast_GLOBAL (18.225 s) : 18225000, 18225000
.   : milestone, 18225000,
profiling (15.547 s) : 15547000, 15547000
.   : milestone, 15547000,
tracing (15.225 s) : 15225000, 15225000
.   : milestone, 15225000,
section candidate
no_agent (15.275 s) : 15275000, 15275000
.   : milestone, 15275000,
appsec (14.738 s) : 14738000, 14738000
.   : milestone, 14738000,
iast (18.711 s) : 18711000, 18711000
.   : milestone, 18711000,
iast_GLOBAL (17.818 s) : 17818000, 17818000
.   : milestone, 17818000,
profiling (15.085 s) : 15085000, 15085000
.   : milestone, 15085000,
tracing (15.04 s) : 15040000, 15040000
.   : milestone, 15040000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.533 s [15.533 s, 15.533 s]	-
appsec	15.042 s [15.042 s, 15.042 s]	-491.0 ms (-3.2%)
iast	18.267 s [18.267 s, 18.267 s]	2.734 s (17.6%)
iast_GLOBAL	18.225 s [18.225 s, 18.225 s]	2.692 s (17.3%)
profiling	15.547 s [15.547 s, 15.547 s]	14.0 ms (0.1%)
tracing	15.225 s [15.225 s, 15.225 s]	-308.0 ms (-2.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.275 s [15.275 s, 15.275 s]	-
appsec	14.738 s [14.738 s, 14.738 s]	-537.0 ms (-3.5%)
iast	18.711 s [18.711 s, 18.711 s]	3.436 s (22.5%)
iast_GLOBAL	17.818 s [17.818 s, 17.818 s]	2.543 s (16.6%)
profiling	15.085 s [15.085 s, 15.085 s]	-190.0 ms (-1.2%)
tracing	15.04 s [15.04 s, 15.04 s]	-235.0 ms (-1.5%)

Fix OpenLineage instrumentation

b07d7ee

Signed-off-by: Pawel Leszczynski <leszczynski.pawel@gmail.com>

pawel-big-lebowski requested a review from mobuchowski August 8, 2025 09:04

pawel-big-lebowski closed this Aug 8, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix OpenLineage instrumentation for Spark#9341

Fix OpenLineage instrumentation for Spark#9341
pawel-big-lebowski wants to merge 1 commit intomasterfrom
pawel.leszczynski/fix-openlineage-instrumentation

pawel-big-lebowski commented Aug 8, 2025 •

edited

Loading

Uh oh!

pr-commenter Bot commented Aug 8, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

pawel-big-lebowski commented Aug 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter Bot commented Aug 8, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

pawel-big-lebowski commented Aug 8, 2025 •

edited

Loading