Skip to content
PR Build (Linux)

perf: stop using FFI in native shuffle read path #6304

Sign in to view logs

perf: stop using FFI in native shuffle read path

perf: stop using FFI in native shuffle read path #6304

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Lint
37s
Build Native Library
2m 24s
ubuntu-latest/rust-test
3m 5s
Lint Java (Spark 4.0, JDK 17)
4m 17s
Lint Java (Spark 3.4, JDK 11, Scala 2.12)
4m 10s
Lint Java (Spark 3.5, JDK 17, Scala 2.12)
4m 10s
Verify TPC-DS Results (hash)
8m 15s
Verify TPC-DS Results (broadcast)
6m 22s
Verify TPC-H Results
4m 28s
Verify TPC-DS Results (sort_merge)
7m 44s
Spark 3.4, JDK 11, Scala 2.12/auto [exec]
10m 31s
Spark 3.4, JDK 11, Scala 2.12/auto [shuffle]
19m 53s
Spark 3.4, JDK 11, Scala 2.12/auto [fuzz]
13m 1s
Spark 3.4, JDK 11, Scala 2.12/auto [parquet]
5m 26s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [sql]
3m 10s
Spark 3.5.6, JDK 17, Scala 2.13/auto [sql]
3m 7s
Spark 3.5.6, JDK 17, Scala 2.13/auto [shuffle]
9m 17s
Spark 3.4, JDK 11, Scala 2.12/auto [expressions]
10m 38s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [csv]
2m 55s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [sql]
3m 11s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [shuffle]
7m 6s
Spark 3.5.6, JDK 17, Scala 2.13/auto [csv]
2m 55s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [parquet]
5m 18s
Spark 3.5.5, JDK 17, Scala 2.13/auto [parquet]
5m 15s
Spark 3.4, JDK 11, Scala 2.12/auto [csv]
3m 0s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [exec]
13m 43s
Spark 4.0, JDK 17/auto [parquet]
5m 26s
Spark 4.0, JDK 17/auto [fuzz]
12m 2s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [exec]
10m 21s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [expressions]
13m 59s
Spark 3.5.5, JDK 17, Scala 2.13/auto [fuzz]
11m 28s
Spark 3.5.6, JDK 17, Scala 2.13/auto [fuzz]
11m 34s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [fuzz]
12m 39s
Spark 3.5.6, JDK 17, Scala 2.13/auto [exec]
9m 54s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [shuffle]
14m 53s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [csv]
2m 56s
Spark 3.4, JDK 11, Scala 2.12/auto [sql]
2m 51s
Spark 3.5.5, JDK 17, Scala 2.13/auto [expressions]
9m 29s
Spark 4.0, JDK 17/auto [csv]
3m 3s
Spark 3.5.5, JDK 17, Scala 2.13/auto [csv]
3m 53s
Spark 3.5.6, JDK 17, Scala 2.13/auto [parquet]
5m 14s
Spark 3.5.6, JDK 17, Scala 2.13/auto [expressions]
13m 3s
Spark 4.0, JDK 17/auto [exec]
10m 3s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [expressions]
13m 55s
Spark 3.5.5, JDK 17, Scala 2.13/auto [exec]
9m 45s
Spark 3.5.5, JDK 17, Scala 2.13/auto [sql]
3m 8s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [parquet]
5m 24s
Spark 4.0, JDK 17/auto [sql]
3m 52s
Spark 3.5.5, JDK 17, Scala 2.13/auto [shuffle]
10m 7s
Spark 4.0, JDK 17/auto [expressions]
10m 0s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [fuzz]
16m 15s
Spark 4.0, JDK 17/auto [shuffle]
9m 13s
6h 38m 25s