Skip to content
CI

refactor: adopt timeMedian in remaining benchmark timing loops #5751

Sign in to view logs

refactor: adopt timeMedian in remaining benchmark timing loops

refactor: adopt timeMedian in remaining benchmark timing loops #5751

Triggered via pull request July 6, 2026 17:07
@carlos-almcarlos-alm
opened #1905
fix/issue-1774-adopt-timemedian-sync-sites
Status Failure
Total duration 21m 1s
Artifacts 4

ci.yml

on: pull_request
Matrix: native-host-build
Lint
7m 26s
Lint
TypeScript type check
7m 3s
TypeScript type check
Security audit
7s
Security audit
Verify dynamic imports
7s
Verify dynamic imports
Grammar version parity
5s
Grammar version parity
Rust compile check
1m 3s
Rust compile check
Matrix: parity
Matrix: test
Pre-publish benchmark gate
14m 23s
Pre-publish benchmark gate
CI Testing Pipeline
4s
CI Testing Pipeline
Fit to window
Zoom out
Zoom in

Annotations

6 errors, 15 warnings, and 3 notices
Pre-publish benchmark gate
Process completed with exit code 1.
tests/benchmarks/regression-guard.test.ts > Benchmark regression guard > incremental benchmarks > wasm engine — dev vs 3.15.0: tests/benchmarks/regression-guard.test.ts#L521
AssertionError: Benchmark regressions exceed threshold: 1-file rebuild: 113 → 294 (+160%, threshold 75%) ❯ assertNoRegressions tests/benchmarks/regression-guard.test.ts:521:12 ❯ tests/benchmarks/regression-guard.test.ts:739:9
tests/benchmarks/regression-guard.test.ts > Benchmark regression guard > incremental benchmarks > native engine — dev vs 3.15.0: tests/benchmarks/regression-guard.test.ts#L521
AssertionError: Benchmark regressions exceed threshold: 1-file rebuild: 117 → 270 (+131%, threshold 50%) ❯ assertNoRegressions tests/benchmarks/regression-guard.test.ts:521:12 ❯ tests/benchmarks/regression-guard.test.ts:739:9
tests/benchmarks/regression-guard.test.ts > Benchmark regression guard > build benchmarks > wasm engine — dev vs 3.15.0: tests/benchmarks/regression-guard.test.ts#L521
AssertionError: Benchmark regressions exceed threshold: 1-file rebuild: 112 → 292 (+161%, threshold 75%) ❯ assertNoRegressions tests/benchmarks/regression-guard.test.ts:521:12 ❯ tests/benchmarks/regression-guard.test.ts:667:9
tests/benchmarks/regression-guard.test.ts > Benchmark regression guard > build benchmarks > native engine — dev vs 3.15.0: tests/benchmarks/regression-guard.test.ts#L521
AssertionError: Benchmark regressions exceed threshold: 1-file rebuild: 117 → 274 (+134%, threshold 50%) ❯ assertNoRegressions tests/benchmarks/regression-guard.test.ts:521:12 ❯ tests/benchmarks/regression-guard.test.ts:667:9
CI Testing Pipeline
Process completed with exit code 1.
Benchmark Regression
[wasm] 1-file rebuild: 113 → 294 (+160%, threshold 15%)
Benchmark Regression
[native] 1-file rebuild: 117 → 270 (+131%, threshold 15%)
Benchmark Regression
[wasm] fnImpact d3: 4.9 → 5.8 (+18%, threshold 15%)
Benchmark Regression
[wasm] fnDeps d5: 47.8 → 57.5 (+20%, threshold 15%)
Benchmark Regression
[wasm] fnDeps d3: 47.3 → 55.8 (+18%, threshold 15%)
Benchmark Regression
[wasm] fnDeps d1: 46.7 → 54.7 (+17%, threshold 15%)
Benchmark Regression
[native] diffImpact: 8.4 → 11.3 (+35%, threshold 15%)
Benchmark Regression
[native] fnImpact d5: 5.2 → 6.1 (+17%, threshold 15%)
Benchmark Regression
[native] fnDeps d5: 33 → 39.8 (+21%, threshold 15%)
Benchmark Regression
[native] fnDeps d3: 33.2 → 39.7 (+20%, threshold 15%)
Benchmark Regression
[native] fnDeps d1: 32.8 → 39.5 (+20%, threshold 15%)
Benchmark Regression
[wasm] 1-file rebuild: 112 → 292 (+161%, threshold 15%)
Benchmark Regression
[wasm] Query time: 47.4 → 55.7 (+18%, threshold 15%)
Benchmark Regression
[native] 1-file rebuild: 117 → 274 (+134%, threshold 15%)
Benchmark Regression
[native] Query time: 33 → 40 (+21%, threshold 15%)
Native host build (macos-latest)
The macos-latest label will migrate to macOS 26 beginning June 15, 2026. For more information see https://github.com/actions/runner-images/issues/14167
Test Node 22 (macos-latest)
The macos-latest label will migrate to macOS 26 beginning June 15, 2026. For more information see https://github.com/actions/runner-images/issues/14167
Engine parity (macos-latest)
The macos-latest label will migrate to macOS 26 beginning June 15, 2026. For more information see https://github.com/actions/runner-images/issues/14167

Artifacts

Produced during runtime
Name Size Digest
benchmark-results-json
7 KB
sha256:58b3cad2a4f561646d0d272071d2690b73f136aea15204ddc3140c97a53b7a96
native-host-macos-latest
11.7 MB
sha256:cbc20b12ef226920c248ffe42c27f1c5694fb1c044a5c8508c924a231918af95
native-host-ubuntu-latest
11.4 MB
sha256:bffaafeda81ce0e9b242fc6d96d44cf1a99885f407232d025ac28cfa7fb179a4
native-host-windows-2022
10.9 MB
sha256:e554817edfd36540dc7d1b50810bbfd9f30f5b34b4bb1c95f81efc6cf27ae7de