Skip to content

[world] Asymmetric ULID timestamp validation thresholds#1605

Merged
VaguelySerious merged 1 commit intomainfrom
peter/asymmetric-ulid-thresholds
Apr 3, 2026
Merged

[world] Asymmetric ULID timestamp validation thresholds#1605
VaguelySerious merged 1 commit intomainfrom
peter/asymmetric-ulid-thresholds

Conversation

@VaguelySerious
Copy link
Copy Markdown
Member

@VaguelySerious VaguelySerious commented Apr 3, 2026 •
edited
Loading

Summary

  • Extracted from [core] [world] Lazy run creation on start #1537
  • Changes ULID timestamp validation from a symmetric 5-minute threshold to asymmetric thresholds: 24 hours in the past and 5 minutes in the future
  • The past threshold supports resilient start where VQS delayed messages (up to 24h) can cause run_created timestamps to lag significantly
  • The future threshold stays tight to prevent abuse from client-generated ULIDs with manipulated timestamps while tolerating clock skew

Test plan

  • custom runId validation tests pass in world-local (8/8 passing)
  • CI checks pass

🤖 Generated with Claude Code

@VaguelySerious VaguelySerious requested a review from a team as a code owner April 3, 2026 19:28
@vercel
Copy link
Copy Markdown
Contributor

vercel Bot commented Apr 3, 2026 •
edited
Loading

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, Comment Apr 3, 2026 7:42pm
example-nextjs-workflow-webpack Ready Ready Preview, Comment Apr 3, 2026 7:42pm
example-workflow Ready Ready Preview, Comment Apr 3, 2026 7:42pm
workbench-astro-workflow Ready Ready Preview, Comment Apr 3, 2026 7:42pm
workbench-express-workflow Ready Ready Preview, Comment Apr 3, 2026 7:42pm
workbench-fastify-workflow Ready Ready Preview, Comment Apr 3, 2026 7:42pm
workbench-hono-workflow Ready Ready Preview, Comment Apr 3, 2026 7:42pm
workbench-nitro-workflow Ready Ready Preview, Comment Apr 3, 2026 7:42pm
workbench-nuxt-workflow Ready Ready Preview, Comment Apr 3, 2026 7:42pm
workbench-sveltekit-workflow Ready Ready Preview, Comment Apr 3, 2026 7:42pm
workbench-vite-workflow Ready Ready Preview, Comment Apr 3, 2026 7:42pm
workflow-docs Ready Ready Preview, Comment, Open in v0 Apr 3, 2026 7:42pm
workflow-swc-playground Ready Ready Preview, Comment Apr 3, 2026 7:42pm

@changeset-bot
Copy link
Copy Markdown

changeset-bot Bot commented Apr 3, 2026 •
edited
Loading

🦋 Changeset detected

Latest commit: 6fe7f08

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 20 packages
Name Type
@workflow/world Patch
@workflow/world-local Patch
@workflow/cli Patch
@workflow/core Patch
@workflow/vitest Patch
@workflow/web-shared Patch
@workflow/world-postgres Patch
@workflow/world-testing Patch
@workflow/world-vercel Patch
workflow Patch
@workflow/builders Patch
@workflow/next Patch
@workflow/nitro Patch
@workflow/ai Patch
@workflow/astro Patch
@workflow/nest Patch
@workflow/rollup Patch
@workflow/sveltekit Patch
@workflow/vite Patch
@workflow/nuxt Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 3, 2026 •
edited
Loading

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 0.042s (-3.5%) 1.005s (~) 0.963s 10 1.00x
💻 Local Nitro 0.043s (-15.9% 🟢) 1.005s (~) 0.962s 10 1.05x
🐘 Postgres Express 0.060s (-9.8% 🟢) 1.010s (~) 0.950s 10 1.45x
🐘 Postgres Nitro 0.063s (+9.9% 🔺) 1.011s (~) 0.948s 10 1.52x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 0.548s (-14.7% 🟢) 2.778s (+13.8% 🔺) 2.230s 10 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 1.131s (-1.0%) 2.005s (~) 0.875s 10 1.00x
💻 Local Express 1.134s (~) 2.006s (~) 0.873s 10 1.00x
🐘 Postgres Express 1.149s (+0.5%) 2.011s (~) 0.863s 10 1.02x
🐘 Postgres Nitro 1.153s (~) 2.012s (~) 0.860s 10 1.02x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.333s (+2.9%) 3.883s (+8.4% 🔺) 1.550s 10 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 10.888s (~) 11.022s (~) 0.134s 3 1.00x
💻 Local Express 10.911s (~) 11.023s (~) 0.112s 3 1.00x
🐘 Postgres Nitro 10.921s (~) 11.026s (~) 0.105s 3 1.00x
💻 Local Nitro 10.936s (-0.7%) 11.023s (-2.9%) 0.088s 3 1.00x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 17.453s (-4.9%) 19.447s (-3.2%) 1.994s 2 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 14.547s (-0.5%) 15.023s (~) 0.476s 4 1.00x
🐘 Postgres Nitro 14.666s (+1.1%) 15.025s (~) 0.359s 4 1.01x
💻 Local Express 14.869s (-0.6%) 15.028s (~) 0.159s 4 1.02x
💻 Local Nitro 15.015s (-1.3%) 15.281s (-4.7%) 0.265s 4 1.03x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 33.276s (-1.4%) 35.166s (-0.6%) 1.890s 2 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 13.993s (~) 14.450s (~) 0.457s 7 1.00x
🐘 Postgres Nitro 14.178s (+1.2%) 15.026s (+2.9%) 0.848s 6 1.01x
💻 Local Express 16.490s (-1.2%) 17.031s (~) 0.541s 6 1.18x
💻 Local Nitro 16.755s (-2.4%) 17.031s (-5.6% 🟢) 0.277s 6 1.20x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 53.480s (-1.8%) 56.144s (+1.3%) 2.665s 2 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 1.269s (+0.7%) 2.013s (~) 0.744s 15 1.00x
🐘 Postgres Express 1.282s (+1.1%) 2.011s (~) 0.730s 15 1.01x
💻 Local Nitro 1.510s (-3.6%) 2.006s (~) 0.495s 15 1.19x
💻 Local Express 1.516s (-1.6%) 2.006s (~) 0.490s 15 1.19x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.523s (-9.4% 🟢) 4.474s (+15.1% 🔺) 1.951s 7 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.331s (~) 3.011s (~) 0.679s 10 1.00x
🐘 Postgres Nitro 2.359s (+1.4%) 3.012s (~) 0.654s 10 1.01x
💻 Local Nitro 2.961s (-5.1% 🟢) 3.208s (-17.4% 🟢) 0.247s 10 1.27x
💻 Local Express 3.123s (~) 3.759s (-6.2% 🟢) 0.637s 8 1.34x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.413s (+9.7% 🔺) 5.619s (+24.1% 🔺) 2.207s 6 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 3.454s (~) 4.010s (~) 0.556s 8 1.00x
🐘 Postgres Nitro 3.502s (+0.8%) 4.011s (~) 0.509s 8 1.01x
💻 Local Nitro 8.370s (~) 8.771s (-2.8%) 0.401s 4 2.42x
💻 Local Express 8.371s (+2.7%) 9.021s (~) 0.650s 4 2.42x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.363s (-18.8% 🟢) 5.338s (-7.0% 🟢) 1.975s 6 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 1.265s (+0.6%) 2.009s (~) 0.744s 15 1.00x
🐘 Postgres Express 1.266s (~) 2.009s (~) 0.743s 15 1.00x
💻 Local Nitro 1.536s (-1.9%) 2.006s (~) 0.469s 15 1.21x
💻 Local Express 1.552s (+0.6%) 2.006s (~) 0.453s 15 1.23x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.483s (+10.6% 🔺) 4.162s (+15.6% 🔺) 1.679s 8 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.348s (~) 3.010s (~) 0.661s 10 1.00x
🐘 Postgres Nitro 2.349s (+1.1%) 3.012s (~) 0.664s 10 1.00x
💻 Local Express 2.907s (-6.5% 🟢) 3.454s (-11.1% 🟢) 0.547s 9 1.24x
💻 Local Nitro 3.122s (-2.9%) 3.885s (~) 0.763s 8 1.33x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.541s (-12.8% 🟢) 4.115s (+3.0%) 1.574s 8 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 3.486s (~) 4.012s (~) 0.526s 8 1.00x
🐘 Postgres Nitro 3.488s (+0.8%) 4.012s (~) 0.524s 8 1.00x
💻 Local Express 8.474s (-5.9% 🟢) 9.023s (-5.3% 🟢) 0.549s 4 2.43x
💻 Local Nitro 8.716s (-2.6%) 9.024s (-2.7%) 0.308s 4 2.50x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.123s (-15.1% 🟢) 5.054s (-1.5%) 1.931s 7 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.823s (-3.3%) 1.024s (+1.6%) 0.201s 59 1.00x
🐘 Postgres Nitro 0.870s (+5.2% 🔺) 1.008s (~) 0.138s 60 1.06x
💻 Local Express 0.966s (-3.3%) 1.076s (-24.4% 🟢) 0.110s 56 1.17x
💻 Local Nitro 0.983s (-4.1%) 1.096s (-42.7% 🟢) 0.112s 55 1.19x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 10.067s (-1.8%) 12.179s (+2.7%) 2.112s 5 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.990s (-1.7%) 2.469s (-8.1% 🟢) 0.479s 37 1.00x
🐘 Postgres Nitro 2.110s (+7.5% 🔺) 3.012s (+40.0% 🔺) 0.902s 30 1.06x
💻 Local Express 2.980s (-1.1%) 3.293s (-8.7% 🟢) 0.313s 28 1.50x
💻 Local Nitro 3.018s (-2.3%) 3.547s (-11.6% 🟢) 0.529s 26 1.52x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 33.137s (+10.2% 🔺) 34.857s (+10.1% 🔺) 1.720s 3 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 3.980s (-1.9%) 4.404s (-7.9% 🟢) 0.424s 28 1.00x
🐘 Postgres Nitro 4.305s (+7.1% 🔺) 5.012s (+10.7% 🔺) 0.707s 24 1.08x
💻 Local Express 9.017s (-1.4%) 9.401s (-2.4%) 0.384s 13 2.27x
💻 Local Nitro 9.211s (-2.2%) 9.864s (-1.6%) 0.653s 13 2.31x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 83.803s (~) 85.733s (~) 1.930s 2 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.282s (+1.4%) 1.008s (~) 0.726s 60 1.00x
🐘 Postgres Nitro 0.299s (+9.6% 🔺) 1.008s (~) 0.709s 60 1.06x
💻 Local Express 0.591s (+1.7%) 1.004s (~) 0.413s 60 2.10x
💻 Local Nitro 0.602s (-11.9% 🟢) 1.005s (-3.4%) 0.403s 60 2.13x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 1.982s (-0.6%) 3.554s (-7.2% 🟢) 1.572s 18 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.493s (-1.0%) 1.008s (~) 0.515s 90 1.00x
🐘 Postgres Nitro 0.517s (+5.7% 🔺) 1.008s (~) 0.491s 90 1.05x
💻 Local Express 2.507s (-1.8%) 3.008s (~) 0.502s 30 5.09x
💻 Local Nitro 2.541s (~) 3.009s (~) 0.468s 30 5.16x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.745s (-17.5% 🟢) 5.390s (-11.7% 🟢) 1.645s 17 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.800s (+1.1%) 1.009s (~) 0.208s 119 1.00x
🐘 Postgres Nitro 0.813s (+5.1% 🔺) 1.019s (+1.1%) 0.206s 118 1.02x
💻 Local Express 11.134s (-0.6%) 11.755s (-1.5%) 0.621s 11 13.91x
💻 Local Nitro 11.277s (-0.6%) 11.938s (~) 0.660s 11 14.09x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 31.620s (+281.9% 🔺) 33.851s (+247.7% 🔺) 2.231s 9 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.201s (-7.9% 🟢) 1.004s (~) 0.012s (+5.4% 🔺) 1.018s (~) 0.818s 10 1.00x
💻 Local Express 0.201s (-0.9%) 1.003s (~) 0.011s (-5.0%) 1.018s (~) 0.817s 10 1.00x
🐘 Postgres Express 0.203s (-0.6%) 0.997s (~) 0.002s (+7.1% 🔺) 1.010s (~) 0.807s 10 1.01x
🐘 Postgres Nitro 0.229s (+9.8% 🔺) 0.993s (~) 0.002s (+33.3% 🔺) 1.011s (~) 0.782s 10 1.14x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 1.584s (-20.9% 🟢) 2.641s (-11.4% 🟢) 0.679s (+0.9%) 4.048s (-3.5%) 2.463s 10 1.00x
▲ Vercel Express ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.641s (+6.2% 🔺) 1.005s (~) 0.003s (-20.0% 🟢) 1.022s (~) 0.381s 59 1.00x
🐘 Postgres Express 0.673s (+9.2% 🔺) 1.021s (+1.9%) 0.006s (+53.2% 🔺) 1.042s (+1.7%) 0.369s 59 1.05x
💻 Local Express 0.719s (-0.7%) 1.010s (~) 0.009s (+6.7% 🔺) 1.023s (~) 0.304s 59 1.12x
💻 Local Nitro 0.723s (-4.9%) 1.010s (~) 0.008s (-14.7% 🟢) 1.022s (~) 0.299s 59 1.13x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 5.245s (-10.7% 🟢) 6.441s (-7.1% 🟢) 0.237s (-44.1% 🟢) 7.975s (+0.6%) 2.730s 8 1.00x
▲ Vercel Express ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.960s (-1.7%) 1.295s (+8.1% 🔺) 0.000s (+Infinity% 🔺) 1.313s (+6.2% 🔺) 0.353s 46 1.00x
🐘 Postgres Nitro 0.996s (+2.1%) 1.271s (+9.1% 🔺) 0.000s (+10.6% 🔺) 1.286s (+8.3% 🔺) 0.291s 47 1.04x
💻 Local Express 1.218s (-2.4%) 2.019s (~) 0.000s (+12.5% 🔺) 2.022s (~) 0.804s 30 1.27x
💻 Local Nitro 1.230s (-5.0% 🟢) 2.021s (~) 0.000s (-27.3% 🟢) 2.023s (~) 0.792s 30 1.28x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.606s (+10.6% 🔺) 5.067s (+22.9% 🔺) 0.001s (+Infinity% 🔺) 5.771s (+23.2% 🔺) 2.165s 12 1.00x
▲ Vercel Express ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.764s (+0.8%) 2.212s (+7.1% 🔺) 0.000s (NaN%) 2.225s (+5.8% 🔺) 0.462s 28 1.00x
🐘 Postgres Nitro 1.816s (+5.9% 🔺) 2.137s (+1.8%) 0.000s (+3.6%) 2.173s (+2.9%) 0.357s 28 1.03x
💻 Local Express 3.362s (-7.2% 🟢) 4.036s (-1.5%) 0.001s (+14.3% 🔺) 4.039s (-1.5%) 0.676s 15 1.91x
💻 Local Nitro 3.539s (-5.2% 🟢) 4.100s (-3.2%) 0.001s (-9.1% 🟢) 4.103s (-3.2%) 0.564s 15 2.01x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 4.404s (-16.4% 🟢) 5.573s (-10.4% 🟢) 0.000s (NaN%) 6.275s (-7.3% 🟢) 1.872s 10 1.00x
▲ Vercel Express ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Express 15/21
🐘 Postgres Express 18/21
▲ Vercel Next.js (Turbopack) 21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 🐘 Postgres 18/21
Next.js (Turbopack) ▲ Vercel 21/21
Nitro 🐘 Postgres 18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

❌ Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 3, 2026 •
edited
Loading

🧪 E2E Test Results

❌ Some tests failed

Summary

Passed Failed Skipped Total
❌ ▲ Vercel Production 856 1 67 924
✅ 💻 Local Development 830 0 178 1008
✅ 📦 Local Production 830 0 178 1008
✅ 🐘 Local Postgres 830 0 178 1008
✅ 🪟 Windows 76 0 8 84
❌ 🌍 Community Worlds 132 60 24 216
✅ 📋 Other 210 0 42 252
Total 3764 61 675 4500

❌ Failed Tests

▲ Vercel Production (1 failed)

hono (1 failed):

🌍 Community Worlds (60 failed)

mongodb (3 failed):

  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KNADWVHN163V38QHQKKWK0B1
  • webhookWorkflow | wrun_01KNADX4QB33YSPJDEND7JPJW6
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KNAE53PD7WR0WEGJ3YGT1EED

redis (2 failed):

  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KNADWVHN163V38QHQKKWK0B1
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KNAE53PD7WR0WEGJ3YGT1EED

turso (55 failed):

  • addTenWorkflow | wrun_01KNADVMY2ADZDEFCAVK9GFP2A
  • addTenWorkflow | wrun_01KNADVMY2ADZDEFCAVK9GFP2A
  • wellKnownAgentWorkflow (.well-known/agent) | wrun_01KNADX14H32WY5D5CJ2CADA8M
  • should work with react rendering in step
  • promiseAllWorkflow | wrun_01KNADVVFJDNRM6X12EVWJSV8G
  • promiseRaceWorkflow | wrun_01KNADW1BC32ANVV4Q8D4ECZTN
  • promiseAnyWorkflow | wrun_01KNADW3NPZRBFYXVTAHQCB5CK
  • importedStepOnlyWorkflow | wrun_01KNADXC2W2SCG0JHBXK06KFJJ
  • hookWorkflow | wrun_01KNADWG9G090YSY7JQS01N5ZF
  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KNADWVHN163V38QHQKKWK0B1
  • webhookWorkflow | wrun_01KNADX4QB33YSPJDEND7JPJW6
  • sleepingWorkflow | wrun_01KNADXB43JBBDAC0R7H9954N4
  • parallelSleepWorkflow | wrun_01KNADXQYZ818ND9BCMQC1A6NV
  • nullByteWorkflow | wrun_01KNADXWFWP8HE86ZW6ZXXS82G
  • workflowAndStepMetadataWorkflow | wrun_01KNADXYQ1XAS5SFY8Y25NYCZR
  • fetchWorkflow | wrun_01KNAE0TSX9BEVE2TE3K8QN55W
  • promiseRaceStressTestWorkflow | wrun_01KNAE0YCQ9MHYK43W5W3YEPYM
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • error handling not registered WorkflowNotRegisteredError fails the run when workflow does not exist
  • error handling not registered StepNotRegisteredError fails the step but workflow can catch it
  • error handling not registered StepNotRegisteredError fails the run when not caught in workflow
  • hookCleanupTestWorkflow - hook token reuse after workflow completion | wrun_01KNAE4DVCJGA7HBPA25N75BV7
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KNAE53PD7WR0WEGJ3YGT1EED
  • hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running | wrun_01KNAE5S7D1Y8R5JRR70BXM4CB
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars) | wrun_01KNAE6CSNSZK568AD2W8FKQ07
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument | wrun_01KNAE6N9JKR3TTQ0H9KK9V4MA
  • closureVariableWorkflow - nested step functions with closure variables | wrun_01KNAE6TNYJM1DW39VF128S7YC
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step | wrun_01KNAE6Y4M4MJMXV7WJ2VRGQZ3
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly | wrun_01KNAE7CZGEFBRCGNHRE54DZGT
  • Calculator.calculate - static workflow method using static step methods from another class | wrun_01KNAE7K3T10S1KWGHV2NJ0GPE
  • AllInOneService.processNumber - static workflow method using sibling static step methods | wrun_01KNAE7RET49171P9BT30MBVBC
  • ChainableService.processWithThis - static step methods using this to reference the class | wrun_01KNAE7Z5E3PBDFP4ADJN4BGS5
  • thisSerializationWorkflow - step function invoked with .call() and .apply() | wrun_01KNAE86ZC0DHK1BK2QFWPH010
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE | wrun_01KNAE8E8EQE2HHH8Z9X2PGQ0M
  • instanceMethodStepWorkflow - instance methods with "use step" directive | wrun_01KNAE8NY2R31SYCR73JMRP3ES
  • crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context | wrun_01KNAE91M28SWD0HC9K10WQ8A1
  • stepFunctionAsStartArgWorkflow - step function reference passed as start() argument | wrun_01KNAE996QWR9JY6091FN739Z7
  • cancelRun - cancelling a running workflow | wrun_01KNAE9HQ1J0D1N9BHASS0VBR8
  • cancelRun via CLI - cancelling a running workflow | wrun_01KNAE9TST5H50RKTH96V9VYC6
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep | wrun_01KNAEA6FJK5ECGCXTBPSVVP75
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_01KNAEAXNWSV64N9SP0ZBVG87M
  • sleepWithSequentialStepsWorkflow - sequential steps work with concurrent sleep (control) | wrun_01KNAEB806AYWDH4W1JBDM55YF
  • importMetaUrlWorkflow - import.meta.url is available in step bundles | wrun_01KNAEBEG302FHKPZA4W9QV5HG

Details by Category

❌ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 77 0 7
✅ example 77 0 7
✅ express 77 0 7
✅ fastify 77 0 7
❌ hono 76 1 7
✅ nextjs-turbopack 82 0 2
✅ nextjs-webpack 82 0 2
✅ nitro 77 0 7
✅ nuxt 77 0 7
✅ sveltekit 77 0 7
✅ vite 77 0 7
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 70 0 14
✅ express-stable 70 0 14
✅ fastify-stable 70 0 14
✅ hono-stable 70 0 14
✅ nextjs-turbopack-canary 59 0 25
✅ nextjs-turbopack-stable 76 0 8
✅ nextjs-webpack-canary 59 0 25
✅ nextjs-webpack-stable 76 0 8
✅ nitro-stable 70 0 14
✅ nuxt-stable 70 0 14
✅ sveltekit-stable 70 0 14
✅ vite-stable 70 0 14
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 70 0 14
✅ express-stable 70 0 14
✅ fastify-stable 70 0 14
✅ hono-stable 70 0 14
✅ nextjs-turbopack-canary 59 0 25
✅ nextjs-turbopack-stable 76 0 8
✅ nextjs-webpack-canary 59 0 25
✅ nextjs-webpack-stable 76 0 8
✅ nitro-stable 70 0 14
✅ nuxt-stable 70 0 14
✅ sveltekit-stable 70 0 14
✅ vite-stable 70 0 14
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 70 0 14
✅ express-stable 70 0 14
✅ fastify-stable 70 0 14
✅ hono-stable 70 0 14
✅ nextjs-turbopack-canary 59 0 25
✅ nextjs-turbopack-stable 76 0 8
✅ nextjs-webpack-canary 59 0 25
✅ nextjs-webpack-stable 76 0 8
✅ nitro-stable 70 0 14
✅ nuxt-stable 70 0 14
✅ sveltekit-stable 70 0 14
✅ vite-stable 70 0 14
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 76 0 8
❌ 🌍 Community Worlds
App Passed Failed Skipped
✅ mongodb-dev 5 0 0
❌ mongodb 56 3 8
✅ redis-dev 5 0 0
❌ redis 57 2 8
✅ turso-dev 5 0 0
❌ turso 4 55 8
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 70 0 14
✅ e2e-local-postgres-nest-stable 70 0 14
✅ e2e-local-prod-nest-stable 70 0 14

📋 View full workflow run

❌ Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@VaguelySerious @claude
[world] Asymmetric ULID timestamp validation thresholds
6fe7f08 
Use 24h past / 5min future instead of symmetric 5min threshold. This
supports resilient start where queue retry delays (up to 24h via VQS)
can cause run_created timestamps to be far in the past, while keeping
future timestamps tight to prevent abuse.

Extracted from #1537.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@VaguelySerious VaguelySerious force-pushed the peter/asymmetric-ulid-thresholds branch from 64f790a to 6fe7f08 Compare April 3, 2026 19:40
@VaguelySerious VaguelySerious enabled auto-merge (squash) April 3, 2026 19:42
TooTallNate
TooTallNate approved these changes Apr 3, 2026
View reviewed changes
Copy link
Copy Markdown
Member

@TooTallNate TooTallNate left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Clean extraction from #1537. The asymmetric threshold logic is correct, the backwards-compat alias is properly deprecated, all three callers use default args so the signature change is safe, and the tests cover the boundary conditions well.

One trivial nit (non-blocking): DEFAULT_TIMESTAMP_THRESHOLD_MS is imported but unused in storage.test.ts (line 7). The tests now use hardcoded values (25h, 10min, 4min) instead of referencing the constant. You could either remove the dead import or use the new constants in the test assertions for self-documenting tests.

LGTM.

@VaguelySerious VaguelySerious disabled auto-merge April 3, 2026 19:54
@VaguelySerious VaguelySerious merged commit b30b0dc into main Apr 3, 2026
99 of 103 checks passed
@VaguelySerious VaguelySerious deleted the peter/asymmetric-ulid-thresholds branch April 3, 2026 19:54
This was referenced Apr 3, 2026
Merged
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@TooTallNate TooTallNate TooTallNate approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious @TooTallNate