fix(ci): split Playwright install to prevent hang on GitHub Actions#152
Merged
Merged
Conversation
The combined 'npx playwright install --with-deps chromium' command has been hanging after Chrome download completes on newer GitHub Actions runner images since May 29, causing every daily test run to time out at the 6-hour job limit. Split into two separate steps: - 'npx playwright install-deps chromium' for system dependencies (with DEBIAN_FRONTEND=noninteractive and NEEDRESTART_MODE=a) - 'npx playwright install chromium' for browser binaries Both steps have a 5-minute timeout to fail fast if they hang again. Applied to both daily-tests.yml and pr-tests.yml workflows.
🟡 AI SDK Integration Test ResultsStatus: 1 test fixed, 464 still failing Summary
✅ FixedThese tests were failing on main but are now passing:
Test MatrixAgent Tests
Embedding Tests
LLM Tests
MCP Tests
Legend: ✅ Pass | ❌ Fail | ✅🔧 Fixed | ❌📉 Regressed | ✅🆕 New (pass) | ❌🆕 New (fail) | 🗑️ Removed | str=streaming blk=blocking a=async s=sync io=stdio sse=sse hi=highlevel lo=lowlevel Generated by AI SDK Integration Tests |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
The daily test run has been broken since May 29 — every run times out at the 6-hour GitHub Actions job limit. All 18 consecutive daily runs have failed.
Root cause:
npx playwright install --with-deps chromiumhangs indefinitely after the Chrome download completes (reaches 100% but never finishes extraction/setup). This started when the GitHub Actions runner image updated, likely causing an interaction issue between--with-depssystem dependency installation (needrestart/dpkg) and the browser download process.Ref: https://github.com/getsentry/testing-ai-sdk-integrations/actions/runs/27492154452
Fix
Split the combined install into two separate steps:
npx playwright install-deps chromium— installs system dependencies only, withDEBIAN_FRONTEND=noninteractiveandNEEDRESTART_MODE=ato prevent any interactive promptsnpx playwright install chromium— downloads and installs browser binariesBoth steps have a 5-minute timeout as a safety net.
Applied to both
daily-tests.ymlandpr-tests.ymlworkflows.