Skip to content

Stabilize E2E container startup in CI#572

Closed
cursor[bot] wants to merge 1 commit into
masterfrom
cursor/ci-pipeline-issue-4194
Closed

Stabilize E2E container startup in CI#572
cursor[bot] wants to merge 1 commit into
masterfrom
cursor/ci-pipeline-issue-4194

Conversation

@cursor
Copy link
Copy Markdown
Contributor

@cursor cursor Bot commented Mar 25, 2026

Fixes the recent E2E CI failures by pre-pulling shared Docker images in Playwright global setup, avoiding forced image pulls during Testcontainers startup, and increasing timeouts for the heaviest CI bootstrap paths.

Open in Web View Automation 

Co-authored-by: Christopher Speller <crspeller@users.noreply.github.com>
@github-actions
Copy link
Copy Markdown

🤖 LLM Evaluation Results

OpenAI

Overall: 19/19 tests passed (100.0%)

Provider Total Passed Failed Pass Rate
✅ OPENAI 19 19 0 100.0%

Anthropic

⚠️ Overall: 18/19 tests passed (94.7%)

Provider Total Passed Failed Pass Rate
⚠️ ANTHROPIC 19 18 1 94.7%

❌ Failed Evaluations

Show 1 failures

ANTHROPIC

1. TestReactEval/[anthropic]_react_cat_message

  • Score: 0.00
  • Rubric: The word/emoji is a cat emoji or a heart/love emoji
  • Reason: The output is the literal text "heart_eyes_cat", not an actual cat emoji (e.g., 😺/🐱) or a heart/love emoji (e.g., ❤️/😍).

This comment was automatically generated by the eval CI pipeline.

@mattermost-build
Copy link
Copy Markdown
Collaborator

This PR has been automatically labelled "stale" because it hasn't had recent activity.
A core team member will check in on the status of the PR to help with questions.
Thank you for your contribution!

@crspeller crspeller closed this Apr 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants