Skip to content

e2e-flakiness-detector #39

e2e-flakiness-detector

e2e-flakiness-detector #39

Triggered via schedule August 18, 2025 14:19
Status Failure
Total duration 1h 49m 40s
Artifacts 1
Matrix: test-e2e
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 2 warnings, and 3 notices
chat-input.test.ts:198:3 › chat model selector: vscode\test\e2e\chat-input.test.ts#L0
5) chat-input.test.ts:198:3 › chat model selector ──────────────────────────────────────────────── Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\chat_model_selector\temp-videos\782cfac03e58bec6998a9c3c84ef79c9.webm' -> 'D:\a\cody\cody\playwright\chat_model_selector\videos\run_3_retry_0_failure.webm'
chat-input.test.ts:198:3 › chat model selector: vscode\test\e2e\chat-input.test.ts#L0
5) chat-input.test.ts:198:3 › chat model selector ──────────────────────────────────────────────── Test timeout of 30000ms exceeded.
chat-input.test.ts:198:3 › chat model selector: vscode\test\e2e\chat-input.test.ts#L218
4) chat-input.test.ts:198:3 › chat model selector ──────────────────────────────────────────────── Error: locator.click: Target page, context or browser has been closed Call log: - waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('listbox', { name: 'Suggestions' }).getByRole('option', { name: 'Claude 3 Haiku' }) - locator resolved to <div id=":r13:" cmdk-item="" role="option" aria-disabled="false" aria-selected="false" data-disabled="false" data-selected="false" title="Claude 3 Haiku by Anthropic" data-testid="chat-model-popover-option" data-value="anthropic::2023-06-01::claude-3-haiku-20240307" class="tw-relative tw-flex tw-cursor-pointer tw-select-none tw-items-center tw-py-3 tw-px-3 tw-text-md tw-outline-none aria-selected:tw-bg-accent aria-selected:tw-text-accent-foreground hover:tw-bg-accent hover:tw-text-accent-foreground…>…</div> - attempting click action - waiting for element to be visible, enabled and stable - element is not stable - retrying click action, attempt #1 - waiting for element to be visible, enabled and stable - element was detached from the DOM, retrying 216 | await modelSelect.click() 217 | const modelChoices = chatFrame.getByRole('listbox', { name: 'Suggestions' }) > 218 | await modelChoices.getByRole('option', { name: 'Claude 3 Haiku' }).click() | ^ 219 | const lastChatInput = getChatInputs(chatFrame).last() 220 | await expect(lastChatInput).toBeFocused() 221 | await expect(modelSelect).toHaveText(/^Claude 3 Haiku/) at D:\a\cody\cody\vscode\test\e2e\chat-input.test.ts:218:72
chat-input.test.ts:198:3 › chat model selector: vscode\test\e2e\chat-input.test.ts#L0
4) chat-input.test.ts:198:3 › chat model selector ──────────────────────────────────────────────── Test timeout of 30000ms exceeded.
chat-input.test.ts:198:3 › chat model selector: vscode\test\e2e\chat-input.test.ts#L0
3) chat-input.test.ts:198:3 › chat model selector ──────────────────────────────────────────────── Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\chat_model_selector\temp-videos\97f4f3ceefad9ac59fdd848a145c6771.webm' -> 'D:\a\cody\cody\playwright\chat_model_selector\videos\run_0_retry_0_failure.webm'
chat-input.test.ts:198:3 › chat model selector: vscode\test\e2e\chat-input.test.ts#L221
3) chat-input.test.ts:198:3 › chat model selector ──────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('combobox', { name: 'Select a model' }).last() Expected pattern: /^Claude 3 Haiku/ Received string: "Claude 3.5 Sonnet" Call log: - expect.toHaveText with timeout 5000ms - waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('combobox', { name: 'Select a model' }).last() - locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:rf:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button> - unexpected value "Claude 3.5 Sonnet" - locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:rf:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button> - unexpected value "Claude 3.5 Sonnet" - locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:r1g:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button> - unexpected value "Claude 3.5 Sonnet" - locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:r1g:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button> - unexpected value "Claude 3.5 Sonnet" - locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:r1g:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button> - unexpected value "Claude 3.5 Sonnet" - locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:r1g:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button> - unexpected value "Claude 3.5 Sonnet" - locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:r1g:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button> - unexpected value "Claude 3.5 Sonnet" - locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:r1g:" data
chat-atFile.test.ts:375:3 › Add Selection to Cody Chat: vscode\test\e2e\chat-atFile.test.ts#L394
2) chat-atFile.test.ts:375:3 › Add Selection to Cody Chat ──────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('textbox', { name: 'Chat message' }).last().locator('.context-item-mention-node') - Expected - 2 + Received + 1 Array [ "buzz.ts", - "buzz.ts:2-5", - "buzz.ts:7-10", + "buzz.ts:2-10", ] Call log: - expect.toHaveText with timeout 5000ms - waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('textbox', { name: 'Chat message' }).last().locator('.context-item-mention-node') - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements 392 | await selectLineRangeInEditorTab(page, 7, 10) 393 | await executeCommandInPalette(page, 'Cody: Add Selection to Cody Chat') > 394 | await expect(chatInputMentions(lastChatInput)).toHaveText(['buzz.ts', 'buzz.ts:2-5', 'buzz.ts:7-10']) | ^ 395 | }) 396 | at D:\a\cody\cody\vscode\test\e2e\chat-atFile.test.ts:394:52
chat-atFile.test.ts:316:3 › @-mention symbol in chat: vscode\test\e2e\common.ts#L180
1) chat-atFile.test.ts:316:3 › @-mention symbol in chat ────────────────────────────────────────── Error: locator.click: Target page, context or browser has been closed Call log: - waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Symbols' }) at common.ts:180 178 | ): Promise<void> { 179 | await chatInput.pressSequentially('@', { delay: 350 }) > 180 | await frame.getByRole('option', { name: provider, exact }).click() | ^ 181 | } 182 | 183 | export function mentionMenu(chatFrame: FrameLocator): Locator { at openMentionsForProvider (D:\a\cody\cody\vscode\test\e2e\common.ts:180:64) at D:\a\cody\cody\vscode\test\e2e\chat-atFile.test.ts:337:5
chat-atFile.test.ts:316:3 › @-mention symbol in chat: vscode\test\e2e\chat-atFile.test.ts#L0
1) chat-atFile.test.ts:316:3 › @-mention symbol in chat ────────────────────────────────────────── Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\__mention_symbol_in_chat\temp-videos\707b76ce871c16cec8766916730c16e8.webm' -> 'D:\a\cody\cody\playwright\__mention_symbol_in_chat\videos\run_1_retry_0_failure.webm'
chat-atFile.test.ts:316:3 › @-mention symbol in chat: vscode\test\e2e\chat-atFile.test.ts#L0
1) chat-atFile.test.ts:316:3 › @-mention symbol in chat ────────────────────────────────────────── Test timeout of 30000ms exceeded.
test-e2e (windows)
The process 'C:\Program Files\Git\bin\git.exe' failed with exit code 128
test-e2e (ubuntu)
The process '/usr/bin/git' failed with exit code 128
🎭 Playwright Run Summary
10 failed chat-atFile.test.ts:316:3 › @-mention symbol in chat ─────────────────────────────────────────── chat-atFile.test.ts:375:3 › Add Selection to Cody Chat ───────────────────────────────────────── chat-input.test.ts:198:3 › chat model selector ───────────────────────────────────────────────── chat-input.test.ts:198:3 › chat model selector ───────────────────────────────────────────────── chat-input.test.ts:198:3 › chat model selector ───────────────────────────────────────────────── command-commit.test.ts:23:3 › use terminal output as context ─────────────────────────────────── command-edit.test.ts:121:1 › edit (fixup) input - range selection ────────────────────────────── command-edit.test.ts:33:3 › edit (fixup) task ────────────────────────────────────────────────── command-edit.test.ts:33:3 › edit (fixup) task ────────────────────────────────────────────────── initial-context.test.ts:46:18 › initial context - file ───────────────────────────────────────── 60 skipped 154 passed (50.1m)
test-e2e (windows)
The windows-latest label will migrate from Windows Server 2022 to Windows Server 2025 beginning September 2, 2025. For more information see https://github.com/actions/runner-images/issues/12677
🎭 Playwright Run Summary
150 skipped 410 passed (1.8h)

Artifacts

Produced during runtime
Name Size Digest
playwright-recordings windows Expired
2.88 MB
sha256:d1a0c88cad5c67b191e10ae8c0b524bd98fe7a10a612f279819c50d14e013600