e2e-flakiness-detector #39
Annotations
10 errors, 2 warnings, and 3 notices
|
chat-input.test.ts:198:3 › chat model selector:
vscode\test\e2e\chat-input.test.ts#L0
5) chat-input.test.ts:198:3 › chat model selector ────────────────────────────────────────────────
Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\chat_model_selector\temp-videos\782cfac03e58bec6998a9c3c84ef79c9.webm' -> 'D:\a\cody\cody\playwright\chat_model_selector\videos\run_3_retry_0_failure.webm'
|
|
chat-input.test.ts:198:3 › chat model selector:
vscode\test\e2e\chat-input.test.ts#L0
5) chat-input.test.ts:198:3 › chat model selector ────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
chat-input.test.ts:198:3 › chat model selector:
vscode\test\e2e\chat-input.test.ts#L218
4) chat-input.test.ts:198:3 › chat model selector ────────────────────────────────────────────────
Error: locator.click: Target page, context or browser has been closed
Call log:
- waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('listbox', { name: 'Suggestions' }).getByRole('option', { name: 'Claude 3 Haiku' })
- locator resolved to <div id=":r13:" cmdk-item="" role="option" aria-disabled="false" aria-selected="false" data-disabled="false" data-selected="false" title="Claude 3 Haiku by Anthropic" data-testid="chat-model-popover-option" data-value="anthropic::2023-06-01::claude-3-haiku-20240307" class="tw-relative tw-flex tw-cursor-pointer tw-select-none tw-items-center tw-py-3 tw-px-3 tw-text-md tw-outline-none aria-selected:tw-bg-accent aria-selected:tw-text-accent-foreground hover:tw-bg-accent hover:tw-text-accent-foreground…>…</div>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is not stable
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element was detached from the DOM, retrying
216 | await modelSelect.click()
217 | const modelChoices = chatFrame.getByRole('listbox', { name: 'Suggestions' })
> 218 | await modelChoices.getByRole('option', { name: 'Claude 3 Haiku' }).click()
| ^
219 | const lastChatInput = getChatInputs(chatFrame).last()
220 | await expect(lastChatInput).toBeFocused()
221 | await expect(modelSelect).toHaveText(/^Claude 3 Haiku/)
at D:\a\cody\cody\vscode\test\e2e\chat-input.test.ts:218:72
|
|
chat-input.test.ts:198:3 › chat model selector:
vscode\test\e2e\chat-input.test.ts#L0
4) chat-input.test.ts:198:3 › chat model selector ────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
chat-input.test.ts:198:3 › chat model selector:
vscode\test\e2e\chat-input.test.ts#L0
3) chat-input.test.ts:198:3 › chat model selector ────────────────────────────────────────────────
Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\chat_model_selector\temp-videos\97f4f3ceefad9ac59fdd848a145c6771.webm' -> 'D:\a\cody\cody\playwright\chat_model_selector\videos\run_0_retry_0_failure.webm'
|
|
chat-input.test.ts:198:3 › chat model selector:
vscode\test\e2e\chat-input.test.ts#L221
3) chat-input.test.ts:198:3 › chat model selector ────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('combobox', { name: 'Select a model' }).last()
Expected pattern: /^Claude 3 Haiku/
Received string: "Claude 3.5 Sonnet"
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('combobox', { name: 'Select a model' }).last()
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:rf:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:rf:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:r1g:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:r1g:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:r1g:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:r1g:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:r1g:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:r1g:" data
|
|
chat-atFile.test.ts:375:3 › Add Selection to Cody Chat:
vscode\test\e2e\chat-atFile.test.ts#L394
2) chat-atFile.test.ts:375:3 › Add Selection to Cody Chat ────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('textbox', { name: 'Chat message' }).last().locator('.context-item-mention-node')
- Expected - 2
+ Received + 1
Array [
"buzz.ts",
- "buzz.ts:2-5",
- "buzz.ts:7-10",
+ "buzz.ts:2-10",
]
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('textbox', { name: 'Chat message' }).last().locator('.context-item-mention-node')
- locator resolved to 2 elements
- locator resolved to 2 elements
- locator resolved to 2 elements
- locator resolved to 2 elements
- locator resolved to 2 elements
- locator resolved to 2 elements
- locator resolved to 2 elements
- locator resolved to 2 elements
392 | await selectLineRangeInEditorTab(page, 7, 10)
393 | await executeCommandInPalette(page, 'Cody: Add Selection to Cody Chat')
> 394 | await expect(chatInputMentions(lastChatInput)).toHaveText(['buzz.ts', 'buzz.ts:2-5', 'buzz.ts:7-10'])
| ^
395 | })
396 |
at D:\a\cody\cody\vscode\test\e2e\chat-atFile.test.ts:394:52
|
|
chat-atFile.test.ts:316:3 › @-mention symbol in chat:
vscode\test\e2e\common.ts#L180
1) chat-atFile.test.ts:316:3 › @-mention symbol in chat ──────────────────────────────────────────
Error: locator.click: Target page, context or browser has been closed
Call log:
- waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Symbols' })
at common.ts:180
178 | ): Promise<void> {
179 | await chatInput.pressSequentially('@', { delay: 350 })
> 180 | await frame.getByRole('option', { name: provider, exact }).click()
| ^
181 | }
182 |
183 | export function mentionMenu(chatFrame: FrameLocator): Locator {
at openMentionsForProvider (D:\a\cody\cody\vscode\test\e2e\common.ts:180:64)
at D:\a\cody\cody\vscode\test\e2e\chat-atFile.test.ts:337:5
|
|
chat-atFile.test.ts:316:3 › @-mention symbol in chat:
vscode\test\e2e\chat-atFile.test.ts#L0
1) chat-atFile.test.ts:316:3 › @-mention symbol in chat ──────────────────────────────────────────
Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\__mention_symbol_in_chat\temp-videos\707b76ce871c16cec8766916730c16e8.webm' -> 'D:\a\cody\cody\playwright\__mention_symbol_in_chat\videos\run_1_retry_0_failure.webm'
|
|
chat-atFile.test.ts:316:3 › @-mention symbol in chat:
vscode\test\e2e\chat-atFile.test.ts#L0
1) chat-atFile.test.ts:316:3 › @-mention symbol in chat ──────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
test-e2e (windows)
The process 'C:\Program Files\Git\bin\git.exe' failed with exit code 128
|
|
test-e2e (ubuntu)
The process '/usr/bin/git' failed with exit code 128
|
|
🎭 Playwright Run Summary
10 failed
chat-atFile.test.ts:316:3 › @-mention symbol in chat ───────────────────────────────────────────
chat-atFile.test.ts:375:3 › Add Selection to Cody Chat ─────────────────────────────────────────
chat-input.test.ts:198:3 › chat model selector ─────────────────────────────────────────────────
chat-input.test.ts:198:3 › chat model selector ─────────────────────────────────────────────────
chat-input.test.ts:198:3 › chat model selector ─────────────────────────────────────────────────
command-commit.test.ts:23:3 › use terminal output as context ───────────────────────────────────
command-edit.test.ts:121:1 › edit (fixup) input - range selection ──────────────────────────────
command-edit.test.ts:33:3 › edit (fixup) task ──────────────────────────────────────────────────
command-edit.test.ts:33:3 › edit (fixup) task ──────────────────────────────────────────────────
initial-context.test.ts:46:18 › initial context - file ─────────────────────────────────────────
60 skipped
154 passed (50.1m)
|
|
test-e2e (windows)
The windows-latest label will migrate from Windows Server 2022 to Windows Server 2025 beginning September 2, 2025. For more information see https://github.com/actions/runner-images/issues/12677
|
|
🎭 Playwright Run Summary
150 skipped
410 passed (1.8h)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
playwright-recordings windows
Expired
|
2.88 MB |
sha256:d1a0c88cad5c67b191e10ae8c0b524bd98fe7a10a612f279819c50d14e013600
|
|