e2e-flakiness-detector #238
Annotations
6 errors and 1 notice
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/chat-atFile.test.ts#L89
1) chat-atFile.test.ts:35:3 › @-mention file in chat ─────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
87 | await chatInput.fill('')
88 | await chatInput.pressSequentially('@mj', { delay: 350 })
> 89 | await expect(chatPanelFrame.getByRole('option', { name: 'Main.java' })).toBeVisible()
| ^
90 | await chatInput.fill('clear')
91 |
92 | // Searching and clicking
at /home/runner/work/cody/cody/vscode/test/e2e/chat-atFile.test.ts:89:77
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/chat-atFile.test.ts#L89
2) chat-atFile.test.ts:35:3 › @-mention file in chat ─────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
87 | await chatInput.fill('')
88 | await chatInput.pressSequentially('@mj', { delay: 350 })
> 89 | await expect(chatPanelFrame.getByRole('option', { name: 'Main.java' })).toBeVisible()
| ^
90 | await chatInput.fill('clear')
91 |
92 | // Searching and clicking
at /home/runner/work/cody/cody/vscode/test/e2e/chat-atFile.test.ts:89:77
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/chat-input.test.ts#L224
3) chat-input.test.ts:194:3 › chat model selector ────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('combobox', { name: 'Select a model' }).last()
Expected pattern: /^Claude 3 Haiku/
Received string: "Claude 3.5 Sonnet"
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('combobox', { name: 'Select a model' }).last()
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-label="Select a model" aria-controls="radix-:r10:" data-testid="chat-model-selector" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_rqosg_5 _button--secondary_rqosg_54 _button--no-icon-start_rqosg_45">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-label="Select a model" aria-controls="radix-:r10:" data-testid="chat-model-selector" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_rqosg_5 _button--secondary_rqosg_54 _button--no-icon-start_rqosg_45">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-label="Select a model" aria-controls="radix-:r10:" data-testid="chat-model-selector" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_rqosg_5 _button--secondary_rqosg_54 _button--no-icon-start_rqosg_45">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-label="Select a model" aria-controls="radix-:r10:" data-testid="chat-model-selector" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_rqosg_5 _button--secondary_rqosg_54 _button--no-icon-start_rqosg_45">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-label="Select a model" aria-controls="radix-:r10:" data-testid="chat-model-selector" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_rqosg_5 _button--secondary_rqosg_54 _button--no-icon-start_rqosg_45">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-label="Select a model" aria-controls="radix-:r10:" data-testid="chat-model-selector" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_rqosg_5 _button--secondary_rqosg_54 _button--no-icon-start_rqosg_45">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-label="Select a model" aria-controls="radix-:r10:" data-testid="chat-model-selector" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_rqosg_5 _button--secondary_rqosg_54 _button--no-icon-start_rqosg_45">…</button>
- unexpected value "Claude 3.5 Sonnet"
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-label="Select a model" aria-controls="radix-:r10:" data-testid="chat-model-selector" class="tw-border-none tw
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/chat-keyboard-shortcuts.test.ts#L1
4) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ─────────────────────────
Test timeout of 30000ms exceeded.
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0:
vscode/test/e2e/common.ts#L179
4) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ─────────────────────────
Error: locator.fill: Target page, context or browser has been closed
Call log:
- waiting for getByPlaceholder('Type the name of a command to run.')
- locator resolved to <input wrap="off" type="text" class="input" role="combobox" autocorrect="off" spellcheck="false" aria-label="input" custom-hover="true" autocapitalize="off" aria-haspopup="menu" aria-expanded="true" aria-autocomplete="list" aria-controls="quickInput_list" aria-activedescendant="list_id_4_0" aria-describedby="quickInput_message" placeholder="Type the name of a command to run."/>
- fill("buzz.ts")
- attempting fill action
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #1
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0
Process completed with exit code 1.
|
Run xvfb-run -a pnpm -C vscode run test:e2e --repeat-each 10 --retries 0
4 failed
chat-atFile.test.ts:35:3 › @-mention file in chat ──────────────────────────────────────────────
chat-atFile.test.ts:35:3 › @-mention file in chat ──────────────────────────────────────────────
chat-input.test.ts:194:3 › chat model selector ─────────────────────────────────────────────────
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ──────────────────────────
30 skipped
436 passed (1.8h)
|
Loading