Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

test: task ui reports some flaky test failues on linux #1478

Open
ssbarnea opened this issue Aug 1, 2024 · 2 comments
Open

test: task ui reports some flaky test failues on linux #1478

ssbarnea opened this issue Aug 1, 2024 · 2 comments
Assignees
@TamiTakamiya
Labels
bug Something isn't working

Comments

@ssbarnea
Copy link
Member

ssbarnea commented Aug 1, 2024

Based on https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444

14 passing (6m)
[279](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:280)
  1 pending
[280](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:281)
  20 failing
[281](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:282)

[282](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:283)
  1) VSCode Ansible - UI tests
[283](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:284)
       Verify the presence of lightspeed element in the status bar and the explorer view
[284](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:285)
         Ansible Lightspeed status bar item absent when settings not enabled:
[285](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:286)
     Error: No editor with title 'playbook_1.yml' in group '0' available
[286](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:287)
      at EditorGroup.getTabByTitle (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:288:15)
[287](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:288)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[288](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:289)
      at async EditorGroup.openEditor (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:195:21)
[289](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:290)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedUiTest.js:64:13)
[290](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:291)

[291](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:292)
  2) VSCode Ansible - UI tests
[292](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:293)
       Verify the presence of lightspeed element in the status bar and the explorer view
[293](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:294)
         Ansible Lightspeed status bar item present when only lightspeed is enabled (with warning color):
[294](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:295)
     Error: No editor with title 'playbook_1.yml' in group '0' available
[295](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:296)
      at EditorGroup.getTabByTitle (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:288:15)
[296](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:297)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[297](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:298)
      at async EditorGroup.openEditor (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:195:21)
[298](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:299)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedUiTest.js:84:13)
[299](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:300)

[300](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:301)
  3) VSCode Ansible - UI tests
[301](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:302)
       Verify the presence of lightspeed element in the status bar and the explorer view
[302](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:303)
         Ansible Lightspeed status bar item present when lightspeed and lightspeed suggestions are enabled (with normal color):
[303](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:304)
     Error: No editor with title 'playbook_1.yml' in group '0' available
[304](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:305)
      at EditorGroup.getTabByTitle (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:288:15)
[305](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:306)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[306](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:307)
      at async EditorGroup.openEditor (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:195:21)
[307](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:308)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedUiTest.js:95:13)
[308](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:309)

[309](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:310)
  4) VSCode Ansible - UI tests
[310](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:311)
       Verify playbook generation and explanation features work as expected
[311](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:312)
         Playbook explanation webview works as expected:
[312](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:313)
     TypeError: Cannot read properties of undefined (reading 'openEditor')
[313](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:314)
      at EditorView.openEditor (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:49:22)
[314](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:315)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[315](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:316)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedUiTest.js:429:34)
[316](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:317)

[317](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:318)
  5) VSCode Ansible - UI tests
[318](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:319)
       Verify playbook generation and explanation features work as expected
[319](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:320)
         Playbook explanation webview with a playbook with no tasks:
[320](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:321)
     TypeError: Cannot read properties of undefined (reading 'openEditor')
[321](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:322)
      at EditorView.openEditor (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:49:22)
[322](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:323)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[323](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:324)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedUiTest.js:478:34)
[324](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:325)

[325](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:326)
  6) VSCode Ansible - UI tests
[326](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:327)
       Verify the execution of playbook using ansible-playbook command
[327](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:328)
         Execute ansible-playbook command with arg:
[328](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:329)
     AssertionError: expected 'runner@fv-az1344-837:~$ \n\n\n\n\n\n\n\n\n\n\n' to include 'ansible-playbook --syntax-check'
[329](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:330)
      at Context.<anonymous> (out/client/test/ui-test/terminalUiTest.js:29:38)
[330](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:331)

[331](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:332)
  7) VSCode Ansible - UI tests
[332](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:333)
       Verify the execution of playbook using ansible-playbook command
[333](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:334)
         Execute ansible-playbook command without arg:
[334](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:335)
     AssertionError: expected 'runner@fv-az1344-837:~$ \n\n\n\n\n\n\n\n\n\n\n' to include 'ansible-playbook '
[335](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:336)
      at Context.<anonymous> (out/client/test/ui-test/terminalUiTest.js:39:38)
[336](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:337)

[337](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:338)
  8) VSCode Ansible - UI tests
[338](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:339)
       Verify the execution of playbook using ansible-navigator command
[339](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:340)
         Execute playbook with ansible-navigator EE mode:
[340](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:341)
     AssertionError: expected 'runner@fv-az1344-837:~$ \n\n\n\n\n\n\n\n\n\n\n' to include 'Play '
[341](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:342)
      at Context.<anonymous> (out/client/test/ui-test/terminalUiTest.js:65:42)
[342](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:343)

[343](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:344)
  9) VSCode Ansible - UI tests
[344](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:345)
       Verify the execution of playbook using ansible-navigator command
[345](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:346)
         Execute playbook with ansible-navigator without EE mode:
[346](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:347)
     AssertionError: expected 'runner@fv-az1344-837:~$ \n\n\n\n\n\n\n\n\n\n\n' to include 'Play '
[347](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:348)
      at Context.<anonymous> (out/client/test/ui-test/terminalUiTest.js:79:38)
[348](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:349)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[349](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:350)

[350](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:351)
  10) VSCode Ansible - UI tests
[351](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:352)
       Test One Click Trial feature
[352](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:353)
         Click Open if a dialog shows up for opening the external website:
[353](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:354)
     Error: Timeout of 30000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/runner/work/vscode-ansible/vscode-ansible/out/client/test/ui-test/allTestsSuite.js)
[354](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:355)
      at listOnTimeout (node:internal/timers:569:17)
[355](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:356)
      at process.processTimers (node:internal/timers:512:7)
[356](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:357)

[357](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:358)
  11) VSCode Ansible - UI tests
[358](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:359)
       Test One Click Trial feature
[359](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:360)
         Click Open to open the callback URI:
[360](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:361)

[361](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:362)
      AssertionError: expected 'Do you want Code to open the external website?' to equal 'Allow \'Ansible\' extension to open this URI?'
[362](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:363)
      + expected - actual
[363](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:364)

[364](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:365)
      -Do you want Code to open the external website?
[365](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:366)
      +Allow 'Ansible' extension to open this URI?
[366](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:367)
      
[367](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:368)
      at Context.<anonymous> (out/client/test/ui-test/lightspeedOneClickTrialUITest.js:73:47)
[368](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:369)
      at process.processImmediate (node:internal/timers:476:21)
[369](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:370)

[370](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:371)
  12) VSCode Ansible - UI tests
[371](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:372)
       Test One Click Trial feature
[372](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:373)
         Verify Ansible Lightspeed webview now contains user's information:
[373](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:374)
     AssertionError: expected 'Experience smarter automation using Ansible Lightspeed with watsonx Code Assistant solutions for your playbook. Learn more\nConnect' to include 'Logged in as: ONE_CLICK_USER (unlicensed)'
[374](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:375)
      at Context.<anonymous> (out/client/test/ui-test/lightspeedOneClickTrialUITest.js:81:38)
[375](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:376)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[376](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:377)

[377](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:378)
  13) VSCode Ansible - UI tests
[378](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:379)
       Test One Click Trial feature
[379](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:380)
         Verify the Refresh icon is found on the title of Explorer view:
[380](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:381)
     NoSuchElementError: no such element: Unable to locate element: {"method":"xpath","selector":"//a[contains(@class, 'codicon-refresh')]"}
[381](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:382)
  (Session info: chrome=122.0.6261.156)
[382](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:383)
      at Object.throwDecodedError (node_modules/selenium-webdriver/lib/error.js:521:15)
[383](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:384)
      at parseHttpResponse (node_modules/selenium-webdriver/lib/http.js:514:13)
[384](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:385)
      at Executor.execute (node_modules/selenium-webdriver/lib/http.js:446:28)
[385](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:386)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[386](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:387)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:742:17)
[387](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:388)
      at async WebviewViewBase.findWebElement (node_modules/@redhat-developer/page-objects/out/components/WebviewMixin.js:42:20)
[388](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:389)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedOneClickTrialUITest.js:86:33)
[389](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:390)

[390](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:391)
  14) VSCode Ansible - UI tests
[391](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:392)
       Test One Click Trial feature
[392](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:393)
         Invoke Playbook generation without experimental features enabled:
[393](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:394)
     NoSuchElementError: no such element: Unable to locate element: {"method":"css selector","selector":".monaco-workbench"}
[394](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:395)
  (Session info: chrome=122.0.6261.156)
[395](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:396)
      at Object.throwDecodedError (node_modules/selenium-webdriver/lib/error.js:521:15)
[396](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:397)
      at parseHttpResponse (node_modules/selenium-webdriver/lib/http.js:514:13)
[397](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:398)
      at Executor.execute (node_modules/selenium-webdriver/lib/http.js:446:28)
[398](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:399)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[399](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:400)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:742:17)
[400](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:401)
      at async toWireValue (node_modules/selenium-webdriver/lib/webdriver.js:147:15)
[401](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:402)
      at async /home/runner/work/vscode-ansible/vscode-ansible/node_modules/selenium-webdriver/lib/webdriver.js:193:16
[402](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:403)
      at async forEachKey (node_modules/selenium-webdriver/lib/webdriver.js:187:9)
[403](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:404)
      at async convertKeys (node_modules/selenium-webdriver/lib/webdriver.js:192:3)
[404](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:405)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:740:22)
[405](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:406)

[406](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:407)
  15) VSCode Ansible - UI tests
[407](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:408)
       Test One Click Trial feature
[408](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:409)
         Invoke Playbook generation with experimental features enabled:
[409](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:410)
     NoSuchElementError: no such element: Unable to locate element: {"method":"css selector","selector":".monaco-workbench"}
[410](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:411)
  (Session info: chrome=122.0.6261.156)
[411](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:412)
      at Object.throwDecodedError (node_modules/selenium-webdriver/lib/error.js:521:15)
[412](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:413)
      at parseHttpResponse (node_modules/selenium-webdriver/lib/http.js:514:13)
[413](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:414)
      at Executor.execute (node_modules/selenium-webdriver/lib/http.js:446:28)
[414](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:415)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[415](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:416)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:742:17)
[416](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:417)
      at async toWireValue (node_modules/selenium-webdriver/lib/webdriver.js:147:15)
[417](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:418)
      at async /home/runner/work/vscode-ansible/vscode-ansible/node_modules/selenium-webdriver/lib/webdriver.js:193:16
[418](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:419)
      at async forEachKey (node_modules/selenium-webdriver/lib/webdriver.js:187:9)
[419](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:420)
      at async convertKeys (node_modules/selenium-webdriver/lib/webdriver.js:192:3)
[420](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:421)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:740:22)
[421](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:422)

[422](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:423)
  16) VSCode Ansible - UI tests
[423](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:424)
       Test One Click Trial feature
[424](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:425)
         Invoke Playbook explanation with experimental features enabled:
[425](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:426)
     Error: Timeout of 30000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/runner/work/vscode-ansible/vscode-ansible/out/client/test/ui-test/allTestsSuite.js)
[426](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:427)
      at listOnTimeout (node:internal/timers:569:17)
[427](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:428)
      at process.processTimers (node:internal/timers:512:7)
[428](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:429)

[429](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:430)
  17) VSCode Ansible - UI tests
[430](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:431)
       Test One Click Trial feature
[431](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:432)
         Invoke Completion with experimental features enabled:
[432](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:433)
     Error: Timeout of 30000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/runner/work/vscode-ansible/vscode-ansible/out/client/test/ui-test/allTestsSuite.js)
[433](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:434)
      at listOnTimeout (node:internal/timers:569:17)
[434](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:435)
      at process.processTimers (node:internal/timers:512:7)
[435](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:436)

[436](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:437)
  18) VSCode Ansible - UI tests
[437](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:438)
       Test One Click Trial feature
[438](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:439)
         Sign out using Accounts global action:
[439](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:440)
     NoSuchElementError: no such element: Unable to locate element: {"method":"css selector","selector":".monaco-workbench"}
[440](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:441)
  (Session info: chrome=122.0.6261.156)
[441](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:442)
      at Object.throwDecodedError (node_modules/selenium-webdriver/lib/error.js:521:15)
[442](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:443)
      at parseHttpResponse (node_modules/selenium-webdriver/lib/http.js:514:13)
[443](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:444)
      at Executor.execute (node_modules/selenium-webdriver/lib/http.js:446:28)
[444](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:445)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[445](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:446)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:742:17)
[446](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:447)
      at async toWireValue (node_modules/selenium-webdriver/lib/webdriver.js:147:15)
[447](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:448)
      at async /home/runner/work/vscode-ansible/vscode-ansible/node_modules/selenium-webdriver/lib/webdriver.js:193:16
[448](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:449)
      at async forEachKey (node_modules/selenium-webdriver/lib/webdriver.js:187:9)
[449](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:450)
      at async convertKeys (node_modules/selenium-webdriver/lib/webdriver.js:192:3)
[450](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:451)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:740:22)
[451](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:452)

[452](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:453)
  19) VSCode Ansible - UI tests
[453](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:454)
       Test One Click Trial feature
[454](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:455)
         Click Sign Out button on the modal dialog:
[455](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:456)
     NoSuchElementError: no such element: Unable to locate element: {"method":"css selector","selector":".monaco-dialog-box"}
[456](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:457)
  (Session info: chrome=122.0.6261.156)
[457](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:458)
      at Object.throwDecodedError (node_modules/selenium-webdriver/lib/error.js:521:15)
[458](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:459)
      at parseHttpResponse (node_modules/selenium-webdriver/lib/http.js:514:13)
[459](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:460)
      at Executor.execute (node_modules/selenium-webdriver/lib/http.js:446:28)
[460](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:461)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[461](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:462)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:742:17)
[462](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:463)
      at async toWireValue (node_modules/selenium-webdriver/lib/webdriver.js:147:15)
[463](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:464)
      at async /home/runner/work/vscode-ansible/vscode-ansible/node_modules/selenium-webdriver/lib/webdriver.js:193:16
[464](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:465)
      at async forEachKey (node_modules/selenium-webdriver/lib/webdriver.js:187:9)
[465](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:466)
      at async convertKeys (node_modules/selenium-webdriver/lib/webdriver.js:192:3)
[466](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:467)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:740:22)
[467](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:468)

[468](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:469)
  20) VSCode Ansible - UI tests
[469](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:470)
       Test One Click Trial feature
[470](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:471)
         Verify the notification message:
[471](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:472)

[472](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:473)
      AssertionError: expected +0 to be above +0
[473](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:474)
      + expected - actual
[474](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:475)

[475](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:476)

[476](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:477)
      at expectNotification (out/client/test/ui-test/uiTestHelper.js:58:46)
[477](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:478)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[478](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:479)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedOneClickTrialUITest.js:187:13)
[479](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:480)

[480](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:481)

[481](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:482)

[482](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:483)
INFO: Screenshots of failures can be found in: /home/runner/work/vscode-ansible/vscode-ansible/out/test-resources/screenshots
[483](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:484)

[484](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:485)
Error: Command failed with exit code 1: TEST_LIGHTSPEED_ACCESS_TOKEN=dummy TEST_LIGHTSPEED_URL=http://ip6-localhost:3000 yarn coverage-ui-current
[485](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:486)
    at makeError (/home/runner/work/vscode-ansible/vscode-ansible/node_modules/start-server-and-test/node_modules/execa/lib/error.js:60:11)
[486](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:487)
    at handlePromise (/home/runner/work/vscode-ansible/vscode-ansible/node_modules/start-server-and-test/node_modules/execa/index.js:118:26)
[487](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:488)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5) {
[488](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:489)
  shortMessage: 'Command failed with exit code 1: TEST_LIGHTSPEED_ACCESS_TOKEN=dummy TEST_LIGHTSPEED_URL=http://ip6-localhost:3000 yarn coverage-ui-current',
[489](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:490)
  command: 'TEST_LIGHTSPEED_ACCESS_TOKEN=dummy TEST_LIGHTSPEED_URL=http://ip6-localhost:3000 yarn coverage-ui-current',
[490](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:491)
  escapedCommand: '"TEST_LIGHTSPEED_ACCESS_TOKEN=dummy TEST_LIGHTSPEED_URL=http://ip6-localhost:3000 yarn coverage-ui-current"',
[491](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:492)
  exitCode: 1,
[492](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:493)
  signal: undefined,
[493](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:494)
  signalDescription: undefined,
[494](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:495)
  stdout: undefined,
[495](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:496)
  stderr: undefined,
[496](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:497)
  failed: true,
[497](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:498)
  timedOut: false,
[498](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:499)
  isCanceled: false,
[499](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:500)
  killed: false
[500](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:501)
}
[501](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:502)
task: Failed to run task "test-ui": exit status 1
@ssbarnea ssbarnea added the bug Something isn't working label Aug 1, 2024
@tima
Copy link

tima commented Aug 28, 2024

@TamiTakamiya Can you confirm this is one of your Lightspeed test or is this something underlying in the framework?

@TamiTakamiya TamiTakamiya self-assigned this Aug 28, 2024
@TamiTakamiya
Copy link
Collaborator

@tima It is true that a few Lightspeed tests occasionally fails in CI even though the reason is not perfectly clear. I assign this to myself anyway.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@TamiTakamiya TamiTakamiya

Labels
bug Something isn't working
Projects
🧰 devtools project board
Status: No status
Milestone
No milestone
Development

No branches or pull requests
3 participants
@tima @ssbarnea @TamiTakamiya