[🐛 Bug]: Selenium tests failing on download

[cjproud]

What happened?

We have some tests that run on a self-hosted runner that uses the standalone-chrome container as a service. I've noticed that some of these tests now fail on selenium/standalone-chrome:latest but successfully ran on the selenium/standalone-chrome:119.0 image. The specific tests were checking if a file download was successful.

Command used to start Selenium Grid with Docker

jobs: 
  test-lint:
    name: Test
    runs-on: [self-hosted, integration_tests]
    container: 
      image: ubuntu:22.04
      options: --name test
      volumes:
        - tmp_volume:/tmp_volume
    # Service containers to run with `container-job`
    services:
      # Label used to access the service container
      selenium_test:
        image: selenium/standalone-chrome
        ports: 
          - 4444:4444
          - 7900:7900
        env:
          SE_SCREEN_WIDTH: 1920
          SE_SCREEN_HEIGHT: 1080
        options: >-
          --shm-size 2gb
          --name selenium
        volumes:
          - tmp_volume:/tmp_volume

Relevant log output

FAIL: test_export_results (design.tests.integrations_tests.test_results_page.ResultsTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/__w/<Folder1>/<App1>/<Folder2>/design/tests/integrations_tests/test_results_page.py", line 53, in test_export_results
    self.assertEquals(temp_files[0], "Test Simulation - Current.xlsx")
AssertionError: 'Test Simulation - Current.xlsx.crdownload' != 'Test Simulation - Current.xlsx'
- Test Simulation - Current.xlsx.crdownload
?                               -----------
+ Test Simulation - Current.xlsx

Operating System

Ubuntu

Docker Selenium version (tag)

4.15.0-20231128

[github-actions]

@cjproud, thank you for creating this issue. We will troubleshoot it as soon as we can.

---

Info for maintainers

Triage this issue by using labels.

If information is missing, add a helpful comment and then I-issue-template label.

If the issue is a question, add the I-question label.

If the issue is valid but there is no time to troubleshoot it, consider adding the help wanted label.

If the issue requires changes or fixes from an external project (e.g., ChromeDriver, GeckoDriver, MSEdgeDriver, W3C), add the applicable G-* label, and it will provide the correct link and auto-close the issue.

After troubleshooting the issue, please add the R-awaiting answer label.

Thank you!

[diemol]

@VietND96 we switched to Chrome for Testing, which might be the reason for this issue. Probably we need to revert 82603e9 and use the regular Chrome.

[VietND96]

Hello @cjproud, may I know in your test is adding these args or not?

options.addArguments("--incognito")
options.addArguments("disable-features=DownloadBubble,DownloadBubbleV2")

In these 2 images, there is Chrome version different also
selenium/standalone-chrome:119.0 -> 119.0.6045.159
selenium/standalone-chrome:latest -> 119.0.6045.105

[VietND96]

Ok, let's ignore the args. Something that I am able to reproduce when the docker volume is set to mount /home/seluser/Downloads, if permission is improper, the download is not triggered.
In your case, it is able to download, but the file with extension .crdownload which means the download is still in progress or stuck somewhere.
I will continue check this, if there is no clue, commit switch to Chrome for Testing will be reverted

[github-actions]

This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.