Conda install regression #591

rsxdalv · 2024-12-17T18:53:26Z

Checklist

I added a descriptive title
I searched open reports and couldn't find a duplicate

What happened?

!conda install -y -k pytorch[version=2.3.1,build=py3.10_cuda11.8*] -c pytorch -c nvidia/label/cuda-11.8.0 -c nvidia

Stopped working between conda 24.9.1 (works) and conda conda 24.11.1

Channels:
 - pytorch
 - nvidia/label/cuda-11.8.0
 - nvidia
 - conda-forge
Platform: linux-64
Collecting package metadata (repodata.json): done
Solving environment: failed

PackagesNotFoundError: The following packages are not available from current channels:

  - pytorch==2.3.1[build='^py3.10_cuda11.8*$']

Current channels:

  - https://conda.anaconda.org/pytorch
  - https://conda.anaconda.org/nvidia/label/cuda-11.8.0
  - https://conda.anaconda.org/nvidia
  - https://conda.anaconda.org/conda-forge

To search for alternate channels that may provide the conda package you're
looking for, navigate to

    https://anaconda.org/

and use the search bar at the top of the page.

The problem happens on both Windows and Linux; on several different machines.

What I suspect is that there was a breaking change that disobeyed semver and the * operator no longer works like it used to.

Conda Info

active environment : None
       user config file : /root/.condarc
 populated config files : /usr/local/.condarc
          conda version : 24.11.1
    conda-build version : not installed
         python version : 3.10.16.final.0
                 solver : libmamba (default)
       virtual packages : __archspec=1=broadwell
                          __conda=24.11.1=0
                          __glibc=2.35=0
                          __linux=6.1.85=0
                          __unix=0=0
       base environment : /usr/local  (writable)
      conda av data dir : /usr/local/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
          package cache : /usr/local/pkgs
                          /root/.conda/pkgs
       envs directories : /usr/local/envs
                          /root/.conda/envs
               platform : linux-64
             user-agent : conda/24.11.1 requests/2.32.3 CPython/3.10.16 Linux/6.1.85+ ubuntu/22.04.3 glibc/2.35 solver/libmamba conda-libmamba-solver/24.11.1 libmambapy/2.0.5
                UID:GID : 0:0
             netrc file : None
           offline mode : False

Conda Config

Conda list

Additional Context

No response

The text was updated successfully, but these errors were encountered:

travishathaway · 2024-12-18T08:35:23Z

@rsxdalv,

Thanks for filing this issue. We'll happy to help track down the source of the possible regression, but I'm currently having a difficult time recreating the error.

When I run the command as you have written it, everything works on the command line via a normal terminal (iTerm2 in my case). But, I can see that your command begins with a !. Are you running this through some sort of Jyputer notebook?

To figure out why this is happening, I believe we need to figure out why this:

pytorch[version=2.3.1,build=py3.10_cuda11.8*]

Is being converted to this:

pytorch[version=2.3.1,build='^py3.10_cuda11.8*$']

For more context, I've included the install plan that was generated when running the command directly inside of a docker container:

Package install plan

(base) root@daa068daec1a:/# conda create --name test pytorch[version=2.3.1,build=py3.10_cuda11.8*] -c pytorch -c nvidia/label/cuda-11.8.0 -c nvidia -c conda-forge --override-channels --dry-run
Channels:
 - pytorch
 - nvidia/label/cuda-11.8.0
 - nvidia
 - conda-forge
Platform: linux-64
Collecting package metadata (repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /opt/conda/envs/test

  added / updated specs:
    - pytorch==2.3.1[build=py3.10_cuda11.8*]


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    _libgcc_mutex-0.1          |      conda_forge           3 KB  conda-forge
    _openmp_mutex-4.5          |       2_kmp_llvm           6 KB  conda-forge
    blas-1.0                   |              mkl           1 KB  conda-forge
    bzip2-1.0.8                |       h4bc722e_7         247 KB  conda-forge
    ca-certificates-2024.12.14 |       hbcca054_0         153 KB  conda-forge
    cpython-3.10.16            |  py310hd8ed1ab_1          48 KB  conda-forge
    cuda-cudart-11.8.89        |                0         197 KB  nvidia/label/cuda-11.8.0
    cuda-cupti-11.8.87         |                0        25.3 MB  nvidia/label/cuda-11.8.0
    cuda-libraries-11.8.0      |                0           1 KB  nvidia/label/cuda-11.8.0
    cuda-nvrtc-11.8.89         |                0        19.1 MB  nvidia/label/cuda-11.8.0
    cuda-nvtx-11.8.86          |                0          57 KB  nvidia/label/cuda-11.8.0
    cuda-runtime-11.8.0        |                0           1 KB  nvidia/label/cuda-11.8.0
    filelock-3.16.1            |     pyhd8ed1ab_1          17 KB  conda-forge
    gmp-6.3.0                  |       hac33072_2         449 KB  conda-forge
    gmpy2-2.1.5                |  py310he8512ff_3         198 KB  conda-forge
    jinja2-3.1.4               |     pyhd8ed1ab_1         108 KB  conda-forge
    ld_impl_linux-64-2.43      |       h712a8e2_2         654 KB  conda-forge
    libcublas-11.11.3.6        |                0       364.0 MB  nvidia/label/cuda-11.8.0
    libcufft-10.9.0.58         |                0       142.8 MB  nvidia/label/cuda-11.8.0
    libcufile-1.4.0.31         |                0         548 KB  nvidia/label/cuda-11.8.0
    libcurand-10.3.0.86        |                0        53.2 MB  nvidia/label/cuda-11.8.0
    libcusolver-11.4.1.48      |                0        96.5 MB  nvidia/label/cuda-11.8.0
    libcusparse-11.7.5.86      |                0       176.3 MB  nvidia/label/cuda-11.8.0
    libffi-3.4.2               |       h7f98852_5          57 KB  conda-forge
    libgcc-14.2.0              |       h77fa898_1         829 KB  conda-forge
    libgcc-ng-14.2.0           |       h69a702a_1          53 KB  conda-forge
    libhwloc-2.11.2            |default_h0d58e46_1001         2.3 MB  conda-forge
    libiconv-1.17              |       hd590300_2         689 KB  conda-forge
    liblzma-5.6.3              |       hb9d3cd8_1         109 KB  conda-forge
    libnpp-11.8.0.86           |                0       147.8 MB  nvidia/label/cuda-11.8.0
    libnsl-2.0.1               |       hd590300_0          33 KB  conda-forge
    libnvjpeg-11.9.0.86        |                0         2.4 MB  nvidia/label/cuda-11.8.0
    libsqlite-3.47.2           |       hee588c1_0         853 KB  conda-forge
    libstdcxx-14.2.0           |       hc0a3c3a_1         3.7 MB  conda-forge
    libstdcxx-ng-14.2.0        |       h4852527_1          53 KB  conda-forge
    libuuid-2.38.1             |       h0b41bf4_0          33 KB  conda-forge
    libxcrypt-4.4.36           |       hd590300_1          98 KB  conda-forge
    libxml2-2.13.5             |       h0d44e9d_1         674 KB  conda-forge
    libzlib-1.3.1              |       hb9d3cd8_2          60 KB  conda-forge
    llvm-openmp-15.0.7         |       h0cdce71_0         3.1 MB  conda-forge
    markupsafe-3.0.2           |  py310h89163eb_1          23 KB  conda-forge
    mkl-2023.0.0               |   h84fe81f_26648       154.0 MB  conda-forge
    mpc-1.3.1                  |       h24ddda3_1         114 KB  conda-forge
    mpfr-4.2.1                 |       h90cbb55_3         620 KB  conda-forge
    mpmath-1.3.0               |     pyhd8ed1ab_1         429 KB  conda-forge
    ncurses-6.5                |       he02047a_1         868 KB  conda-forge
    networkx-3.4.2             |     pyh267e887_2         1.2 MB  conda-forge
    openssl-3.4.0              |       hb9d3cd8_0         2.8 MB  conda-forge
    pip-24.3.1                 |     pyh8b19718_2         1.2 MB  conda-forge
    python-3.10.16             |he725a3c_1_cpython        24.0 MB  conda-forge
    python_abi-3.10            |          5_cp310           6 KB  conda-forge
    pytorch-2.3.1              |py3.10_cuda11.8_cudnn8.7.0_0        1.56 GB  pytorch
    pytorch-cuda-11.8          |       h7e8668a_6           7 KB  pytorch
    pytorch-mutex-1.0          |             cuda           3 KB  pytorch
    pyyaml-6.0.2               |  py310ha75aee5_1         178 KB  conda-forge
    readline-8.2               |       h8228510_1         275 KB  conda-forge
    setuptools-75.6.0          |     pyhff2d567_1         756 KB  conda-forge
    sympy-1.13.3               |   pyh2585a3b_104         4.4 MB  conda-forge
    tbb-2021.13.0              |       hceb3a55_1         172 KB  conda-forge
    tk-8.6.13                  |noxft_h4845f30_101         3.2 MB  conda-forge
    torchtriton-2.3.1          |            py310       177.3 MB  pytorch
    typing_extensions-4.12.2   |     pyha770c72_1          39 KB  conda-forge
    tzdata-2024b               |       hc8b5060_0         119 KB  conda-forge
    wheel-0.45.1               |     pyhd8ed1ab_1          61 KB  conda-forge
    yaml-0.2.5                 |       h7f98852_2          87 KB  conda-forge
    ------------------------------------------------------------
                                           Total:        2.94 GB

The following NEW packages will be INSTALLED:

  _libgcc_mutex      conda-forge/linux-64::_libgcc_mutex-0.1-conda_forge
  _openmp_mutex      conda-forge/linux-64::_openmp_mutex-4.5-2_kmp_llvm
  blas               conda-forge/linux-64::blas-1.0-mkl
  bzip2              conda-forge/linux-64::bzip2-1.0.8-h4bc722e_7
  ca-certificates    conda-forge/linux-64::ca-certificates-2024.12.14-hbcca054_0
  cpython            conda-forge/noarch::cpython-3.10.16-py310hd8ed1ab_1
  cuda-cudart        nvidia/label/cuda-11.8.0/linux-64::cuda-cudart-11.8.89-0
  cuda-cupti         nvidia/label/cuda-11.8.0/linux-64::cuda-cupti-11.8.87-0
  cuda-libraries     nvidia/label/cuda-11.8.0/linux-64::cuda-libraries-11.8.0-0
  cuda-nvrtc         nvidia/label/cuda-11.8.0/linux-64::cuda-nvrtc-11.8.89-0
  cuda-nvtx          nvidia/label/cuda-11.8.0/linux-64::cuda-nvtx-11.8.86-0
  cuda-runtime       nvidia/label/cuda-11.8.0/linux-64::cuda-runtime-11.8.0-0
  filelock           conda-forge/noarch::filelock-3.16.1-pyhd8ed1ab_1
  gmp                conda-forge/linux-64::gmp-6.3.0-hac33072_2
  gmpy2              conda-forge/linux-64::gmpy2-2.1.5-py310he8512ff_3
  jinja2             conda-forge/noarch::jinja2-3.1.4-pyhd8ed1ab_1
  ld_impl_linux-64   conda-forge/linux-64::ld_impl_linux-64-2.43-h712a8e2_2
  libcublas          nvidia/label/cuda-11.8.0/linux-64::libcublas-11.11.3.6-0
  libcufft           nvidia/label/cuda-11.8.0/linux-64::libcufft-10.9.0.58-0
  libcufile          nvidia/label/cuda-11.8.0/linux-64::libcufile-1.4.0.31-0
  libcurand          nvidia/label/cuda-11.8.0/linux-64::libcurand-10.3.0.86-0
  libcusolver        nvidia/label/cuda-11.8.0/linux-64::libcusolver-11.4.1.48-0
  libcusparse        nvidia/label/cuda-11.8.0/linux-64::libcusparse-11.7.5.86-0
  libffi             conda-forge/linux-64::libffi-3.4.2-h7f98852_5
  libgcc             conda-forge/linux-64::libgcc-14.2.0-h77fa898_1
  libgcc-ng          conda-forge/linux-64::libgcc-ng-14.2.0-h69a702a_1
  libhwloc           conda-forge/linux-64::libhwloc-2.11.2-default_h0d58e46_1001
  libiconv           conda-forge/linux-64::libiconv-1.17-hd590300_2
  liblzma            conda-forge/linux-64::liblzma-5.6.3-hb9d3cd8_1
  libnpp             nvidia/label/cuda-11.8.0/linux-64::libnpp-11.8.0.86-0
  libnsl             conda-forge/linux-64::libnsl-2.0.1-hd590300_0
  libnvjpeg          nvidia/label/cuda-11.8.0/linux-64::libnvjpeg-11.9.0.86-0
  libsqlite          conda-forge/linux-64::libsqlite-3.47.2-hee588c1_0
  libstdcxx          conda-forge/linux-64::libstdcxx-14.2.0-hc0a3c3a_1
  libstdcxx-ng       conda-forge/linux-64::libstdcxx-ng-14.2.0-h4852527_1
  libuuid            conda-forge/linux-64::libuuid-2.38.1-h0b41bf4_0
  libxcrypt          conda-forge/linux-64::libxcrypt-4.4.36-hd590300_1
  libxml2            conda-forge/linux-64::libxml2-2.13.5-h0d44e9d_1
  libzlib            conda-forge/linux-64::libzlib-1.3.1-hb9d3cd8_2
  llvm-openmp        conda-forge/linux-64::llvm-openmp-15.0.7-h0cdce71_0
  markupsafe         conda-forge/linux-64::markupsafe-3.0.2-py310h89163eb_1
  mkl                conda-forge/linux-64::mkl-2023.0.0-h84fe81f_26648
  mpc                conda-forge/linux-64::mpc-1.3.1-h24ddda3_1
  mpfr               conda-forge/linux-64::mpfr-4.2.1-h90cbb55_3
  mpmath             conda-forge/noarch::mpmath-1.3.0-pyhd8ed1ab_1
  ncurses            conda-forge/linux-64::ncurses-6.5-he02047a_1
  networkx           conda-forge/noarch::networkx-3.4.2-pyh267e887_2
  openssl            conda-forge/linux-64::openssl-3.4.0-hb9d3cd8_0
  pip                conda-forge/noarch::pip-24.3.1-pyh8b19718_2
  python             conda-forge/linux-64::python-3.10.16-he725a3c_1_cpython
  python_abi         conda-forge/linux-64::python_abi-3.10-5_cp310
  pytorch            pytorch/linux-64::pytorch-2.3.1-py3.10_cuda11.8_cudnn8.7.0_0
  pytorch-cuda       pytorch/linux-64::pytorch-cuda-11.8-h7e8668a_6
  pytorch-mutex      pytorch/noarch::pytorch-mutex-1.0-cuda
  pyyaml             conda-forge/linux-64::pyyaml-6.0.2-py310ha75aee5_1
  readline           conda-forge/linux-64::readline-8.2-h8228510_1
  setuptools         conda-forge/noarch::setuptools-75.6.0-pyhff2d567_1
  sympy              conda-forge/noarch::sympy-1.13.3-pyh2585a3b_104
  tbb                conda-forge/linux-64::tbb-2021.13.0-hceb3a55_1
  tk                 conda-forge/linux-64::tk-8.6.13-noxft_h4845f30_101
  torchtriton        pytorch/linux-64::torchtriton-2.3.1-py310
  typing_extensions  conda-forge/noarch::typing_extensions-4.12.2-pyha770c72_1
  tzdata             conda-forge/noarch::tzdata-2024b-hc8b5060_0
  wheel              conda-forge/noarch::wheel-0.45.1-pyhd8ed1ab_1
  yaml               conda-forge/linux-64::yaml-0.2.5-h7f98852_2



DryRunExit: Dry run. Exiting.

jaimergp · 2024-12-18T10:30:03Z

That might be a libmamba v2 reporting artifact. It would be interesting to see the verbose -vvv logs to peak into the internal handling.

jaimergp · 2024-12-18T10:40:09Z

I can reproduce locally. The following alternative works in the meantime:

conda install "pytorch=2.3.1=*cuda11.8*" python=3.10 -c pytorch -c nvidia/label/cuda-11.8.0 -c nvidia --platform=linux-64

I checked with micromamba v2 and it also reproduces there (but works with v1). It's a regression there, so we'll need an issue in mamba-org/mamba.

In the meantime, we can transfer this to conda/conda-libmamba-solver for tracking purposes.

jaimergp · 2024-12-18T10:48:34Z

Opened mamba-org/mamba#3699

rsxdalv · 2024-12-18T11:11:20Z

Thanks for the info!
I did

pytorch[version=2.3.1,build=py3.10_cuda11.8.*] -c pytorch -c nvidia/label/cuda-11.8.0 -c nvidia

Which expands into a .* Regex that works.

I ran it both via Jupyter on Google colab, but also locally on a windows machine via CMD.

rsxdalv added the type::bug describes erroneous operation, use severity::* to classify the type label Dec 17, 2024

rsxdalv mentioned this issue Dec 17, 2024

Error on install, "PackagesNotFoundError" "pytorch==2.3.1[build='^py3.10_cuda11.8$']" rsxdalv/tts-generation-webui#428

Open

travishathaway added the source::community catch-all for issues filed by community members label Dec 18, 2024

travishathaway added the pending::feedback indicates we are waiting on feedback from the user label Dec 18, 2024

conda-bot added pending::support indicates user is waiting on support from triage engineers and removed pending::feedback indicates we are waiting on feedback from the user labels Dec 18, 2024

jaimergp transferred this issue from conda/conda Dec 18, 2024

jaimergp mentioned this issue Dec 18, 2024

v2 doesn't solve pytorch=2.3.1=py3.10_cuda11.8*, but v1 does mamba-org/mamba#3699

Open

3 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Conda install regression #591

Conda install regression #591

rsxdalv commented Dec 17, 2024

travishathaway commented Dec 18, 2024

jaimergp commented Dec 18, 2024

jaimergp commented Dec 18, 2024

jaimergp commented Dec 18, 2024

rsxdalv commented Dec 18, 2024

Conda install regression #591

Conda install regression #591

Comments

rsxdalv commented Dec 17, 2024

Checklist

What happened?

Conda Info

Conda Config

Conda list

Additional Context

travishathaway commented Dec 18, 2024

jaimergp commented Dec 18, 2024

jaimergp commented Dec 18, 2024

jaimergp commented Dec 18, 2024

rsxdalv commented Dec 18, 2024