Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

v2 doesn't solve pytorch=2.3.1=py3.10_cuda11.8*, but v1 does #3699

Open
3 tasks done
jaimergp opened this issue Dec 18, 2024 · 4 comments · May be fixed by #3700
Open
3 tasks done

v2 doesn't solve pytorch=2.3.1=py3.10_cuda11.8*, but v1 does #3699

jaimergp opened this issue Dec 18, 2024 · 4 comments · May be fixed by #3700
Labels
type::bug Something isn't working

Comments

@jaimergp
Copy link
Contributor

Troubleshooting docs

  • My problem is not solved in the Troubleshooting docs

Anaconda default channels

  • I do NOT use the Anaconda default channels (pkgs/* etc.)

How did you install Mamba?

Micromamba

Search tried in issue tracker

pytorch

Latest version of Mamba

  • My problem is not solved with the latest version

Tried in Conda?

Not applicable

Describe your issue

Comes from this report: conda/conda-libmamba-solver#591

@rsxdalv reports that a certain install command that used to work with libmamba v1 doesn't work anymore with v2. I could reproduce with micromamba:

This command:

CONDA_OVERRIDE_GLIBC=2.17 micromamba create --dry-run "pytorch=2.3.1=py3.10_cuda11.8*" -c pytorch -c nvidia/label/cuda-11.8.0 -c nvidia -c conda-forge --platform=linux-64 -p ~/tmp/dry

Works with v1.5.11:

Transaction

  Prefix: /root/tmp

  Updating specs:

   - pytorch==2.3.1[build=py3.10_cuda11.8*]


  Package                 Version  Build                         Channel                       Size
─────────────────────────────────────────────────────────────────────────────────────────────────────
  Install:
─────────────────────────────────────────────────────────────────────────────────────────────────────

  + pytorch-mutex             1.0  cuda                          pytorch                        3kB
  + _libgcc_mutex             0.1  conda_forge                   conda-forge                    3kB
  + python_abi               3.10  5_cp310                       conda-forge                    6kB
  + ld_impl_linux-64         2.43  h712a8e2_2                    conda-forge                  669kB
  + ca-certificates    2024.12.14  hbcca054_0                    conda-forge                  157kB
  + libzlib                 1.3.1  hb9d3cd8_2                    conda-forge                   61kB
  + llvm-openmp            15.0.7  h0cdce71_0                    conda-forge                    3MB
  + _openmp_mutex             4.5  2_kmp_llvm                    conda-forge                    6kB
  + libgcc                 14.2.0  h77fa898_1                    conda-forge                  849kB
  + libsqlite              3.47.2  hee588c1_0                    conda-forge                  874kB
  + liblzma                 5.6.3  hb9d3cd8_1                    conda-forge                  111kB
  + libgcc-ng              14.2.0  h69a702a_1                    conda-forge                   54kB
  + openssl                 3.4.0  hb9d3cd8_0                    conda-forge                    3MB
  + libstdcxx              14.2.0  hc0a3c3a_1                    conda-forge                    4MB
  + libiconv                 1.17  hd590300_2                    conda-forge                  706kB
  + tk                     8.6.13  noxft_h4845f30_101            conda-forge                    3MB
  + libxcrypt              4.4.36  hd590300_1                    conda-forge                  100kB
  + libffi                  3.4.2  h7f98852_5                    conda-forge                   58kB
  + bzip2                   1.0.8  h4bc722e_7                    conda-forge                  253kB
  + yaml                    0.2.5  h7f98852_2                    conda-forge                   89kB
  + ncurses                   6.5  he02047a_1                    conda-forge                  889kB
  + libuuid                2.38.1  h0b41bf4_0                    conda-forge                   34kB
  + libnsl                  2.0.1  hd590300_0                    conda-forge                   33kB
  + libstdcxx-ng           14.2.0  h4852527_1                    conda-forge                   54kB
  + libxml2                2.13.5  h0d44e9d_1                    conda-forge                  690kB
  + readline                  8.2  h8228510_1                    conda-forge                  281kB
  + gmp                     6.3.0  hac33072_2                    conda-forge                  460kB
  + libhwloc               2.11.2  default_h0d58e46_1001         conda-forge                    2MB
  + mpfr                    4.2.1  h90cbb55_3                    conda-forge                  635kB
  + tbb                 2021.13.0  hceb3a55_1                    conda-forge                  176kB
  + mpc                     1.3.1  h24ddda3_1                    conda-forge                  117kB
  + mkl                  2023.0.0  h84fe81f_26648                conda-forge                  161MB
  + blas                      1.0  mkl                           conda-forge                    1kB
  + tzdata                  2024b  hc8b5060_0                    conda-forge                  122kB
  + cuda-cudart           11.8.89  0                             nvidia/label/cuda-11.8.0     202kB
  + cuda-cupti            11.8.87  0                             nvidia/label/cuda-11.8.0      27MB
  + cuda-nvrtc            11.8.89  0                             nvidia/label/cuda-11.8.0      20MB
  + cuda-nvtx             11.8.86  0                             nvidia/label/cuda-11.8.0      58kB
  + libcublas           11.11.3.6  0                             nvidia/label/cuda-11.8.0     382MB
  + libcufft            10.9.0.58  0                             nvidia/label/cuda-11.8.0     150MB
  + libcusolver         11.4.1.48  0                             nvidia/label/cuda-11.8.0     101MB
  + libcusparse         11.7.5.86  0                             nvidia/label/cuda-11.8.0     185MB
  + libnpp              11.8.0.86  0                             nvidia/label/cuda-11.8.0     155MB
  + libnvjpeg           11.9.0.86  0                             nvidia/label/cuda-11.8.0       3MB
  + libcufile            1.4.0.31  0                             nvidia/label/cuda-11.8.0     561kB
  + libcurand           10.3.0.86  0                             nvidia/label/cuda-11.8.0      56MB
  + cuda-libraries         11.8.0  0                             nvidia/label/cuda-11.8.0       2kB
  + cuda-runtime           11.8.0  0                             nvidia/label/cuda-11.8.0       1kB
  + python                3.10.16  he725a3c_1_cpython            conda-forge                   25MB
  + pytorch-cuda             11.8  h7e8668a_6                    pytorch                        7kB
  + wheel                  0.45.1  pyhd8ed1ab_1                  conda-forge                   63kB
  + setuptools             75.6.0  pyhff2d567_1                  conda-forge                  774kB
  + pip                    24.3.1  pyh8b19718_2                  conda-forge                    1MB
  + mpmath                  1.3.0  pyhd8ed1ab_1                  conda-forge                  440kB
  + typing_extensions      4.12.2  pyha770c72_1                  conda-forge                   40kB
  + cpython               3.10.16  py310hd8ed1ab_1               conda-forge                   49kB
  + networkx                3.4.2  pyh267e887_2                  conda-forge                    1MB
  + filelock               3.16.1  pyhd8ed1ab_1                  conda-forge                   17kB
  + markupsafe              3.0.2  py310h89163eb_1               conda-forge                   23kB
  + gmpy2                   2.1.5  py310he8512ff_3               conda-forge                  203kB
  + pyyaml                  6.0.2  py310ha75aee5_1               conda-forge                  183kB
  + jinja2                  3.1.4  pyhd8ed1ab_1                  conda-forge                  111kB
  + sympy                  1.13.3  pyh2585a3b_104                conda-forge                    5MB
  + pytorch                 2.3.1  py3.10_cuda11.8_cudnn8.7.0_0  pytorch                        2GB
  + torchtriton             2.3.1  py310                         pytorch                      186MB

  Summary:

  Install: 65 packages

  Total download: 3GB

─────────────────────────────────────────────────────────────────────────────────────────────────────


Dry run. Not executing the transaction.

Fails with v2.0.5:

error    libmamba Could not solve for environment specs
    The following package could not be installed
    └─ pytorch =2.3.1 ^py3.10_cuda11.8*$ does not exist (perhaps a typo or a missing channel).

mamba info / micromamba info

libmamba version : 2.0.5
     micromamba version : 2.0.5
           curl version : libcurl/8.11.1 (OpenSSL/3.4.0) SecureTransport zlib/1.3.1 zstd/1.5.6 libssh2/1.11.1 nghttp2/1.64.0
     libarchive version : libarchive 3.7.7 zlib/1.3.1 bz2lib/1.0.8 libzstd/1.5.6
       envs directories : /Users/jrodriguez/micromamba/envs
          package cache : /Users/jrodriguez/micromamba/pkgs
                          /Users/jrodriguez/.mamba/pkgs
            environment : base
           env location : /Users/jrodriguez/micromamba
      user config files : /Users/jrodriguez/.mambarc
 populated config files : /Users/jrodriguez/.condarc
       virtual packages : __unix=0=0
                          __osx=14.3.1=0
                          __archspec=1=arm64
               channels : https://conda.anaconda.org/conda-forge/noarch
                          https://conda.anaconda.org/conda-forge/osx-arm64
       base environment : /Users/jrodriguez/micromamba
               platform : osx-arm64

Logs

pytorch/linux-64                                            Using cache
pytorch/noarch                                              Using cache
nvidia/label/cuda-11.8.0/linux-64                           Using cache
nvidia/label/cuda-11.8.0/noarch                             Using cache
nvidia/linux-64                                             Using cache
nvidia/noarch                                               Using cache
conda-forge/linux-64                                        Using cache
conda-forge/noarch                                          Using cache

driguez/.mamba/mambarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.mamba/.mambarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.config/mamba/mambarc.d'
trace    libmamba Configuration not found at '/Users/jrodriguez/.config/mamba/mambarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.config/mamba/.mambarc'
trace    libmamba Configuration found at '/Users/jrodriguez/.condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.conda/condarc.d'
trace    libmamba Configuration not found at '/Users/jrodriguez/.conda/condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.conda/.condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.config/conda/condarc.d'
trace    libmamba Configuration not found at '/Users/jrodriguez/.config/conda/condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.config/conda/.condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/micromamba/.mambarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/micromamba/condarc.d'
trace    libmamba Configuration not found at '/Users/jrodriguez/micromamba/condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/micromamba/.condarc'
trace    libmamba Configuration not found at '/var/lib/conda/.mambarc'
trace    libmamba Configuration not found at '/var/lib/conda/condarc.d/'
trace    libmamba Configuration not found at '/var/lib/conda/condarc'
trace    libmamba Configuration not found at '/var/lib/conda/.condarc'
trace    libmamba Configuration not found at '/etc/conda/.mambarc'
trace    libmamba Configuration not found at '/etc/conda/condarc.d/'
trace    libmamba Configuration not found at '/etc/conda/condarc'
trace    libmamba Configuration not found at '/etc/conda/.condarc'
trace    libmamba Update configurable 'no_env'
trace    libmamba Compute configurable 'envs_dirs'
trace    libmamba Compute configurable 'file_specs'
trace    libmamba Compute configurable 'spec_file_env_name'
trace    libmamba Compute configurable 'env_name'
trace    libmamba Compute configurable 'use_default_prefix_fallback'
trace    libmamba Compute configurable 'use_root_prefix_fallback'
trace    libmamba Compute configurable 'use_target_prefix_fallback'
trace    libmamba Compute configurable 'target_prefix'
trace    libmamba Get RC files configuration from locations up to TargetPrefix
trace    libmamba Configuration not found at '/Users/jrodriguez/tmp/dry/.mambarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/tmp/dry/condarc.d'
trace    libmamba Configuration not found at '/Users/jrodriguez/tmp/dry/condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/tmp/dry/.condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.mambarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.mamba/mambarc.d'
trace    libmamba Configuration not found at '/Users/jrodriguez/.mamba/mambarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.mamba/.mambarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.config/mamba/mambarc.d'
trace    libmamba Configuration not found at '/Users/jrodriguez/.config/mamba/mambarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.config/mamba/.mambarc'
trace    libmamba Configuration found at '/Users/jrodriguez/.condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.conda/condarc.d'
trace    libmamba Configuration not found at '/Users/jrodriguez/.conda/condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.conda/.condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.config/conda/condarc.d'
trace    libmamba Configuration not found at '/Users/jrodriguez/.config/conda/condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/.config/conda/.condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/micromamba/.mambarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/micromamba/condarc.d'
trace    libmamba Configuration not found at '/Users/jrodriguez/micromamba/condarc'
trace    libmamba Configuration not found at '/Users/jrodriguez/micromamba/.condarc'
trace    libmamba Configuration not found at '/var/lib/conda/.mambarc'
trace    libmamba Configuration not found at '/var/lib/conda/condarc.d/'
trace    libmamba Configuration not found at '/var/lib/conda/condarc'
trace    libmamba Configuration not found at '/var/lib/conda/.condarc'
trace    libmamba Configuration not found at '/etc/conda/.mambarc'
trace    libmamba Configuration not found at '/etc/conda/condarc.d/'
trace    libmamba Configuration not found at '/etc/conda/condarc'
trace    libmamba Configuration not found at '/etc/conda/.condarc'
trace    libmamba Update configurable 'no_env'
trace    libmamba Compute configurable 'relocate_prefix'
trace    libmamba Compute configurable 'target_prefix_checks'
trace    libmamba Compute configurable 'pkgs_dirs'
trace    libmamba Compute configurable 'platform'
trace    libmamba Compute configurable 'specs'
trace    libmamba Compute configurable 'others_pkg_mgrs_specs'
trace    libmamba Compute configurable 'experimental'
trace    libmamba Compute configurable 'experimental_repodata_parsing'
trace    libmamba Compute configurable 'debug'
trace    libmamba Compute configurable 'override_channels_enabled'
trace    libmamba Compute configurable 'override_channels'
trace    libmamba Compute configurable 'channels'
trace    libmamba Compute configurable 'channel_alias'
trace    libmamba Compute configurable 'default_channels'
trace    libmamba Compute configurable 'custom_channels'
trace    libmamba Compute configurable 'custom_multichannels'
trace    libmamba Compute configurable 'mirrored_channels'
trace    libmamba Compute configurable 'repodata_use_zst'
trace    libmamba Compute configurable 'repodata_has_zst'
trace    libmamba Compute configurable 'cacert_path'
trace    libmamba Compute configurable 'local_repodata_ttl'
trace    libmamba Compute configurable 'offline'
trace    libmamba Compute configurable 'ssl_no_revoke'
trace    libmamba Compute configurable 'ssl_verify'
trace    libmamba Compute configurable 'proxy_servers'
trace    libmamba Compute configurable 'remote_connect_timeout_secs'
trace    libmamba Compute configurable 'remote_backoff_factor'
trace    libmamba Compute configurable 'remote_max_retries'
trace    libmamba Compute configurable 'no_channel_priority'
trace    libmamba Compute configurable 'strict_channel_priority'
trace    libmamba Compute configurable 'channel_priority'
trace    libmamba Compute configurable 'explicit_install'
trace    libmamba Compute configurable 'no_pin'
trace    libmamba Compute configurable 'no_py_pin'
trace    libmamba Compute configurable 'add_pip_as_python_dependency'
trace    libmamba Compute configurable 'pinned_packages'
trace    libmamba Compute configurable 'freeze_installed'
trace    libmamba Compute configurable 'no_deps'
trace    libmamba Compute configurable 'only_deps'
trace    libmamba Compute configurable 'force_reinstall'
trace    libmamba Compute configurable 'allow_uninstall'
trace    libmamba Compute configurable 'allow_downgrade'
trace    libmamba Compute configurable 'order_solver_request'
trace    libmamba Compute configurable 'categories'
trace    libmamba Compute configurable 'retry_clean_cache'
trace    libmamba Compute configurable 'download_threads'
trace    libmamba Compute configurable 'extract_threads'
trace    libmamba Compute configurable 'allow_softlinks'
trace    libmamba Compute configurable 'always_copy'
trace    libmamba Compute configurable 'always_softlink'
trace    libmamba Compute configurable 'show_anaconda_channel_warnings'
trace    libmamba Compute configurable 'shortcuts'
trace    libmamba Compute configurable 'safety_checks'
trace    libmamba Compute configurable 'extra_safety_checks'
trace    libmamba Compute configurable 'verify_artifacts'
trace    libmamba Compute configurable 'trusted_channels'
trace    libmamba Compute configurable 'lock_timeout'
trace    libmamba Compute configurable 'use_lockfiles'
trace    libmamba Compute configurable 'compile_pyc'
trace    libmamba Compute configurable 'always_yes'
trace    libmamba Compute configurable 'auto_activate_base'
trace    libmamba Compute configurable 'dry_run'
trace    libmamba Compute configurable 'download_only'
trace    libmamba Compute configurable 'print_config_only'
trace    libmamba Compute configurable 'print_context_only'
trace    libmamba Compute configurable 'json'
trace    libmamba Compute configurable 'verbose'
trace    libmamba Compute configurable 'log_level'
trace    libmamba Compute configurable 'log_backtrace'
trace    libmamba Compute configurable 'log_pattern'
trace    libmamba Compute configurable 'changeps1'
trace    libmamba Compute configurable 'shell_completion'
trace    libmamba Compute configurable 'env_prompt'
trace    libmamba Compute configurable 'show_all_configs'
trace    libmamba Compute configurable 'show_all_rc_configs'
trace    libmamba Compute configurable 'show_config_descriptions'
trace    libmamba Compute configurable 'show_config_groups'
trace    libmamba Compute configurable 'show_config_long_descriptions'
trace    libmamba Compute configurable 'show_config_sources'
trace    libmamba Compute configurable 'show_config_values'
trace    libmamba Compute configurable 'quiet'
trace    libmamba Compute configurable 'override_rc_files'
trace    libmamba Compute configurable 'shell_type'
trace    libmamba Compute configurable 'prefix_or_name'
trace    libmamba Compute configurable 'shell_stack'
trace    libmamba Compute configurable 'list_regex'
trace    libmamba Compute configurable 'full_name'
trace    libmamba Compute configurable 'clean_all'
trace    libmamba Compute configurable 'clean_index_cache'
trace    libmamba Compute configurable 'clean_packages'
trace    libmamba Compute configurable 'clean_tarballs'
trace    libmamba Compute configurable 'clean_locks'
trace    libmamba Compute configurable 'clean_trash'
trace    libmamba Compute configurable 'clean_force_pkgs_dirs'
trace    libmamba Compute configurable 'config_set_system_path'
trace    libmamba Compute configurable 'config_set_env_path'
trace    libmamba Compute configurable 'config_set_file_path'
trace    libmamba Compute configurable 'config_set_sequence_spec'
trace    libmamba Compute configurable 'remove_key'
trace    libmamba Compute configurable 'remove'
trace    libmamba Compute configurable 'set_value'
trace    libmamba Compute configurable 'get_value'
trace    libmamba Compute configurable 'constructor_prefix'
trace    libmamba Compute configurable 'constructor_extract_conda_pkgs'
trace    libmamba Compute configurable 'constructor_extract_tarball'
debug    libmamba 118 configurables computed
info     libmamba Found token for conda.anaconda.org at "/Users/jrodriguez/.continuum/anaconda-client/tokens/https%3A%2F%2Fapi.anaconda.org.token"
debug    libmamba Checking if '/Users/jrodriguez/micromamba/pkgs' is writable
trace    libmamba '/Users/jrodriguez/micromamba/pkgs/urls.txt' exists, checking if writable
debug    libmamba '/Users/jrodriguez/micromamba/pkgs' writable
info     libmamba Searching index cache file for repo 'pytorch/linux-64'
debug    libmamba Locking directory '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
debug    libmamba Successfully locked
debug    libmamba Using JSON cache
trace    libmamba Cache age: 16/60s
debug    libmamba Using SOLV cache
trace    libmamba Cache age: 16s
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
info     libmamba Searching index cache file for repo 'pytorch/noarch'
debug    libmamba Locking directory '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
debug    libmamba Successfully locked
debug    libmamba Using JSON cache
trace    libmamba Cache age: 16/60s
debug    libmamba Using SOLV cache
trace    libmamba Cache age: 16s
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
info     libmamba Searching index cache file for repo 'nvidia/label/cuda-11.8.0/linux-64'
debug    libmamba Locking directory '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
debug    libmamba Successfully locked
debug    libmamba Using JSON cache
trace    libmamba Cache age: 16/60s
debug    libmamba Using SOLV cache
trace    libmamba Cache age: 16s
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
info     libmamba Searching index cache file for repo 'nvidia/label/cuda-11.8.0/noarch'
debug    libmamba Locking directory '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
debug    libmamba Successfully locked
debug    libmamba Using JSON cache
trace    libmamba Cache age: 16/60s
debug    libmamba Using SOLV cache
trace    libmamba Cache age: 16s
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
info     libmamba Searching index cache file for repo 'nvidia/linux-64'
debug    libmamba Locking directory '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
debug    libmamba Successfully locked
debug    libmamba Using JSON cache
trace    libmamba Cache age: 16/60s
debug    libmamba Using SOLV cache
trace    libmamba Cache age: 16s
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
info     libmamba Searching index cache file for repo 'nvidia/noarch'
debug    libmamba Locking directory '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
debug    libmamba Successfully locked
debug    libmamba Using JSON cache
trace    libmamba Cache age: 15/60s
debug    libmamba Using SOLV cache
trace    libmamba Cache age: 15s
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
info     libmamba Searching index cache file for repo 'conda-forge/linux-64'
debug    libmamba Locking directory '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
debug    libmamba Successfully locked
debug    libmamba Using JSON cache
trace    libmamba Cache age: 673/1200s
debug    libmamba Using SOLV cache
trace    libmamba Cache age: 670s
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
info     libmamba Searching index cache file for repo 'conda-forge/noarch'
debug    libmamba Locking directory '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
debug    libmamba Successfully locked
debug    libmamba Using JSON cache
trace    libmamba Cache age: 675/1200s
debug    libmamba Using SOLV cache
trace    libmamba Cache age: 668s
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/cache.lock'
info     libmamba Using macOS SecureTransport backend
info     libmamba Attempting to read libsolv solv file "/Users/jrodriguez/micromamba/pkgs/cache/cb9fd28a.solv" for repo https://conda.anaconda.org/t/*****/pytorch/linux-64
info     libmamba Expecting solv metadata : {"etag":"","mod":"Mon, 28 Oct 2024 23:02:45 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/pytorch/linux-64"}
debug    libmamba Locking file '/Users/jrodriguez/micromamba/pkgs/cache/cb9fd28a.solv'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/cb9fd28a.solv.lock'
debug    libmamba Successfully locked
info     libmamba Loaded solv metadata : {"etag":"","mod":"Mon, 28 Oct 2024 23:02:45 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/pytorch/linux-64"}
info     libmamba Metadata from solv are valid, loading successful
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache/cb9fd28a.solv'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/cb9fd28a.solv.lock'
info     libmamba Attempting to read libsolv solv file "/Users/jrodriguez/micromamba/pkgs/cache/81a587a4.solv" for repo https://conda.anaconda.org/t/*****/pytorch/noarch
info     libmamba Expecting solv metadata : {"etag":"","mod":"Mon, 28 Oct 2024 23:02:45 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/pytorch/noarch"}
debug    libmamba Locking file '/Users/jrodriguez/micromamba/pkgs/cache/81a587a4.solv'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/81a587a4.solv.lock'
debug    libmamba Successfully locked
info     libmamba Loaded solv metadata : {"etag":"","mod":"Mon, 28 Oct 2024 23:02:45 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/pytorch/noarch"}
info     libmamba Metadata from solv are valid, loading successful
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache/81a587a4.solv'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/81a587a4.solv.lock'
info     libmamba Attempting to read libsolv solv file "/Users/jrodriguez/micromamba/pkgs/cache/3a5d42c5.solv" for repo https://conda.anaconda.org/t/*****/nvidia/label/cuda-11.8.0/linux-64
info     libmamba Expecting solv metadata : {"etag":"","mod":"Mon, 03 Oct 2022 22:52:53 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/nvidia/label/cuda-11.8.0/linux-64"}
debug    libmamba Locking file '/Users/jrodriguez/micromamba/pkgs/cache/3a5d42c5.solv'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/3a5d42c5.solv.lock'
debug    libmamba Successfully locked
info     libmamba Loaded solv metadata : {"etag":"","mod":"Mon, 03 Oct 2022 22:52:53 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/nvidia/label/cuda-11.8.0/linux-64"}
info     libmamba Metadata from solv are valid, loading successful
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache/3a5d42c5.solv'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/3a5d42c5.solv.lock'
info     libmamba Attempting to read libsolv solv file "/Users/jrodriguez/micromamba/pkgs/cache/dd51dd01.solv" for repo https://conda.anaconda.org/t/*****/nvidia/label/cuda-11.8.0/noarch
info     libmamba Expecting solv metadata : {"etag":"","mod":"Mon, 03 Oct 2022 22:52:53 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/nvidia/label/cuda-11.8.0/noarch"}
debug    libmamba Locking file '/Users/jrodriguez/micromamba/pkgs/cache/dd51dd01.solv'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/dd51dd01.solv.lock'
debug    libmamba Successfully locked
info     libmamba Loaded solv metadata : {"etag":"","mod":"Mon, 03 Oct 2022 22:52:53 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/nvidia/label/cuda-11.8.0/noarch"}
info     libmamba Metadata from solv are valid, loading successful
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache/dd51dd01.solv'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/dd51dd01.solv.lock'
info     libmamba Attempting to read libsolv solv file "/Users/jrodriguez/micromamba/pkgs/cache/eab6ca9b.solv" for repo https://conda.anaconda.org/t/*****/nvidia/linux-64
info     libmamba Expecting solv metadata : {"etag":"","mod":"Mon, 09 Dec 2024 22:01:48 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/nvidia/linux-64"}
debug    libmamba Locking file '/Users/jrodriguez/micromamba/pkgs/cache/eab6ca9b.solv'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/eab6ca9b.solv.lock'
debug    libmamba Successfully locked
info     libmamba Loaded solv metadata : {"etag":"","mod":"Mon, 09 Dec 2024 22:01:48 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/nvidia/linux-64"}
info     libmamba Metadata from solv are valid, loading successful
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache/eab6ca9b.solv'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/eab6ca9b.solv.lock'
info     libmamba Attempting to read libsolv solv file "/Users/jrodriguez/micromamba/pkgs/cache/6d94291a.solv" for repo https://conda.anaconda.org/t/*****/nvidia/noarch
info     libmamba Expecting solv metadata : {"etag":"","mod":"Mon, 09 Dec 2024 22:01:48 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/nvidia/noarch"}
debug    libmamba Locking file '/Users/jrodriguez/micromamba/pkgs/cache/6d94291a.solv'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/6d94291a.solv.lock'
debug    libmamba Successfully locked
info     libmamba Loaded solv metadata : {"etag":"","mod":"Mon, 09 Dec 2024 22:01:48 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/nvidia/noarch"}
info     libmamba Metadata from solv are valid, loading successful
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache/6d94291a.solv'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/6d94291a.solv.lock'
info     libmamba Attempting to read libsolv solv file "/Users/jrodriguez/micromamba/pkgs/cache/88ec62ec.solv" for repo https://conda.anaconda.org/t/*****/conda-forge/linux-64
info     libmamba Expecting solv metadata : {"etag":"\"30d228b9f51b24bbc5a19dff490819d8\"","mod":"Wed, 18 Dec 2024 10:20:11 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/conda-forge/linux-64"}
debug    libmamba Locking file '/Users/jrodriguez/micromamba/pkgs/cache/88ec62ec.solv'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/88ec62ec.solv.lock'
debug    libmamba Successfully locked
info     libmamba Loaded solv metadata : {"etag":"\"30d228b9f51b24bbc5a19dff490819d8\"","mod":"Wed, 18 Dec 2024 10:20:11 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/conda-forge/linux-64"}
info     libmamba Metadata from solv are valid, loading successful
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache/88ec62ec.solv'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/88ec62ec.solv.lock'
info     libmamba Attempting to read libsolv solv file "/Users/jrodriguez/micromamba/pkgs/cache/eb045dd1.solv" for repo https://conda.anaconda.org/t/*****/conda-forge/noarch
info     libmamba Expecting solv metadata : {"etag":"\"975ec323eb55f1523aaeea18ee5a68f6\"","mod":"Wed, 18 Dec 2024 10:05:55 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/conda-forge/noarch"}
debug    libmamba Locking file '/Users/jrodriguez/micromamba/pkgs/cache/eb045dd1.solv'
trace    libmamba Lockfile created at '/Users/jrodriguez/micromamba/pkgs/cache/eb045dd1.solv.lock'
debug    libmamba Successfully locked
info     libmamba Loaded solv metadata : {"etag":"\"975ec323eb55f1523aaeea18ee5a68f6\"","mod":"Wed, 18 Dec 2024 10:05:55 GMT","tool_version":"2.0_0.7.30","url":"https://conda.anaconda.org/t/*****/conda-forge/noarch"}
info     libmamba Metadata from solv are valid, loading successful
debug    libmamba Unlocking '/Users/jrodriguez/micromamba/pkgs/cache/eb045dd1.solv'
trace    libmamba Removing file '/Users/jrodriguez/micromamba/pkgs/cache/eb045dd1.solv.lock'
info     libmamba Loading site packages
debug    libmamba `pip` not found
debug    libmamba Loading virtual packages
debug    libmamba Loading distribution virtual packages
warning  libmamba Linux version not found, defaulting virtual package version to 0. Try setting CONDA_OVERRIDE_LINUX environment variable to the desired version.
debug    libmamba OS "Darwin" is not Linux
debug    libmamba Loading CUDA virtual package
debug    libmamba Could not find CUDA version by calling 'nvidia-smi' (skipped)
    
error    libmamba Could not solve for environment specs
    The following package could not be installed
    └─ pytorch =2.3.1 ^py3.10_cuda11.8*$ does not exist (perhaps a typo or a missing channel).
critical libmamba Could not solve for environment specs

environment.yml

No response

~/.condarc

always_yes: true
show_channel_urls: true
solver: libmamba
@jaimergp jaimergp mentioned this issue Dec 18, 2024
Open
2 tasks
@jjerphan
Copy link
Member

jjerphan commented Dec 18, 2024 •
edited
Loading

Thank you for the report.

Does the problem resolve if you install nvidia-smi or if you set CONDA_OVERRIDE_CUDA (here to 11.8, I guess)?

We need to have a more robust discovery of the version of CUDA used on the system.

@jjerphan jjerphan linked a pull request Dec 18, 2024 that will close this issue
Open
@jjerphan jjerphan added the type::bug Something isn't working label Dec 18, 2024
@jaimergp
Copy link
Contributor Author

Does the problem resolve if you install nvidia-smi or if you set CONDA_OVERRIDE_CUDA (here to 11.8, I guess)?

I'm on macOS so can't install nvidia-smi, but setting CONDA_OVERRIDE_CUDA did not change the outcome. It still fails.

It must be something about the build string format because this one CLI variant does work with micromamba v2:

$ CONDA_OVERRIDE_GLIBC=2.17 micromamba create --dry-run "pytorch=2.3.1=*_cuda11.8*" python=3.10 -c pytorch -c nvidia/label/cuda-11.8.0 -c nvidia -c conda-forge --platform=linux-64 -p ~/tmp/dry

The commands behave quite robustly across different operating systems and machines, so feel free to copy/paste and run these dry-runs to debug.

@jjerphan
Copy link
Member

jjerphan commented Dec 19, 2024 •
edited
Loading

I forgot to mention in my previous message that I cannot reproduce the problem locally with micromamba 2.0.5 using the command and configuration you provide.

In particular, the build string is properly picked in the MatchSpec for PyTorch as in conda's case:

   - pytorch[version="=2.3.1",build="*_cuda11.8*"]
Full Output 
CONDA_OVERRIDE_GLIBC=2.17 micromamba create --dry-run "pytorch=2.3.1=*_cuda11.8*" python=3.10 -c pytorch -c nvidia/label/cuda-11.8.0 -c nvidia -c conda-forge --platform=linux-64 -p ~/tmp/dry
pytorch/linux-64                                            Using cache
pytorch/noarch                                              Using cache
nvidia/linux-64                                             Using cache
nvidia/noarch                                               Using cache
conda-forge/linux-64                                        Using cache
conda-forge/noarch                                          Using cache


Transaction

  Prefix: /home/jjerphan/tmp/dry

  Updating specs:

   - pytorch[version="=2.3.1",build="*_cuda11.8*"]
   - python=3.10


  Package                 Version  Build                         Channel                        Size
──────────────────────────────────────────────────────────────────────────────────────────────────────
  Install:
──────────────────────────────────────────────────────────────────────────────────────────────────────

  + _libgcc_mutex             0.1  conda_forge                   conda-forge                  Cached
  + _openmp_mutex             4.5  2_kmp_llvm                    conda-forge                  Cached
  + blas                    2.116  mkl                           conda-forge                    13kB
  + blas-devel              3.9.0  16_linux64_mkl                conda-forge                    13kB
  + bzip2                   1.0.8  h4bc722e_7                    conda-forge                  Cached
  + ca-certificates    2024.12.14  hbcca054_0                    conda-forge                  Cached
  + cpython               3.10.16  py310hd8ed1ab_1               conda-forge                    49kB
  + cuda-cudart           11.8.89  0                             nvidia/label/cuda-11.8.0      202kB
  + cuda-cupti            11.8.87  0                             nvidia/label/cuda-11.8.0       27MB
  + cuda-libraries         11.8.0  0                             nvidia/label/cuda-11.8.0        2kB
  + cuda-nvrtc            11.8.89  0                             nvidia/label/cuda-11.8.0       20MB
  + cuda-nvtx             11.8.86  0                             nvidia/label/cuda-11.8.0       58kB
  + cuda-runtime           11.8.0  0                             nvidia/label/cuda-11.8.0        1kB
  + filelock               3.16.1  pyhd8ed1ab_1                  conda-forge                  Cached
  + gmp                     6.3.0  hac33072_2                    conda-forge                  Cached
  + gmpy2                   2.1.5  py310he8512ff_3               conda-forge                   203kB
  + jinja2                  3.1.4  pyhd8ed1ab_1                  conda-forge                  Cached
  + ld_impl_linux-64         2.43  h712a8e2_2                    conda-forge                  Cached
  + libblas                 3.9.0  16_linux64_mkl                conda-forge                  Cached
  + libcblas                3.9.0  16_linux64_mkl                conda-forge                  Cached
  + libcublas           11.11.3.6  0                             nvidia/label/cuda-11.8.0      382MB
  + libcufft            10.9.0.58  0                             nvidia/label/cuda-11.8.0      150MB
  + libcufile            1.4.0.31  0                             nvidia/label/cuda-11.8.0      561kB
  + libcurand           10.3.0.86  0                             nvidia/label/cuda-11.8.0       56MB
  + libcusolver         11.4.1.48  0                             nvidia/label/cuda-11.8.0      101MB
  + libcusparse         11.7.5.86  0                             nvidia/label/cuda-11.8.0      185MB
  + libffi                  3.4.2  h7f98852_5                    conda-forge                  Cached
  + libgcc                 14.2.0  h77fa898_1                    conda-forge                  Cached
  + libgcc-ng              14.2.0  h69a702a_1                    conda-forge                  Cached
  + libgfortran            14.2.0  h69a702a_1                    conda-forge                  Cached
  + libgfortran-ng         14.2.0  h69a702a_1                    conda-forge                  Cached
  + libgfortran5           14.2.0  hd5240d6_1                    conda-forge                  Cached
  + libhwloc               2.11.2  default_h0d58e46_1001         conda-forge                  Cached
  + libiconv                 1.17  hd590300_2                    conda-forge                  Cached
  + liblapack               3.9.0  16_linux64_mkl                conda-forge                  Cached
  + liblapacke              3.9.0  16_linux64_mkl                conda-forge                    13kB
  + liblzma                 5.6.3  hb9d3cd8_1                    conda-forge                  Cached
  + libnpp              11.8.0.86  0                             nvidia/label/cuda-11.8.0      155MB
  + libnsl                  2.0.1  hd590300_0                    conda-forge                  Cached
  + libnvjpeg           11.9.0.86  0                             nvidia/label/cuda-11.8.0        3MB
  + libsqlite              3.47.2  hee588c1_0                    conda-forge                  Cached
  + libstdcxx              14.2.0  hc0a3c3a_1                    conda-forge                  Cached
  + libstdcxx-ng           14.2.0  h4852527_1                    conda-forge                  Cached
  + libuuid                2.38.1  h0b41bf4_0                    conda-forge                  Cached
  + libxcrypt              4.4.36  hd590300_1                    conda-forge                  Cached
  + libxml2                2.13.5  h0d44e9d_1                    conda-forge                  Cached
  + libzlib                 1.3.1  hb9d3cd8_2                    conda-forge                  Cached
  + llvm-openmp            15.0.7  h0cdce71_0                    conda-forge                     3MB
  + markupsafe              3.0.2  py310h89163eb_1               conda-forge                  Cached
  + mkl                  2022.1.0  h84fe81f_915                  conda-forge                   209MB
  + mkl-devel            2022.1.0  ha770c72_916                  conda-forge                    26kB
  + mkl-include          2022.1.0  h84fe81f_915                  conda-forge                   763kB
  + mpc                     1.3.1  h24ddda3_1                    conda-forge                  Cached
  + mpfr                    4.2.1  h90cbb55_3                    conda-forge                  Cached
  + mpmath                  1.3.0  pyhd8ed1ab_1                  conda-forge                  Cached
  + ncurses                   6.5  he02047a_1                    conda-forge                  Cached
  + networkx                3.4.2  pyh267e887_2                  conda-forge                  Cached
  + openssl                 3.4.0  hb9d3cd8_0                    conda-forge                  Cached
  + pip                    24.3.1  pyh8b19718_2                  conda-forge                  Cached
  + python                3.10.16  he725a3c_1_cpython            conda-forge                  Cached
  + python_abi               3.10  5_cp310                       conda-forge                  Cached
  + pytorch                 2.3.1  py3.10_cuda11.8_cudnn8.7.0_0  pytorch                         2GB
  + pytorch-cuda             11.8  h7e8668a_6                    pytorch                         7kB
  + pytorch-mutex             1.0  cuda                          pytorch                         3kB
  + pyyaml                  6.0.2  py310ha75aee5_1               conda-forge                  Cached
  + readline                  8.2  h8228510_1                    conda-forge                  Cached
  + setuptools             75.6.0  pyhff2d567_1                  conda-forge                  Cached
  + sympy                  1.13.3  pyh2585a3b_104                conda-forge                     5MB
  + tbb                 2021.13.0  hceb3a55_1                    conda-forge                   176kB
  + tk                     8.6.13  noxft_h4845f30_101            conda-forge                  Cached
  + torchtriton             2.3.1  py310                         pytorch                       186MB
  + typing_extensions      4.12.2  pyha770c72_1                  conda-forge                  Cached
  + tzdata                  2024b  hc8b5060_0                    conda-forge                  Cached
  + wheel                  0.45.1  pyhd8ed1ab_1                  conda-forge                  Cached
  + yaml                    0.2.5  h7f98852_2                    conda-forge                  Cached

  Summary:

  Install: 75 packages

  Total download: 3GB

──────────────────────────────────────────────────────────────────────────────────────────────────────


Dry run. Not executing the transaction.

Can you try setting CONDA_OVERRIDE_LINUX=6.11.11?

@jaimergp
Copy link
Contributor Author

Yes this last command you shared does work. The problematic one is the one I shared in the opening message, with the build string py3.10_cuda11.8*

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type::bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix: Improve CUDA version detection jjerphan/mamba
2 participants
@jaimergp @jjerphan