Are cuda aarch64 build available anywhere?

[gdippolito]

Hello,

I'm interested in trying out a Pytorch build for CUDA 12.4 and aarch64 architecture.

Are those available anywhere?

Thanks,

[nWEIdia]

Yes, you can use
pip3 install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu124 (we are actively developing and maintaining it, e.g. tomorrow the wheel will feature cudnn v9).

As an alternative, below is a binary that has been verified as of now that you can just wget it.

https://download.pytorch.org/whl/nightly/cu124/torch-2.4.0.dev20240606%2Bcu124-cp310-cp310-linux_aarch64.whl
If you use other python version, we support 3.8 -> 3.12.

As an example: you can use ubuntu:22.04 container (on arm) to use the above command,
apt update && apt install python3 python3-pip python3-venv
apt-get install libopenblas-dev (required for libgFortran.so)

cc @tinglvv @ptrblck @atalman

[gdippolito]

Thanks!
If I want to use a release tag what would the URL be? For example I would like to use 2.3.0 with CUDA 12.4 for aarch64. Would that be available somewhere?

[nWEIdia]

Currently CUDA 12.4 for aarch64 is only available in nightly. p.s. cuda 12.4 support was only added after v2.3.0, so it is not possible to use cuda12.4 with 2.3.0.
There is a very good likelihood that v2.4.0 in short future could have cuda 12.4 aarch64 binary.