nvidia
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| nvidia [2024/10/02 00:26] – randon | nvidia [2025/04/26 04:23] (current) – external edit 127.0.0.1 | ||
|---|---|---|---|
| Line 7: | Line 7: | ||
| Do this by: | Do this by: | ||
| *(enable modules if not yet enabled): `source / | *(enable modules if not yet enabled): `source / | ||
| - | *`export CC_CLUSTER=cedar` (compute nodes most closely resemble those of [https:// | + | *`export CC_CLUSTER=cedar` (compute nodes most closely resemble those of [[https:// |
| *Load the python module `module load python` | *Load the python module `module load python` | ||
| *`pip install --no-index torch torchvision torchtext torchaudio` (after loading the module, we will be using computecanada' | *`pip install --no-index torch torchvision torchtext torchaudio` (after loading the module, we will be using computecanada' | ||
| Line 18: | Line 18: | ||
| *For ubuntu 22.04, make sure you symlink gcc to gcc12 (at least during the installation). The default kernel for ubuntu 22.04 is compiled with gcc12. | *For ubuntu 22.04, make sure you symlink gcc to gcc12 (at least during the installation). The default kernel for ubuntu 22.04 is compiled with gcc12. | ||
| - | For some reason torch 2.4.1 does not package the correct version of libnccl2. To get around this, follow the instructions [https:// | + | For some reason torch 2.4.1 does not package the correct version of libnccl2. To get around this, follow the instructions |
| For reasons, torch is still using cuda12.4 but if you let nvidia auto install, you will end up with cuda 12.6, which is not supported by torch (as of september 2024). Specify: | For reasons, torch is still using cuda12.4 but if you let nvidia auto install, you will end up with cuda 12.6, which is not supported by torch (as of september 2024). Specify: | ||
| * Remove any installed torch: `pip uninstall -y torch torchvision torchaudio` | * Remove any installed torch: `pip uninstall -y torch torchvision torchaudio` | ||
| Line 27: | Line 27: | ||
| By this point the libraries for the version of libnccl necessary should be picked up by torch so you wont have the error " | By this point the libraries for the version of libnccl necessary should be picked up by torch so you wont have the error " | ||
| + | |||
| + | ====nvcc==== | ||
| + | Many versions of nvcc are installed for each version of cuda. Check `/ | ||
nvidia.1727828802.txt.gz · Last modified: 2025/04/26 04:23 (external edit)