Application specific recommendations for GPU computations
The NVIDIA device drivers will be loaded in all GPU supported images once a GPU node is started on Nuvolos. However depending on the image type additional components (e.g. CUDA toolkit) might need to be installed via conda.
If you launch a GPU accelerated node on Nuvolos, the nvidia-smitool will be available from the command line / terminal. You can use this to check the load on the given GPU to verify how effectively the code is leveraging the accelerator.
Please find below some examples on how to get started with GPU computations on Nuvolos or consult directly the relevant machine learning library documentation. If you require additional support, please reach out to our team directly.
We recommend to install the appropriate cudatoolkit from conda that is compatible with the target library and then use a conda packaged version of the library that can leverage the cudatoolkit.
For example, to run pytorch with on Nuvolos, simply run: