IBM Spectrum Computing Group

You are right, those parameters are now enabled by default. So I guess lshosts -gpu doesn't show anything about AMD GPU in your cluster. Probably you should reach LSF support to run debug on LSF lim service. Is there any indication in lim log ? ------------------------------ ...

To be on the safe side, we added the parameter to lsf.conf and restarted the cluster. Still no success! Is there any guide/documentation, what one should be aware of, when using AMD GPUs? How does LSF find them, and where does it look for it? ...

BTW, this 'default' behavior is also mentioned in the release notes of FixPack 13: --- Starting in IBM Spectrum LSF Version 10.1 Fix Pack 13, the default values of the following three parameters are changed to: LSF_GPU_AUTOCONFIG=Y LSB_GPU_NEW_SYNTAX=extend LSF_GPU_RESOURCE_IGNORE=Y ...

Thanks! We will try to add this to lsf.conf. The ROCM library is installed. BTW, the documentation about LSF_GPU_RESOURCE_IGNORE is not very clear: it says "Default: Y", which made us believe it is set to 'Y', if not present in lsf.conf - which is ...

Add LSF_GPU_RESOURCE_IGNORE=Y in lsf.conf then restart the cluster. Also make sure you have installed ROCM SMI library on AMD GPU node. ------------------------------ YI SUN ------------------------------

We run the latest fix pack (14): $ lim -V EGO 3.4.0 build 601547, April 20 2023 $ sbatchd -V IBM Spectrum LSF 10.1.0.0 build 601547, April 20 2023 binary type: linux3.10-glibc2.17-x86_64 ------------------------------ Bernd Dammann -------- ...