[eden-u4]

I don't have much experience with ROCm for large trainings, but NVIDIA is still shit with driver+cuda version+other things. The only simplification is due to ubuntu and other distros that already do the heavy lift by installing all required components, without much configuration.

[npteljes]

Oh I'm sure. The thing is that with AMD I have the same luxury, and the wretched thing still doesn't work, or has regressions.

[int_19h]

On Ubuntu, in my experience, installing the .deb version of the CUDA toolkit pretty much "just works".