ROCm/hipBLAS

[Feature]: Optional rocSOLVER at run time

cgmb opened this issue · 0 comments

cgmb commented

Suggestion Description

There is a BUILD_WITH_SOLVER CMake option, but it would be nice if the rocsolver library could be loaded at run-time with dlopen when BUILD_WITH_SOLVER is OFF. This would allow Debian and Ubuntu systems packages to build with -DBUILD_WITH_SOLVER=OFF and mark rocsolver as a recommended package, rather than a required dependency. The behaviour for BUILD_WITH_SOLVER=ON would be unchanged (and would be needed for static hipBLAS builds).

Users that wish to use hipBLAS for applications such as llama-cpp currently must install hipBLAS, which depends on rocSOLVER, which depends on rocSPARSE. Despite only wanting to run a few GEMMS, they end up installing several gigabytes of other libraries that provide functionality that they do not need for their particular application. The rocSOLVER library has made rocSPARSE an optional dependency for this reason, and I think it would be a good idea for hipBLAS to do the same.

The rocSOLVER library would still be installed with hipblas by default, but users could specifically request --no-install-recommends to avoid it (or could explicitly uninstall rocsolver).

Operating System

Ubuntu

GPU

No response

ROCm Component

hipBLAS