dvmazur/mixtral-offloading

hqq_aten package not installed.

LeMoussel opened this issue · 2 comments

When I execute the notebook demo.ipynb, I got hqq_aten package not installed. HQQBackend.ATEN backend will not work unless you install the hqq_aten lib in hqq/kernels.

What does it mean? What should be installed?

Hey, @LeMoussel! This is a warning and does not affect the notebook's execution in any way. Moreover, hqq_aten is not needed as we have custom kernels for HQQ inference.

anyone found info on how to install hqq_aten though?