abertsch72/unlimiformer

Error in running Llama 2 generation example

OswaldHe opened this issue · 0 comments

Hi, I got the following error when I tried to execute the command in the README:

scores, values = faiss.knn_gpu(faiss.StandardGpuResources(), queries, self.keys, k, 
TypeError: torch_replacement_knn_gpu() got an unexpected keyword argument 'device'

I'm using faiss-gpu@1.7.2.