java.lang.UnsatisfiedLinkError: 'void de.kherud.llama.LlamaModel.delete()' on LlamaModel.close
mikhalchenko-alexander opened this issue · 1 comments
mikhalchenko-alexander commented
Hi, I'm trying to do on-the-fly model reload. But whenever I try to close loaded model it throws UnsatisfiedLinkError. Minimal code to reproduce
ModelParameters modelParams = new ModelParameters.Builder()
.build();
InferenceParameters inferParams = new InferenceParameters.Builder()
.build();
LlamaModel model = new LlamaModel("/path/to/model.gguf", modelParams);
new Timer().schedule(new TimerTask() {
@Override
public void run() {
model.close();
}
}, 10000);
mikhalchenko-alexander commented
It seems that it is fixed in 2.2.1. Closing.