kherud/java-llama.cpp

java.lang.UnsatisfiedLinkError: 'void de.kherud.llama.LlamaModel.delete()' on LlamaModel.close

mikhalchenko-alexander opened this issue · 1 comments

Hi, I'm trying to do on-the-fly model reload. But whenever I try to close loaded model it throws UnsatisfiedLinkError. Minimal code to reproduce

ModelParameters modelParams = new ModelParameters.Builder()
                .build();
InferenceParameters inferParams = new InferenceParameters.Builder()
        .build();
LlamaModel model = new LlamaModel("/path/to/model.gguf", modelParams);
new Timer().schedule(new TimerTask() {
    @Override
    public void run() {
        model.close();
    }
}, 10000);

It seems that it is fixed in 2.2.1. Closing.