Issues
- 2
Segfault on model open and close
#80 opened by shuttie - 0
Android inference issue "A FORTIFY: pthread_mutex_lock called on a destroyed mutex"
#79 opened by xunuohope1107 - 7
Process finished with exit code -1073741819 (0xC0000005) while trying to infer CodeGemma-2B GGUF
#77 opened by 32kda - 3
- 2
- 3
- 1
Add vocab_only
#70 opened by ardinursyamsu - 5
What's the model path in android?
#69 opened by Raffa064 - 6
fail with snowflake-arctic-embed-l
#59 opened by fbellomi - 1
- 2
Can't pass the test
#68 opened by ardinursyamsu - 8
Issues with logging in v3
#66 opened by martinhybergTE - 7
Interrupting inference?
#62 opened by jrtp - 2
'ggml-common.h' file not found On MacOS
#61 opened by MarchLiu - 5
- 7
'ggml-metal.metal' not found
#16 opened by Solido - 4
- 3
Prebuilt x86 linux libs use EVEX encoding for AVX instructions, causing SIGILL
#25 opened by AutonomicPerfectionist - 3
Questions and Feedback
#18 opened by Solido - 3
Missing libjllama on Linux aarch64
#17 opened by AutonomicPerfectionist - 3
version `GLIBCXX_3.4.29' not found
#19 opened by sc3sc3 - 1
- 3
empty response
#23 opened by mbofb - 1
- 8
WSL/Java 17 is supported?
#26 opened by javierfd - 5
Core dump on Ubuntu
#27 opened by DWAA1660 - 0
- 1
model.generate aborts with "libc++abi: terminating due to uncaught exception of type std::length_error: basic_string"
#29 opened by abadelt - 2
java.lang.NoSuchFieldError: de.kherud.llama.InferenceParameters.antiPrompt [Ljava/lang/String;
#31 opened by enimatek-nl - 1
- 3
Handling multi token utf8 bytes in streaming mode
#47 opened by hvisser - 1
java 8 patch
#36 opened by litongjava - 4
How build project on windows?
#40 opened by Maxon081102 - 1
- 3
- 3
"Failed to load native library" when using custom llama.cpp with GPU acceleration build
#53 opened by PauloIVM - 2
Update to a newer version of llama.cpp
#51 opened by RFYoung - 2
where is default llama and jllama dlls?
#44 opened by siddhsql - 3
Completion seems to ignore EOS token
#45 opened by hvisser - 3
not getting gpu acceleration on windows
#43 opened by siddhsql - 19
Android support?
#37 opened by samolego - 0
Deleting local references where it doesn't exist
#38 opened by samolego - 1
Support multimodal inputs
#34 opened by yeroc - 2
How to use GPU to run the modes, like to set "-ngl N, -- n-Gpu-layers N" in the llama.cpp project?
#32 opened by vo1d07 - 1
java.lang.UnsatisfiedLinkError: 'void de.kherud.llama.LlamaModel.delete()' on LlamaModel.close
#21 opened by mikhalchenko-alexander - 0
adapting MainExample.java for Builder pattern
#22 opened by mbofb - 2
- 9
- 2
GPU build issue: failed to load model
#12 opened by mymagicpower - 3
Could not find jni.h
#10 opened by mymagicpower