kherud/java-llama.cpp

Issues

• Please give a sample for Android

  #82 opened a year ago by SteveWorkshop
  2

• rerank

  #84 opened a year ago by litongjava
  1

• what is the process to build the project if i am only making changes to java-llama code?

  #90 opened 10 months ago by siddhsql
  1

• Exception Access Violation in Windows x86-64 when running in Windows 11 and default libraries (in release)

  #83 opened a year ago by kyselat
  6

• Unable to integrate java-llama.cpp with Android studio Java.

  #91 opened 10 months ago by Mohsin-Fawad
  0

• what are slots?

  #89 opened 10 months ago by siddhsql
  0

• Json request like role system or role user isn't support?

  #88 opened 10 months ago by yousefabdel1727
  1

• How to reset the context on every turn?

  #87 opened a year ago by siddhsql
  0

• does `llama-3.4.1-cuda12-linux-x86-64.jar` handle both CPU and GPU or only GPU?

  #86 opened a year ago by siddhsql
  0

• SIGILL error when executing a language model code on CPU on M1 MacBook with Rosetta 2 and Java 8

  #85 opened a year ago by s0t00524
  1

• Process finished with exit code -1073741819 (0xC0000005) while trying to infer CodeGemma-2B GGUF

  #77 opened a year ago by 32kda
  9

• Add Android sample

  #81 opened a year ago by shalva97
  1

• Segfault on model open and close

  #80 opened a year ago by shuttie
  2

• Android inference issue "A FORTIFY: pthread_mutex_lock called on a destroyed mutex"

  #79 opened a year ago by xunuohope1107
  0

• Add suuport to params.lora_adapters in newer llama.cpp (after b3534)

  #78 opened a year ago by xunuohope1107
  3

• 3.4.0 packaging regression: CUDA libs packed with the main JAR

  #76 opened a year ago by shuttie
  2

• JNI

  #72 opened a year ago by ys2940
  3

• Add vocab_only

  #70 opened a year ago by ardinursyamsu
  1

• What's the model path in android?

  #69 opened a year ago by Raffa064
  5

• fail with snowflake-arctic-embed-l

  #59 opened a year ago by fbellomi
  6

• Android build error : libllama.so is incompatible with aarch64linux

  #50 opened 2 years ago by RageshAntonyHM
  1

• Can't pass the test

  #68 opened a year ago by ardinursyamsu
  2

• Issues with logging in v3

  #66 opened a year ago by martinhybergTE
  8

• Interrupting inference?

  #62 opened a year ago by jrtp
  7

• 'ggml-common.h' file not found On MacOS

  #61 opened a year ago by MarchLiu
  2

• Java tests failed when CUDA enabled on version 3.0.0

  #54 opened 2 years ago by RFYoung
  5

• Prebuilt x86 linux libs use EVEX encoding for AVX instructions, causing SIGILL

  #25 opened 2 years ago by AutonomicPerfectionist
  3

• empty response

  #23 opened 2 years ago by mbofb
  3

• Need help: No native library found for os.name=Windows, os.arch=x86_64

  #24 opened 2 years ago by j0schihatake
  1

• WSL/Java 17 is supported?

  #26 opened 2 years ago by javierfd
  8

• Core dump on Ubuntu

  #27 opened 2 years ago by DWAA1660
  5

• Latest version did not publish to Maven

  #28 opened 2 years ago by AutonomicPerfectionist
  0

• model.generate aborts with "libc++abi: terminating due to uncaught exception of type std::length_error: basic_string"

  #29 opened 2 years ago by abadelt
  1

• java.lang.NoSuchFieldError: de.kherud.llama.InferenceParameters.antiPrompt [Ljava/lang/String;

  #31 opened 2 years ago by enimatek-nl
  2

• SIGILL (0x4) at pc=0x00007fe92acb5142, pid=3952, tid=4017

  #30 opened 2 years ago by siddhsql
  1

• Handling multi token utf8 bytes in streaming mode

  #47 opened 2 years ago by hvisser
  3

• java 8 patch

  #36 opened 2 years ago by litongjava
  1

• How build project on windows?

  #40 opened 2 years ago by Maxon081102
  4

• Suggestion: make obtaining the language model from the web more convenient

  #48 opened 2 years ago by mbofb
  1

• SIGSEGV Error During Execution of Embedding Code

  #49 opened 2 years ago by hide212131
  3

• "Failed to load native library" when using custom llama.cpp with GPU acceleration build

  #53 opened 2 years ago by PauloIVM
  3

• Update to a newer version of llama.cpp

  #51 opened 2 years ago by RFYoung
  2

• where is default llama and jllama dlls?

  #44 opened 2 years ago by siddhsql
  2

• Completion seems to ignore EOS token

  #45 opened 2 years ago by hvisser
  3

• not getting gpu acceleration on windows

  #43 opened 2 years ago by siddhsql
  3

• Android support?

  #37 opened 2 years ago by samolego
  19

• Deleting local references where it doesn't exist

  #38 opened 2 years ago by samolego
  0

• Support multimodal inputs

  #34 opened 2 years ago by yeroc
  1

• How to use GPU to run the modes, like to set "-ngl N, -- n-Gpu-layers N" in the llama.cpp project?

  #32 opened 2 years ago by vo1d07
  2

• adapting MainExample.java for Builder pattern

  #22 opened 2 years ago by mbofb
  0