foldl/chatllm.cpp

Issues

• LlaMA 3.2 1B & 3B generate garbage after hundreds of tokens

  #38 opened 2 months ago by foldl
  0

• Tutorial on RAG: Convert fruit vector store failed - GGML_ASSERT: ...... Aborted

  #37 opened 2 months ago by GentleYo
  8

• Convert reranker model failed - TypeError: 'type' object is not subscriptable

  #35 opened 2 months ago by GentleYo
  11

• Question:Can we use chatllm.cpp in Android System

  #36 opened 2 months ago by FranzKafkaYu
  1

• phi-3.5 moe

  #34 opened 2 months ago by ayttop
  1

• phi 3.5 moe usage

  #31 opened 3 months ago by GlasslessPizza
  5

• sparsemixer function in Phi-3.5-MoE-insturct

  #33 opened 3 months ago by JustQJ
  1

• Phi-3.5-MoE-instruct

  #32 opened 3 months ago by ayttop
  1

• calculate required scratch memory

  #6 opened 3 months ago by foldl
  1

• CPU inferencing a lot slower than llama.cpp

  #10 opened 4 months ago by netspym
  3

• LlaMA 3.1 70B not work

  #30 opened 4 months ago by foldl
  0

• How to use GPU?

  #13 opened 6 months ago by li904775857
  2

• Model id for mistral nemo?

  #29 opened 4 months ago by mlsterpr0
  1

• F16 quantization not work

  #28 opened 4 months ago by foldl
  1

• gemma模型的bug

  #26 opened 4 months ago by phpk
  3

• baichuan13 does not work well

  #27 opened 5 months ago by cagev
  1

• bge-reranker is extreamly slow

  #24 opened 5 months ago by RobinQu
  10

• bindings里面的openai_api.ts好像读不到历史信息

  #22 opened 5 months ago by gabrielpondc
  3

• The same sentence appears in loop

  #19 opened 5 months ago by ChenHuge
  3

• 你好，请问支持GLM-4V吗？

  #23 opened 5 months ago by yhl41001
  2

• crashed using qwen2 72b

  #21 opened 5 months ago by cagev
  2

• RuntimeError: Internal: could not parse ModelProto from /home/james/glm-4-9b-chat/tokenizer.model

  #20 opened 5 months ago by jamfor352
  3

• Does this project have a communication group?

  #15 opened 5 months ago by wyrjob
  1

• 请问可否给个docker镜像

  #17 opened 6 months ago by zhanpengjie
  1

• quantized InternLM2 failed

  #18 opened 6 months ago by cagev
  2

• Support GGUF

  #16 opened 6 months ago by trufae
  1

• build libchatllm error

  #14 opened 6 months ago by wzg-zhuo
  1

• Compilation of bindings under macOS does not succeed

  #12 opened 6 months ago by phpk
  1

• mac打包报错

  #11 opened 6 months ago by phpk
  4

• LLM conversion is a issue.

  #9 opened 6 months ago by netspym
  2

• 提供python调用方式

  #3 opened 8 months ago by wzg-zhuo
  5

• can't build on arm termux

  #8 opened 8 months ago by coinight
  2

• 请问如何部署BCEmbedding的rerank模型？

  #7 opened 8 months ago by chenchun0629
  1

• core dumped

  #5 opened 8 months ago by MarsMeng1994
  2

• 用-p提供命令行的prompt参数时，不支持中文。

  #4 opened 9 months ago by yg1988
  1

• how do i run phi-2 on cpu (x86 ec2)

  #1 opened 10 months ago by kirilligum
  4