menloresearch/cortex.llamacpp

Issues

• feat: [DESCRIPTION] support mac vulkan

  #403 opened 8 months ago by alsyundawy
  1

• bug: [v0.5.15] Running DeepSeek R1 error:"Failed to fetch"

  #426 opened 8 months ago by david-menloai
  0

• bug: could not stop streaming inference

  #313 opened 10 months ago by vansangpfiev
  1

• feat: llamacpp README.md file

  #139 opened 10 months ago by irfanpena
  0

• feat: CI for VNNI support

  #60 opened a year ago by vansangpfiev
  5

• chore: fix macos codesign ci cortex.llamacpp

  #322 opened a year ago by hiento09
  0

• feat: Nightly build release name should map with commit ID from upstream repo llama.cpp

  #303 opened a year ago by hiento09
  3

• chore: setup macos-12 selfhosted runner

  #317 opened a year ago by hiento09
  1

• feat: [support log prob like OpenAI API]

  #262 opened a year ago by nguyenhoangthuan99
  6

• feat: [support logit_bias for OpenAI API compatible]

  #263 opened a year ago by nguyenhoangthuan99
  1

• feat: [support return multiple choices]

  #264 opened a year ago by nguyenhoangthuan99
  3

• feat: [support stream_option for OpenAI API compatible]

  #265 opened a year ago by nguyenhoangthuan99
  1

• feat: [Windows] CI for AMD RoCM support

  #9 opened a year ago by hiro-v
  1

• feat: Add Intel GPU Support via SYCL on Linux platform

  #107 opened a year ago by xiangyang-95
  1

• Discussion: Review cuda build flags

  #24 opened a year ago by vansangpfiev
  1

• Offloading to VRAM, RAM memory lock, etc : Features of Faraday.dev

  #213 opened a year ago by ClaudeRobbinCR
  1

• feat: instructions detecting

  #20 opened a year ago by vansangpfiev
  0

• feat: add build cuda without any avx instruction

  #173 opened a year ago by nguyenhoangthuan99
  1

• Discussion: batching benchmark and improvement

  #164 opened a year ago by vansangpfiev
  2

• bug: CI for vulkan builds seem broken when rebase to b3389

  #143 opened a year ago by vansangpfiev
  0

• feat: improve the testing so we can rebase llama.cpp nightly

  #47 opened a year ago by vansangpfiev
  0

• bug: Quick start section in README.md has duplicated command

  #109 opened a year ago by xiangyang-95
  1

• feat: get running models

  #33 opened a year ago by vansangpfiev
  0

• Codebase should have a clear coding convention

  #17 opened a year ago by vansangpfiev
  0

• feat: CI

  #1 opened 2 years ago by vansangpfiev
  1

• feat: example to run backend

  #2 opened 2 years ago by vansangpfiev
  0

• feat: e2e testing script for completion endpoint

  #3 opened 2 years ago by vansangpfiev
  0

• feat: e2e testing script for embedding endpoint

  #4 opened 2 years ago by vansangpfiev
  0