janhq/cortex.cpp

bug: `uncaught exception of type cpp::bitwizeshift::bad_result_access`

Closed this issue · 1 comments

gabrielle-ong commented

Cortex version

v178

Describe the Bug

cortex run HF model

throws error on mac

libc++abi: terminating due to uncaught exception of type cpp::bitwizeshift::bad_result_access<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>: error attempting to access value from result containing error
[1]    15073 abort      cortex-nightly run bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

linux

libc++abi: terminating due to uncaught exception of type cpp::bitwizeshift::bad_result_access<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>: error attempting to access value from result containing error
[1]    15073 abort      cortex-nightly run bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Steps to Reproduce

No response

Screenshots / Logs

image

VM: linux app 1
Image

What is your OS?

  • MacOS
  • Windows
  • Linux

What engine are you running?

  • cortex.llamacpp (default)
  • cortex.tensorrt-llm (Nvidia GPUs)
  • cortex.onnx (NPUs, DirectML)
gabrielle-ong commented

Resolved as of v187 on Mac and Windows, thanks @vansangpfiev!

Image
Image