skeskinen/bert.cpp

Error Running Server Example

BradSmith2015 opened this issue · 1 comments

When I try to run the server example I get an error

bert_load_from_file: loading model from 'models/all-MiniLM-L6-v2/ggml-model-q4_0.bin' - please wait ...
bert_load_from_file: n_vocab = 30522
bert_load_from_file: n_max_tokens   = 512
bert_load_from_file: n_embd  = 384
bert_load_from_file: n_intermediate  = 1536
bert_load_from_file: n_head  = 12
bert_load_from_file: n_layer = 6
bert_load_from_file: f16     = 2
bert_load_from_file: ggml ctx size =  12.26 MB
libc++abi: terminating due to uncaught exception of type std::length_error: basic_string

Running on Mac m1

I'm seeing the same, with a checkout from today.

backtrace from debugger

jaybinks@Jays-Mac-mini bert.cpp % sudo lldb ./build/bin/main
Password:
(lldb) target create "./build/bin/main"
Current executable set to '/Users/jaybinks/src/bert.cpp/build/bin/main' (arm64).
(lldb) run  -m models/all-MiniLM-L6-v2/ggml-model-q4_0.bin
Process 86343 launched: '/Users/jaybinks/src/bert.cpp/build/bin/main' (arm64)
bert_load_from_file: loading model from 'models/all-MiniLM-L6-v2/ggml-model-q4_0.bin' - please wait ...
bert_load_from_file: n_vocab = 30522
bert_load_from_file: n_max_tokens   = 512
bert_load_from_file: n_embd  = 384
bert_load_from_file: n_intermediate  = 1536
bert_load_from_file: n_head  = 12
bert_load_from_file: n_layer = 6
bert_load_from_file: f16     = 2
bert_load_from_file: ggml ctx size =  12.26 MB
libc++abi: terminating with uncaught exception of type std::length_error: basic_string
bert_load_from_file: Process 86343 stopped
* thread #1, queue = 'com.apple.main-thread', stop reason = signal SIGABRT
    frame #0: 0x00000001a6dc6868 libsystem_kernel.dylib`__pthread_kill + 8
libsystem_kernel.dylib`:
->  0x1a6dc6868 <+8>:  b.lo   0x1a6dc6888               ; <+40>
    0x1a6dc686c <+12>: pacibsp 
    0x1a6dc6870 <+16>: stp    x29, x30, [sp, #-0x10]!
    0x1a6dc6874 <+20>: mov    x29, sp
(lldb) bt
* thread #1, queue = 'com.apple.main-thread', stop reason = signal SIGABRT
  * frame #0: 0x00000001a6dc6868 libsystem_kernel.dylib`__pthread_kill + 8
    frame #1: 0x00000001a6dfdcec libsystem_pthread.dylib`pthread_kill + 288
    frame #2: 0x00000001a6d362c8 libsystem_c.dylib`abort + 180
    frame #3: 0x00000001a6db6b18 libc++abi.dylib`abort_message + 132
    frame #4: 0x00000001a6da69f4 libc++abi.dylib`demangling_terminate_handler() + 312
    frame #5: 0x00000001a6aab774 libobjc.A.dylib`_objc_terminate() + 160
    frame #6: 0x00000001a6db5eb4 libc++abi.dylib`std::__terminate(void (*)()) + 20
    frame #7: 0x00000001a6db8c2c libc++abi.dylib`__cxxabiv1::failed_throw(__cxxabiv1::__cxa_exception*) + 36
    frame #8: 0x00000001a6db8bd8 libc++abi.dylib`__cxa_throw + 140
    frame #9: 0x0000000100003ee0 main`std::__1::__throw_length_error[abi:v15006](char const*) + 60
    frame #10: 0x0000000100009848 main`std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>::__throw_length_error[abi:v15006]() const + 20
    frame #11: 0x000000010000835c main`bert_load_from_file + 8632
    frame #12: 0x0000000100003aec main`main + 124
    frame #13: 0x00000001a6ad3e50 dyld`start + 2544
(lldb)