Atome-FE/llama-node

Issue to build GPU version

dspasyuk opened this issue · 1 comments

I am trying to build a GPU version of llama-node/lama-cpp but running into the issue with napi package. The package does not get installed automatically when I try to install it I get an error that supported platform for napi is Node 0.4. Am I missing something? Has anyone build this successfully for the Nvidia GPU?

[llama-cpp]$ pnpm build:cuda

Checking environment...

Checking rustc...✅
Checking cargo...✅
Checking cmake...✅
Checking llvm...✅
Checking clang.../bin/sh: clang: command not found
Checking gcc...✅
Checking nvcc...✅

Compiling...

/bin/sh: napi: command not found
[UnhandledPromiseRejection: This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). The promise rejected with the reason "127".] {
code: 'ERR_UNHANDLED_REJECTION'
}

Napi Error:

npm WARN EBADENGINE Unsupported engine {
npm WARN EBADENGINE package: 'node-api@0.0.1',
npm WARN EBADENGINE required: { node: '~0.4' },
npm WARN EBADENGINE current: { node: 'v16.14.0', npm: '8.3.1' }
npm WARN EBADENGINE }

Instruction on the website is not complete you need to first do npm install llama-node before going into packages/llama-cpp/ and do pnpm build:cuda.