baileytec-labs/llama-on-lambda

permission issue

Closed this issue · 1 comments

i just follow your instruction to deploy the lambda. i am not using cdk,but manually build the docker image and push the image to the aws esr,and i create the lambda and update ram to 10GB add function url,when i visit the function url with /docs,i can access the web page,but if i try to call the prompt from web ,it failed quickly, the log says:

error loading model: failed to open /opt/modelfile.bin: Permission denied 
| 2023-06-28T16:55:35.852+08:00 | llama_load_model_from_file: failed to load model 
| 2023-06-28T16:55:35.853+08:00 | Traceback (most recent call last):
| 2023-06-28T16:55:35.853+08:00 | File "/function/main.py", line 35, in prompt
| 2023-06-28T16:55:35.853+08:00 | llm = Llama(model_path=MODELPATH,seed=seedval)

any idea?

my fault.