baileytec-labs/llama-on-lambda
Deploy llama.cpp compatible Generative AI LLMs on AWS Lambda!
PythonNOASSERTION
Issues
- 0
- 6
Use ARM64 to increase performance
#3 opened by bnusunny - 1
permission issue
#7 opened by callMeMakerRen - 0
Add Contribution Instructions
#5 opened by sean-bailey - 6
What is the latency?
#1 opened by philschmid - 0