baileytec-labs/llama-on-lambda

Use Lambda Web Adapter for response streaming

Opened this issue · 0 comments

bnusunny commented

Suggest using Lambda Web Adapter in the Dockerfile to get response streaming support.

https://github.com/awslabs/aws-lambda-web-adapter