awslabs/multi-model-server

big file request will not release memory

yangjian1218 opened this issue · 0 comments

When post a big file(a picture or a video) >=8M, docker will not release memory. when left momory cant support a requst. It will report error:io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 251658240, max: 259522560).
we can set -XX:MaxDirectMemorySize=1G, but it is not good idea.