NVIDIA/FasterTransformer

Can FasterTransformer only deploy via Triton server?

jxcomeon opened this issue · 0 comments

I use centos without docker. I download tritonserver2.33.0-jetpack5.1.tgz and run CUDA_VISIBLE_DEVICES=0,1 /opt/tritonserver/bin/tritonserver \ --model-repository=./triton-model-store/t5/ . It reports an error: slurmstepd: error: execve(): ../bin/tritonserver: Exec format error. How can i solve this problem?