fastertransformer/utils/nccl_utils.cc:62 'unhandled cuda error'

Question

fastertransformer/utils/nccl_utils.cc:62 'unhandled cuda error'

wangweiwei1188 opened this issue a year ago · 0 comments

wangweiwei1188 commented a year ago

Branch/Tag/Commit

main

Docker Image Version

mini

GPU name

p100

CUDA Driver

470.199.02

Reproduced Steps

1. tritonserver --model-repository=/path  
2. fastertransformer/utils/nccl_utils.cc:62 'unhandled cuda error'

But when export FT_LOG_LEVEL=DEBUG it's ok.