/tvm_tensorrt

Comparing the inference performance of TVM kernel tuning, Ansor and TensorRT on ResNet

Primary LanguageC++MIT LicenseMIT

Contributors Forks Stargazers Issues MIT License LinkedIn


TVM TensorRT Deployment Performance Comparison

Install dependencies

sudo apt install opencv

Installing TensorRT from this link

Installing TVM form TVM tutorial

Make sure to set set(USE_LLVM ON) and set(USE_CUDA ON) in build/config.cmake

How to build

git clone --recursive https://github.com/jc-su/tvm_tensorrt_comparsion
mkdir build
cd build
cmake ..
make $(nproc)