DerryHub/BEVFormer_tensorrt
BEVFormer inference on TensorRT, including INT8 Quantization and Custom TensorRT Plugins (float/half/half2/int8).
PythonApache-2.0
Issues
- 0
关于bevformer进行int8量化的疑问?
#108 opened by IEIAuto - 2
- 5
benchmark on orin
#75 opened by shuyuan-wang - 0
- 0
- 2
Issue trying to deploy model on TensorRT
#105 opened by gcunhase - 10
does anyone try to deploy this great repo in jetson orin? Unsupported operator Gridsampler2DTRT
#57 opened by sainttelant - 1
- 0
test_fp16 (det2trt.models.utils.test_trt_ops.test_multi_scale_deformable_attn.MultiScaleDeformableAttnTestCase) ... error in ms_deformable_im2col_cuda: no kernel image is available for execution on the device error in ms_deformable_im2col_cuda: no kernel image is available for execution on the device FAIL
#104 opened by MarkGJ - 0
base模型的tensorrt加速出现精度溢出的问题,请问如何解决?
#103 opened by scuizhibin - 1
ImportError: cannot import name 'iou3d_cuda' from partially initialized module 'third_party.bev_mmdet3d.ops.iou3d' (most likely due to a circular import)(workspace/./third_party/bev_mmdet3d/opts/iou3d/__init__.py)
#102 opened by REN529 - 1
- 6
error: no instance of overloaded function "nvcuda::wmma::load_matrix_sync"
#70 opened by santoshcoder23 - 0
why overwrite multiscaleDeformableAttnPlugin ?
#101 opened by lix19937 - 3
amples/bevformer/tiny/pth2onnx.sh error,
#74 opened by linClubs - 2
UNSUPPORTED_NODE: Assertion failed: creator && "Plugin not found, a When running test sample
#100 opened by guiyuliu - 1
TensorRT plugin for BEVFormer Encoder
#86 opened by Wolfybox - 2
About onnx surgeon
#99 opened by gaosanyuan - 1
Stucked at onnx::Expand_1007 when running "sh samples/bevformer/plugin/tiny/onnx2trt.sh -d 0"
#83 opened by kamiLight - 1
qat model
#73 opened by CodeWorldChanged - 1
- 6
- 2
- 2
No importer registered for op: MMCVModulatedDeformConv2d. Attempting to import as plugin.
#97 opened by Alex-fishred - 3
OSError: /home/work/Downloads/BEVFormer_tensorrt/TensorRT/lib/libtensorrt_ops.so: cannot open shared object file: No such file or directory
#90 opened by ZSA010807 - 9
- 0
why tensorrt do inference slower than pytorch
#95 opened by gofreelee - 0
Are the Inverse, BEV Pool V2, Flash Multi-Head Attention not used in the bevformer?
#93 opened by kamiLight - 0
Did you really run the BEVFromer(Pytorch) on 3090? Or you just copy the result from https://github.com/fundamentalvision/BEVFormer
#91 opened by admyxs - 0
What's the purpose of prod for bev_mask
#89 opened by Jian-danai - 2
RuntimeError: modulated_deformable_im2col_impl: implementation for device cuda:0 not found.
#88 opened by qingwan7 - 3
ERROR: Could not build wheels for pycocotools, which is required to install pyproject.toml-based projects
#80 opened by kamiLight - 2
The input image size
#85 opened by Jian-danai - 2
'CustomMSDeformableAttentionTRTP' gives incorrect outputs in Pytorch inference
#84 opened by Jian-danai - 1
Dockerfile half updated?
#77 opened by jeeprhymeallthetime - 1
A bug when transferring onnx to trt
#79 opened by Son-Goku-gpu - 1
- 21
error in ms_deformable_im2cal_cuda : no kernel image is available for execution on the device
#69 opened by CodeWorldChanged - 18
SpatialCrossAttentionTRT don't select valid query, no cuda memory problem here?
#71 opened by sherylwang - 2
Can't find BEVFormer_ptq_max model
#72 opened by Oh-Cest-la-vie - 2
What does points_per_group mean?
#63 opened by shaoqb - 2
The usage of flash attention
#66 opened by 2401ch - 1
How to use a different yolox weight other than the one provided to do quantization in the context?
#64 opened by NutshellLee - 2
When doing yolox/trt_evaluate.sh for fp32 tensorrt model, what's the reason this error occurred? how can i fix it?
#65 opened by NutshellLee - 1
No module named 'pytorch_quantization
#61 opened by Isaac-xie - 1
build bev_mmdert3d error: Invalid distribution name or version syntax: bev-mmdet3d--0.1
#55 opened by firestonelib - 0
How can i see the output image
#56 opened by Ashu683 - 0
ImportError: cannot import name 'iou3d_cuda'
#53 opened by Ashu683 - 1
ImportError: cannot import name 'iou3d_cuda' from partially initialized module 'third_party.bev_mmdet3d.ops.iou3d'
#52 opened by Ashu683 - 3
can not use onnxsim
#51 opened by shaoqb