TensorRT加速(VS+opencv4.5)


1.安装配置TensorRT

(1)在官网进行下载:https://developer.nvidia.cn/zh-cn/tensorrt

 (2)配置

包含目录:

 库目录:

 链接器:

cublas.lib
cublasLt.lib
cuda.lib
cudadevrt.lib
cudart.lib
cudart_static.lib
cudnn.lib
cudnn64_8.lib
cudnn_adv_infer.lib
cudnn_adv_infer64_8.lib
cudnn_adv_train.lib
cudnn_adv_train64_8.lib
cudnn_cnn_infer.lib
cudnn_cnn_infer64_8.lib
cudnn_cnn_train.lib
cudnn_cnn_train64_8.lib
cudnn_ops_infer.lib
cudnn_ops_infer64_8.lib
cudnn_ops_train.lib
cudnn_ops_train64_8.lib
cufft.lib
cufftw.lib
curand.lib
cusolver.lib
cusolverMg.lib
cusparse.lib
nppc.lib
nppial.lib
nppicc.lib
nppicom.lib
nppidei.lib
nppif.lib
nppig.lib
nppim.lib
nppist.lib
nppisu.lib
nppitc.lib
npps.lib
nvblas.lib
nvgraph.lib
nvjpeg.lib
nvml.lib
nvrtc.lib
OpenCL.lib
opencv_world451.lib
myelin64_1.lib
nvinfer.lib
nvinfer_plugin.lib
nvonnxparser.lib
nvparsers.lib

 2.创建项目

 3. 代码

参考:https://cloud.tencent.com/developer/article/1800743

https://blog.csdn.net/hjxu2016/article/details/119796206

Tips:

1. 先创建内存空间,再加载图进行推理

2. 图片预处理

resize(image, image, Size(224, 224));
image.convertTo(img2, CV_32F);
img2 = (img2 / 255 - 0.2458) / 0.0612;

相当于:

transforms.Resize([224, 224]),
transforms.ToTensor(),
transforms.Normalize(mean=[0.2458], std=[0.0612])

3. 代码整理好了再放