Onnx-tensorrt: deserialization of the generated trt file

Created on 24 Oct 2018  路  2Comments  路  Source: onnx/onnx-tensorrt

After got the serialized .trt file, how can we deserialize it using tensorrt c++ api?

picture Eddiesyn
👍2

Most helpful comment

I don't think the doc discribes the process clearly enough. What is the modeldata and modelsize? Should I use class IHostmemroy to save the data and information?

picture FunkyKoki on 10 Oct 2019
👍3

All 2 comments

Please check this tutorial on how to deserialize TRT engine in C++:
https://docs.nvidia.com/deeplearning/sdk/tensorrt-developer-guide/index.html#serial_model_c

yinghai picture yinghai on 26 Nov 2018

I don't think the doc discribes the process clearly enough. What is the modeldata and modelsize? Should I use class IHostmemroy to save the data and information?

FunkyKoki picture FunkyKoki on 10 Oct 2019
👍3
Was this page helpful?
0 / 5 - 0 ratings

Related issues

lazykyama picture lazykyama  路  4Comments
shroudie picture shroudie  路  3Comments
bpinaya picture bpinaya  路  6Comments
austinmw picture austinmw  路  6Comments
wangzilu picture wangzilu  路  8Comments