Detectron2: Caffe2 export of quantized model

[zetyquickly]

Hello, everyone

First of all I've finally obtained results in a fight with ONNX export of quantized model built on detectron2 and trained using PyTorch QAT tools. So if anyone interested in guidance in this or in PR of additional functionality in detectron2 please write me back.

I understand that export of quantized model using detectron2/export tools might not be supported for now. But there are frequent mentions of INT8 in a code that's why I'll ask the following.

While I do conversion after I see:
ONNX export Done. Exported predict_net (before optimizations)

Code logs an error:

[W init.h:137] Caffe2 GlobalInit should be run before any other API calls.
[W tensor.cc:167] Changing the data type of Tensor is discouraged. Attempt to change data type from: nullptr (uninitialized) to: unsigned char
Traceback (most recent call last):
  File "./tools/caffe2_converter.py", line 111, in <module>
    caffe2_model = export_caffe2_model(cfg, model, first_batch)
  File "/root/some_detectron2/detectron2/export/api.py", line 157, in export_caffe2_model
    return Caffe2Tracer(cfg, model, inputs).export_caffe2()
  File "/root/some_detectron2/detectron2/export/api.py", line 95, in export_caffe2
    predict_net, init_net = export_caffe2_detection_model(model, inputs)
  File "/root/some_detectron2/detectron2/export/caffe2_export.py", line 171, in export_caffe2_detection_model
    init_net = construct_init_net_from_params(params, device_options)
  File "/root/some_detectron2/detectron2/export/shared.py", line 312, in construct_init_net_from_params
    [create_const_fill_op(name, blob, device_option=device_options.get(name, None))]
  File "/root/some_detectron2/detectron2/export/shared.py", line 290, in create_const_fill_op
    assert device_option is None
AssertionError

The model takes floats as input and returns floats as outputs, inputs are implicitly quantized at the beggining of the network.

Is it possible to properly configurate export API functionality to export qunatized model?
Is device_option assertion is vital in such exporting?

[ppwwyyxx]

Quantization is not currently supported. We only have internal support, (a very small) part of it open sourced.

[zetyquickly]

Quantization is not currently supported. We only have internal support, (a very small) part of it open sourced.

Thank you @ppwwyyxx

Is this includes PyTorch/Caffe2 modification or it is written on top existing commits?
It will be open sourced in the future, is there any pros for not doing double work now? I mean adding such support by ourselves

[ppwwyyxx]

It does not include pytorch/caffe2 modifications. We would like to open source them eventually but we likely won't have time to work on this in the near (3 months) future.

[ppwwyyxx]

btw, https://github.com/sstsai-adl/workshops/tree/master/LPCV_2020/uav_video_challenge contains a quantized CPU model for text detection. It may give an idea of what the model looks like in the end. They were released by a different team for an inference demo only.

[zetyquickly]

btw, https://github.com/sstsai-adl/workshops/tree/master/LPCV_2020/uav_video_challenge contains a quantized CPU model for text detection. It may give an idea of what the model looks like in the end. They were released by a different team for an inference demo only.

Thanks for your concern,
I'll add something on that.

For anyone who wants to export quantized detectron2 model in TorchScript I would recommend do monkey patching of forward, __init__ and fuse functions of layers that are used in your meta architecture , e.g. GeneralizedRCNN. Then do quantization preparation, fusion and do QAT or static quantization (see official docs). After that you can trace the model manually or use experimental TorchScript tracing functionality of detectron2/export. It should do the trick if you want to deploy in PC CPU

But if you are interested in mobile deployment of a model, for now TorchScript is not a working approach

[zhoujinhai]

btw, https://github.com/sstsai-adl/workshops/tree/master/LPCV_2020/uav_video_challenge contains a quantized CPU model for text detection. It may give an idea of what the model looks like in the end. They were released by a different team for an inference demo only.

Thanks for your concern,
I'll add something on that.

For anyone who wants to export quantized detectron2 model in TorchScript I would recommend do monkey patching of forward, __init__ and fuse functions of layers that are used in your meta architecture , e.g. GeneralizedRCNN. Then do quantization preparation, fusion and do QAT or static quantization (see official docs). After that you can trace the model manually or use experimental TorchScript tracing functionality of detectron2/export. It should do the trick if you want to deploy in PC CPU

But if you are interested in mobile deployment of a model, for now TorchScript is not a working approach

I want to deploy quantization model in PC, Do you have solved it?

[zetyquickly]

Hi, @zhoujinhai

If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo
If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet.

[zhoujinhai]

Thanks  I will try it

发自我的iPhone

------------------ Original ------------------
From: Emil Bogomolov <[email protected]>
Date: Wed,Aug 5,2020 2:49 AM
To: facebookresearch/detectron2 <[email protected]>
Cc: zhoujinhai <[email protected]>, Mention <[email protected]>
Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496)

Hi, @zhoujinhai

If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo
If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.

[zhoujinhai]

Hi, @zhoujinhai

If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo
If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet.

Have you tried with mask rcnn model?

[zetyquickly]

Hello, @zhoujinhai

By the link that I attached you can see the quantization patching of GeneralizedRCNN class which is the generalization of MaskRCNN architecture.

If you have further questions, please leave this issue's thread and ask them in the mentioned repo. I will try to answer them

[yang-gis]

Hi, @zhoujinhai

If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo
If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet.

hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10.

[zhoujinhai]

It doesn't support windows

发自我的iPhone

------------------ Original ------------------
From: yang jinyi <[email protected]>
Date: Mon,Sep 14,2020 9:37 AM
To: facebookresearch/detectron2 <[email protected]>
Cc: zhoujinhai <[email protected]>, Mention <[email protected]>
Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496)

Hi, @zhoujinhai

If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo
If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet.

hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.

[yang-gis]

It doesn't support windows 发自我的iPhone
…
------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe

It doesn't support windows 发自我的iPhone
…
------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

感觉不对啊。我测试了支持windows，用cpu模型可以运行，但使用gpu模型在windows中运行失败。在workspace.runnetonce(init_model.pb)处报错

[zhoujinhai]

我是在ubuntu上运行的 windows我看官方部署文档貌似说过不支持

发自我的iPhone

------------------ Original ------------------
From: yang jinyi <[email protected]>
Date: Tue,Sep 15,2020 6:12 PM
To: facebookresearch/detectron2 <[email protected]>
Cc: zhoujinhai <[email protected]>, Mention <[email protected]>
Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496)

It doesn't support windows 发自我的iPhone
…
------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe

It doesn't support windows 发自我的iPhone
…
------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

感觉不对啊。我测试了支持windows，用cpu模型可以运行，但使用gpu模型在windows中运行失败。在workspace.runnetonce(init_model.pb)处报错

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.

[yang-gis]

我是在ubuntu上运行的 windows我看官方部署文档貌似说过不支持 发自我的iPhone
…
------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Tue,Sep 15,2020 6:12 PM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 感觉不对啊。我测试了支持windows，用cpu模型可以运行，但使用gpu模型在windows中运行失败。在workspace.runnetonce(init_model.pb)处报错 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

我试了windows上cpu模型可以跑，gpu模型不行，不知是不是我caffe2在vs中的配置问题，还是模型问题，或是本身windows不支持gpu模型运行

[zhoujinhai]

Gpu应该要配置cuda动态库还有probuf哪些 具体没在windows下弄过

发自我的iPhone

------------------ Original ------------------
From: yang jinyi <[email protected]>
Date: Fri,Sep 18,2020 8:49 AM
To: facebookresearch/detectron2 <[email protected]>
Cc: zhoujinhai <[email protected]>, Mention <[email protected]>
Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496)

我是在ubuntu上运行的 windows我看官方部署文档貌似说过不支持 发自我的iPhone
…
------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Tue,Sep 15,2020 6:12 PM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 感觉不对啊。我测试了支持windows，用cpu模型可以运行，但使用gpu模型在windows中运行失败。在workspace.runnetonce(init_model.pb)处报错 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

我试了windows上cpu模型可以跑，gpu模型不行，不知是不是我caffe2在vs中的配置问题，还是模型问题，或是本身windows不支持gpu模型运行

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.

[yang-gis]

Gpu应该要配置cuda动态库还有probuf哪些 具体没在windows下弄过 发自我的iPhone
…
------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Fri,Sep 18,2020 8:49 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) 我是在ubuntu上运行的 windows我看官方部署文档貌似说过不支持 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Tue,Sep 15,2020 6:12 PM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 感觉不对啊。我测试了支持windows，用cpu模型可以运行，但使用gpu模型在windows中运行失败。在workspace.runnetonce(init_model.pb)处报错 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 我试了windows上cpu模型可以跑，gpu模型不行，不知是不是我caffe2在vs中的配置问题，还是模型问题，或是本身windows不支持gpu模型运行 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

好的，谢谢。暂时我还不知道怎么解决这个问题

[zhoujinhai]

你可以用pytorch检查windows下gpu是否可用 逐步排查下

发自我的iPhone

------------------ Original ------------------
From: yang jinyi <[email protected]>
Date: Wed,Sep 23,2020 8:39 AM
To: facebookresearch/detectron2 <[email protected]>
Cc: zhoujinhai <[email protected]>, Mention <[email protected]>
Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496)

Gpu应该要配置cuda动态库还有probuf哪些 具体没在windows下弄过 发自我的iPhone
…
------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Fri,Sep 18,2020 8:49 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) 我是在ubuntu上运行的 windows我看官方部署文档貌似说过不支持 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Tue,Sep 15,2020 6:12 PM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 感觉不对啊。我测试了支持windows，用cpu模型可以运行，但使用gpu模型在windows中运行失败。在workspace.runnetonce(init_model.pb)处报错 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 我试了windows上cpu模型可以跑，gpu模型不行，不知是不是我caffe2在vs中的配置问题，还是模型问题，或是本身windows不支持gpu模型运行 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

好的，谢谢。暂时我还不知道怎么解决这个问题

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.

[yang-gis]

你可以用pytorch检查windows下gpu是否可用 逐步排查下 发自我的iPhone
…
------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Wed,Sep 23,2020 8:39 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Gpu应该要配置cuda动态库还有probuf哪些 具体没在windows下弄过 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Fri,Sep 18,2020 8:49 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) 我是在ubuntu上运行的 windows我看官方部署文档貌似说过不支持 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Tue,Sep 15,2020 6:12 PM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 感觉不对啊。我测试了支持windows，用cpu模型可以运行，但使用gpu模型在windows中运行失败。在workspace.runnetonce(init_model.pb)处报错 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 我试了windows上cpu模型可以跑，gpu模型不行，不知是不是我caffe2在vs中的配置问题，还是模型问题，或是本身windows不支持gpu模型运行 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 好的，谢谢。暂时我还不知道怎么解决这个问题 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

大佬我检查了。python下的pytorch以及caffe2是可以调用gpu的。哎，就是c++没有gpu的例子试一下

[zhoujinhai]

你转caffe2模型的时候有个参数要设置成cuda 默认是cpu

发自我的iPhone

------------------ Original ------------------
From: yang jinyi <[email protected]>
Date: Thu,Sep 24,2020 9:39 AM
To: facebookresearch/detectron2 <[email protected]>
Cc: zhoujinhai <[email protected]>, Mention <[email protected]>
Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496)

你可以用pytorch检查windows下gpu是否可用 逐步排查下 发自我的iPhone
…
------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Wed,Sep 23,2020 8:39 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Gpu应该要配置cuda动态库还有probuf哪些 具体没在windows下弄过 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Fri,Sep 18,2020 8:49 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) 我是在ubuntu上运行的 windows我看官方部署文档貌似说过不支持 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Tue,Sep 15,2020 6:12 PM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 感觉不对啊。我测试了支持windows，用cpu模型可以运行，但使用gpu模型在windows中运行失败。在workspace.runnetonce(init_model.pb)处报错 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 我试了windows上cpu模型可以跑，gpu模型不行，不知是不是我caffe2在vs中的配置问题，还是模型问题，或是本身windows不支持gpu模型运行 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 好的，谢谢。暂时我还不知道怎么解决这个问题 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

大佬我检查了。python下的pytorch以及caffe2是可以调用gpu的。哎，就是c++没有gpu的例子试一下

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.

[yang-gis]

你转caffe2模型的时候有个参数要设置成cuda 默认是cpu 发自我的iPhone
…
------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Thu,Sep 24,2020 9:39 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) 你可以用pytorch检查windows下gpu是否可用 逐步排查下 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Wed,Sep 23,2020 8:39 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Gpu应该要配置cuda动态库还有probuf哪些 具体没在windows下弄过 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Fri,Sep 18,2020 8:49 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) 我是在ubuntu上运行的 windows我看官方部署文档貌似说过不支持 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Tue,Sep 15,2020 6:12 PM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 感觉不对啊。我测试了支持windows，用cpu模型可以运行，但使用gpu模型在windows中运行失败。在workspace.runnetonce(init_model.pb)处报错 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 我试了windows上cpu模型可以跑，gpu模型不行，不知是不是我caffe2在vs中的配置问题，还是模型问题，或是本身windows不支持gpu模型运行 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 好的，谢谢。暂时我还不知道怎么解决这个问题 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 大佬我检查了。python下的pytorch以及caffe2是可以调用gpu的。哎，就是c++没有gpu的例子试一下 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

好像我都设置了。gpu模型的devicetype是1了，说明是gpu的模型

[yang-gis]

Gpu应该要配置cuda动态库还有probuf哪些 具体没在windows下弄过 发自我的iPhone
…
------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Fri,Sep 18,2020 8:49 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) 我是在ubuntu上运行的 windows我看官方部署文档貌似说过不支持 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Tue,Sep 15,2020 6:12 PM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe It doesn't support windows 发自我的iPhone … ------------------ Original ------------------ From: yang jinyi <[email protected]> Date: Mon,Sep 14,2020 9:37 AM To: facebookresearch/detectron2 <[email protected]> Cc: zhoujinhai <[email protected]>, Mention <[email protected]> Subject: Re: [facebookresearch/detectron2] Caffe2 export of quantized model (#1496) Hi, @zhoujinhai If you are ok with TorchScript version of your model, so please refer to reply above. The example of monkey patching I've mentioned is available in this repo If you are interested in Caffe2 version of your quantized model then I'm afraid that if this issue still persists means that such functionality haven't been added yet. hello,have you tried to test a trained model(.pb file ) on linux or windows10? I have tested on these platform, and finding that gpu model can not be ran successfully on caffe2 (c++) on windows10. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 感觉不对啊。我测试了支持windows，用cpu模型可以运行，但使用gpu模型在windows中运行失败。在workspace.runnetonce(init_model.pb)处报错 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe. 我试了windows上cpu模型可以跑，gpu模型不行，不知是不是我caffe2在vs中的配置问题，还是模型问题，或是本身windows不支持gpu模型运行 — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

大佬你有时间研究一下。我的能力不太够。毕竟windows下部署caffe2 c++还是很重要的。