Vision: Support for torchvision.ops.nms on pytorch mobile

[hal-314]

❓ Questions and Help

You can't deploy object detection models like yolo, FastRCNN, etc without nms op. There are several issues in the forum. https://discuss.pytorch.org/t/support-torchvision-ops-nms-on-mobile-cpu/69627 or in this repo https://github.com/pytorch/vision/issues/2050 .

So, there is any eta for this? I want to use YoloV5 to detect objects with a smartphone. I have read the code and it seems to have a fairly straight forward implementation. So, I don't know why Pytorch Mobile can't find this operator.

[fmassa]

Assigning this to @dreiss for comments

[chenbohua3]

Same issue in pytorch1.6.0 / torchvision 0.7.0. Since nms is a widely used op in detection, this may be an urgent problem:)

[fmassa]

FYI we are actively working on getting this working on mobile for the next major release.

[HasnainRaz]

@fmassa Any updates regarding this? Scripting a model that uses torchvision nms using pytorch 1.7.1 and torchvision 0.8.2 and running on iOS with Libtorch 1.7.1 still produces the same error.

Is there any update or relevant PR/ticket we can look at to keep track of the progress?

[zhiqwang]

I think that #2897 is aimed to resolve this problem.

[HasnainRaz]

2897 appears to track the torchvision ops for android. Is there one that tracks something similar for iOS as well?

[zhiqwang]

Oops... I don't know either.

[fmassa]

@HasnainRaz we will also be looking into iOS for next release. We currently don't have an open PR for it yet though.