Insightface: the inference speed of retinaface

[zyg11]

GTX 1080
mobilenet0.25
I run test.py with the image (640*640）and found that the detect time is 120ms.
But I found the forward time is near 0.3ms. It's confused me. Is there any tricks to speed up detect time.?

[Neltherion]

@zyg11 The slowness happens AFTER the forward time where we're trying to use the network's output to find the exact location of faces. the Cython parts of the code speeds up the process a bit but overall I think this part needs the most optimization.

[zyg11]

I got it. Thanks !

[SongQingChe]

I cant download this mobilenet0.25 retinaface model, could you please give a download link? thanks@

[zyg11]

You can found it in the Third-party Models which made from yangfly!

[khanhnt]

@zyg11 The slowness happens AFTER the forward time where we're trying to use the network's output to find the exact location of faces. the Cython parts of the code speeds up the process a bit but overall I think this part needs the most optimization.

No, the slowness happens exactly at the forward command, because the ndarray ops executes in asynchornous mode. if you add nd.waitall() just after forward, you will see the inference time is about 3s, not 3ms as public

[nttstar]

It is the warmup time cost. You should not include the first inference time for the performance test.

[khanhnt]

It is the warmup time cost. You should not include the first inference time for the performance test.

Hi @nttstar,
Is there any way to perform the warmup only one time to detect many images ? It seems when I call the detect function, it will warmup again.

[edumucelli]

Experiencing same effect than @khanhnt

[zhengjiawen]

It is the warmup time cost. You should not include the first inference time for the performance test.

Hi @nttstar,
Is there any way to perform the warmup only one time to detect many images ? It seems when I call the detect function, it will warmup again.

Hi @khanhnt , I encountered the same problem, have you soloved the problem?

[cannguyen275]

@zyg11 I faced the same issue. Did you solve it?

[mremise]

Same issue for me on GPU and CPU