Incubator-mxnet: How to enable GPU P2P

Created on 14 Nov 2016 · 6Comments · Source: apache/incubator-mxnet

When I train with several GPUs I get this warning:

src/kvstore/././comm.h:290: only 0 out of 12 GPU pairs are enabled direct access. It may affect the perofmrance. You can set MXNET_ENABLE_GPU_P2P=0 to turn it off

How can I enable the GPUs to have direct access?

Source

miguelgfierro

Most helpful comment

This means your GPU or motherboard doesn't support P2P

piiswrong on 14 Nov 2016

👍4 😄1

All 6 comments

Try export MXNET_ENABLE_GPU_P2P=1

shuokay on 14 Nov 2016

I tried that but is not working, I also tried to compile puting this flag in the config.mk but wasn't lucky either.

miguelgfierro on 14 Nov 2016

This means your GPU or motherboard doesn't support P2P

piiswrong on 14 Nov 2016

👍4 😄1

Thanks

miguelgfierro on 14 Nov 2016

[20:45:45] src/kvstore/././comm.h:577: only 4 out of 12 GPU pairs are enabled direct access. It may affect the performance. You can set MXNET_ENABLE_GPU_P2P=0 to turn it off

should I set MXNET_ENABLE_GPU_P2P=0 ？

kli-crise on 28 Aug 2017

I have 8 gpus and I get the message only 32 out of 56 GPU pairs are enabled direct access. It may affect the performance. You can set MXNET_ENABLE_GPU_P2P=0 to turn it off
so what do I do? @piiswrong