@gaopeng-eugene: multi-device synchronous BN is not supported at the moment. It will likely be supported in the future after the Caffe2 multi-device BN implementation is finished. For now, all models use fixed AffineChannel ops to replace the BN op from the original pretraining network.
Is that supported now?
Most helpful comment
@gaopeng-eugene: multi-device synchronous BN is not supported at the moment. It will likely be supported in the future after the Caffe2 multi-device BN implementation is finished. For now, all models use fixed
AffineChannelops to replace the BN op from the original pretraining network.