Pytorch-cyclegan-and-pix2pix: Instance norm during evaluation

Created on 2 Oct 2018  路  4Comments  路  Source: junyanz/pytorch-CycleGAN-and-pix2pix

Hello,

I notice that during training, when sampling the images the model is not in eval mode https://pytorch.org/docs/stable/nn.html#torch.nn.Module.eval. Then, as track_running_stats is True in InstanceNorm, the model should behave differently when it is training or evaluating. I might have missed something.

Most helpful comment

I updated the flag.

All 4 comments

I'm also curious about this. When I visit this repository a year ago, there was no track_running_stats in PyTorch. Does track_running_stats affect the performance?

This is a good point. This is a new flag that we haven't tested. Maybe we should set the default value as Fasle so that we can match the original code. @SsnL @taesung89

I agree. Let's set it to false. @HectorAnadon thanks for pointing this out! We really appreciate it.

I updated the flag.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

John1231983 picture John1231983  路  3Comments

lyhangustc picture lyhangustc  路  5Comments

TheIllusion picture TheIllusion  路  5Comments

JamesChenChina picture JamesChenChina  路  3Comments

MaureenZOU picture MaureenZOU  路  4Comments