Pytorch-lightning: When auto_sceale_batch_size and auto_lr_find are both enabled, lr find is called with every batch search

Created on 21 Aug 2020  ·  5Comments  ·  Source: PyTorchLightning/pytorch-lightning

is this a bug or feature? I think lr find should be called after batch size search is done.

bug / fix documentation help wanted

All 5 comments

Hi! thanks for your contribution!, great first issue!

@SkafteNicki mind have look? 🐰

@Borda this is definitely a bug, it should be added to the list of attributes that are stored and altered before the search and then restored after the search:
https://github.com/PyTorchLightning/pytorch-lightning/blob/ccc923cbb01af7776f2472056b264758a6745871/pytorch_lightning/trainer/training_tricks.py#L213-L249
I will send a bugfix.

or @LeeJZh are interested in sending fix? 🦝

or @LeeJZh are interested in sending fix? 🦝

a pull request has been made.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

jcreinhold picture jcreinhold  ·  3Comments

DavidRuhe picture DavidRuhe  ·  3Comments

edenlightning picture edenlightning  ·  3Comments

maxime-louis picture maxime-louis  ·  3Comments

as754770178 picture as754770178  ·  3Comments