Pytorch-lightning: When auto_sceale_batch_size and auto_lr_find are both enabled, lr find is called with every batch search

Created on 21 Aug 2020  路  5Comments  路  Source: PyTorchLightning/pytorch-lightning

is this a bug or feature? I think lr find should be called after batch size search is done.

bug / fix documentation help wanted
Source
picture LeeJZh

All 5 comments

Hi! thanks for your contribution!, great first issue!

github-actions[bot] picture github-actions[bot] on 21 Aug 2020

@SkafteNicki mind have look? 馃惏

Borda picture Borda on 25 Aug 2020

@Borda this is definitely a bug, it should be added to the list of attributes that are stored and altered before the search and then restored after the search:
https://github.com/PyTorchLightning/pytorch-lightning/blob/ccc923cbb01af7776f2472056b264758a6745871/pytorch_lightning/trainer/training_tricks.py#L213-L249
I will send a bugfix.

SkafteNicki picture SkafteNicki on 25 Aug 2020
👍1

or @LeeJZh are interested in sending fix? 馃

Borda picture Borda on 25 Aug 2020

or @LeeJZh are interested in sending fix? 馃

a pull request has been made.

LeeJZh picture LeeJZh on 25 Aug 2020
🎉1
Was this page helpful?
0 / 5 - 0 ratings

Related issues

edenlightning picture edenlightning  路  3Comments
baeseongsu picture baeseongsu  路  3Comments
anthonytec2 picture anthonytec2  路  3Comments
monney picture monney  路  3Comments
iakremnev picture iakremnev  路  3Comments