Pytorch-lightning: How to scheduler.step() after every batch

[benihime91]

I want to make use of schedulers like torch.optim.lr_scheduler.CyclicLR & torch.optim.lr_scheduler.OneCycleLR
https://pytorch.org/docs/stable/optim.html
These schedulers require scheduler.step() to be callled after each batch.
How to achieve this is PyTorchLightning?

[github-actions[bot]]

Hi! thanks for your contribution!, great first issue!

[rohitgr7]

https://pytorch-lightning.readthedocs.io/en/latest/lightning-module.html#configure-optimizers

just set the interval:

scheduler = {
    'scheduler': scheduler,
    'interval': 'step', # or 'epoch'
    'frequency: 1
}

[benihime91]

@rohitgr7 Thanks