Addons: Request for example: Weight Decay Optimizers / Super Convergence

Created on 6 Jul 2019  路  4Comments  路  Source: tensorflow/addons

A valuable set of optimizers that are available in Addons.

Related info:
https://www.fast.ai/2018/07/02/adam-weight-decay/
https://github.com/tensorflow/addons/blob/master/examples/README.md

good first issue help wanted tutorials
Source
picture seanpmorgan

All 4 comments

I can take up this one if it is ok. Is it ok if we build this example based on lazy_adam example?
@seanpmorgan

SSaishruthi picture SSaishruthi on 9 Jul 2019

I can take up this one if it is ok. Is it ok if we build this example based on lazy_adam example?
@seanpmorgan

Yeah we can use that as a starting point. I would like to include some info from that Fast AI blog (credit them where appropriate)... and it would be great to show the convergence speed against standard adam optimizer

seanpmorgan picture seanpmorgan on 9 Jul 2019
👍1

Sure. I will keep you posted about the progress.

SSaishruthi picture SSaishruthi on 10 Jul 2019

@seanpmorgan Can you please assign this issue to me? I am working on it

SSaishruthi picture SSaishruthi on 1 Aug 2019
👍1
Was this page helpful?
0 / 5 - 0 ratings

Related issues

seanpmorgan picture seanpmorgan  路  4Comments
seanpmorgan picture seanpmorgan  路  3Comments
seanpmorgan picture seanpmorgan  路  3Comments
seanpmorgan picture seanpmorgan  路  3Comments
n3011 picture n3011  路  4Comments