Caffe: Using AdaDelta and Adam causes resuming training to fail with incorrect length of history blobs error

Created on 17 May 2016  路  2Comments  路  Source: BVLC/caffe

I tried to resume my pretrained model and found out whenever I try to use a solver which uses AdaDelta or Adam, it crashes caffe. other types of learning rate types such as SGD,RMSProp, etc are fine.
Here is a sample error I get when trying AdaDelta and/or Adam:

I0517 09:05:26.691237  5888 solver.cpp:60] Solver scaffolding done.
I0517 09:05:26.694239  5888 caffe.cpp:210] Resuming from examples/mnist/lenet_iter_64000.solverstate
F0517 09:05:26.901387  5888 sgd_solver.cpp:316] Check failed: state.history_size() == history_.size() (57 vs. 114) Incorrect length of history blobs.
*** Check failure stack trace: ***
bug

Most helpful comment

I am facing the same problem. Did you find a solution to it?

All 2 comments

I am facing the same problem. Did you find a solution to it?

try second last checkpoint. it worked for me.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

kelvinxu picture kelvinxu  路  3Comments

dfotland picture dfotland  路  3Comments

inferrna picture inferrna  路  3Comments

serimp picture serimp  路  3Comments

Ruhjkg picture Ruhjkg  路  3Comments