Openfoodnetwork: RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
Error in OpenFoodNetwork
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
Products JSON differs from cached version for distributor: 178, order cycle: 199
Stacktrace
app/jobs/products_cache_integrity_checker_job.rb:6 - perform
script/delayed_job:5 - <main>
mkllnk
All 124 comments
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 13 May 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 20 May 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 21 May 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 25 May 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 27 May 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 27 May 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 27 May 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 1 Jun 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 8 Jun 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 8 Jun 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 15 Jun 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 22 Jun 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 6 Jul 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 13 Jul 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 13 Jul 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 13 Jul 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 29 Jul 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 29 Jul 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 2 Aug 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 9 Aug 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 26 Aug 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 26 Aug 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 26 Aug 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 31 Aug 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 31 Aug 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 7 Sep 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 9 Sep 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 16 Sep 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 18 Sep 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 28 Sep 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 5 Oct 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 12 Oct 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 12 Oct 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 19 Oct 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 21 Oct 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 18 Nov 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 25 Nov 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 25 Nov 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 25 Nov 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 25 Nov 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 30 Nov 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 7 Dec 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 9 Dec 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 21 Dec 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 21 Dec 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 21 Dec 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 23 Dec 2016
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 11 Jan 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 11 Jan 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 16 Jan 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 18 Jan 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 20 Jan 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 1 Feb 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 1 Feb 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 8 Feb 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 8 Feb 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 10 Feb 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 10 Feb 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 22 Feb 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 24 Feb 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 15 Mar 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 15 Mar 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 15 Mar 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 17 Mar 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 17 Mar 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 29 Mar 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 31 Mar 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 5 Apr 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 5 Apr 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 19 Apr 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 19 Apr 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 21 Apr 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 27 Apr 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 27 Apr 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 10 May 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 12 May 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 12 May 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 12 May 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 24 May 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 24 May 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 24 May 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 24 May 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 6 Jun 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 14 Jun 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 22 Jun 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 28 Jun 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 28 Jun 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 28 Jun 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 19 Jul 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 21 Jul 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 21 Jul 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 25 Jul 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 26 Jul 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 26 Jul 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 26 Jul 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 28 Jul 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 28 Jul 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 2 Aug 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 16 Aug 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 16 Aug 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 18 Aug 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 18 Aug 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 13 Sep 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 28 Sep 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 6 Oct 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 13 Oct 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 14 Oct 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 16 Oct 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 18 Oct 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 18 Oct 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 15 Nov 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 25 Nov 2017
An error linked to this issue has been reopened in Bugsnag
RuntimeError in app/jobs/products_cache_integrity_checker_job.rb:6
mkllnk
on 27 Dec 2017
Just for reference: we have 488 recorded instances of this product cache error on UK production in the last 30 days, and that's normal... :warning:
Matt-Yorkley
on 20 Dec 2018
We need to assess its severity and fix it as any other bug. Do you guys have any insight?
sauloperez
on 20 Dec 2018
From what I know:
- The products cache is created if it doesn't exist.
- There are several points in the code that invalidate the cache, e.g. creating a product in the admin panel.
This report means that there are actions changing products that don't trigger the cache invalidation or there is a gap in the logic that the cache is reported as invalid even though it is valid. I would guess it's the former.
mkllnk
on 21 Dec 2018
I 90% sure it's a cache invalidation bug.
sauloperez
on 21 Dec 2018
you know there are only 2 hard things in computer science?
naming things, cache invalidation and off-by-1 errors ;-)
luisramos0
on 21 Dec 2018
I think you forgot Spree upgrades :trollface:
jokes aside, I'm afraid this might have higher severity than an S4. We need to investigate what are its possible implications.
sauloperez
on 21 Dec 2018
As a first investigation I looked at the Canadian server because the data is small enough to handle. There are two cache entries out of sync. I looked at failed jobs and there are some that failed because of a missing order cycle. The enterprises of those jobs don't match the invalid cache entries. So it's not their fault.
mkllnk
on 21 Mar 2019
If I modify a closed order cycle then the cache is not updated. That is how it should work. The admin cache page shows the diff though which is confusing. It should only display cachable order cycles.
mkllnk
on 21 Mar 2019
The code to check if any errors would be reported to Bugsnag:
Exchange.cachable.map { |ex| OpenFoodNetwork::ProductsCacheIntegrityChecker.new(ex.receiver, ex.order_cycle).ok? }
=> [true, true, true]
# This means it's all good. `false` means an error.
On Aus production we have currently 30 cachable exchanges and one is buggered.
mkllnk
on 21 Mar 2019
Possibly related:
- #2111
- #3629
- #3626
mkllnk
on 21 Mar 2019
#2111 and #3629 describe the scenario that deleted variants are not removed from the order cycle. I tested that locally and found that it also breaks the cache. The cache checker thinks that the variant should be removed but it hasn't. I'm not sure if the exchange is still there or not. If it's not there then we can close #2111. Fixing #3629 could solve this cache issue as well but there may be other broken parts that cause it.
mkllnk
on 21 Mar 2019
Related issues
andrewpbrett
路
3Comments
sauloperez
路
3Comments
shen-sat
路
3Comments
myriamboure
路
3Comments
filipefurtad0
路
3Comments
Most helpful comment
I think you forgot Spree upgrades :trollface:
jokes aside, I'm afraid this might have higher severity than an S4. We need to investigate what are its possible implications.