Huginn: Increase failed job retry attempts

Created on 22 May 2018  路  4Comments  路  Source: huginn/huginn

I have a lot of agents running mostly Twitter and RSS feeds. Occasionally they will fail and retry up to 5 times but after the 5th retry it will just sit in the queue. In the past these agents would eventually process through. Is there a setting somewhere to increase this to say... 10?

I am running a local installation on Ubuntu using threaded workers and the faraday fix

builder.options.timeout = (Delayed::Worker.max_run_time.seconds - 30).to_i

I have increased the database pool from 20 to 30 just now to see if that would help but I have not been able to test it fully yet.


Edit: Checked this morning and the issue persists after increasing the pool size.

Most helpful comment

Maybe we could change it to (ENV['DELAYED_JOB_MAX_ATTEMPTS'].presence || 5).to_i and let users set a desired value to the environment variable.

All 4 comments

Here is the error I am still seeing:

https://pastebin.com/zsK0Z3XL

We don't have a way to configure the amount of retries at the moment. You can modify it manually here: https://github.com/huginn/huginn/blob/77842eae64d2cb7404027979a07730000146ea6b/config/initializers/delayed_job.rb#L2

That's exactly what I was looking for. Thank you.

Maybe we could change it to (ENV['DELAYED_JOB_MAX_ATTEMPTS'].presence || 5).to_i and let users set a desired value to the environment variable.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

0xdevalias picture 0xdevalias  路  9Comments

IAMEVANHE picture IAMEVANHE  路  3Comments

TOrfevres picture TOrfevres  路  3Comments

scumola picture scumola  路  4Comments

AnimusAstralis picture AnimusAstralis  路  4Comments