I have a lot of agents running mostly Twitter and RSS feeds. Occasionally they will fail and retry up to 5 times but after the 5th retry it will just sit in the queue. In the past these agents would eventually process through. Is there a setting somewhere to increase this to say... 10?
I am running a local installation on Ubuntu using threaded workers and the faraday fix
builder.options.timeout = (Delayed::Worker.max_run_time.seconds - 30).to_i
I have increased the database pool from 20 to 30 just now to see if that would help but I have not been able to test it fully yet.
Edit: Checked this morning and the issue persists after increasing the pool size.
Here is the error I am still seeing:
We don't have a way to configure the amount of retries at the moment. You can modify it manually here: https://github.com/huginn/huginn/blob/77842eae64d2cb7404027979a07730000146ea6b/config/initializers/delayed_job.rb#L2
That's exactly what I was looking for. Thank you.
Maybe we could change it to (ENV['DELAYED_JOB_MAX_ATTEMPTS'].presence || 5).to_i and let users set a desired value to the environment variable.
Most helpful comment
Maybe we could change it to
(ENV['DELAYED_JOB_MAX_ATTEMPTS'].presence || 5).to_iand let users set a desired value to the environment variable.