Nightwatch: enhancement request: option to re-run failing tests <n> number of times
Many GUI test frameworks support an option to re-run failing tests a specified number of times. For example, I'd like to see this command:
nightwatch -s FAILING -a regression --rerun 3
give every failing test TWO more tries to pass.
mam-p
All 22 comments
+1 for this. A huge number of users need this due to browser instability (especially IE).
I'm working on a hacky way of accomplishing this with the current version of nightwatch, I'll post my results if I have success.
lacymorrow
on 1 Oct 2014
interesting...
On Wed, Oct 1, 2014 at 2:55 AM, Lacy Morrow [email protected]
wrote:
+1 for this. A huge number of users need this due to browser instability
(especially IE).I'm working on a hacky way of accomplishing this with the current version
of nightwatch, I'll post my results if I have success.—
Reply to this email directly or view it on GitHub
https://github.com/beatfactor/nightwatch/issues/284#issuecomment-57405456
.
beatfactor
on 1 Oct 2014
+1 for this. We use nightwatch to run our end2end tests, but it is starting to become a nightmare to see so many false positives, which would go away after a rerun.
chan-dra
on 2 Oct 2014
I work with Chandra and would love to have automatic retries. If anyone has ideas on how to make it work, we could probably take a stab at it. =
maxbeatty
on 2 Oct 2014
+1 Yeah ok, this would be very useful. Could also resolve issues such as #252
rcherny
on 3 Oct 2014
+1.
didemacet
on 23 Oct 2014
@lacymorrow do you have any updates? If not, can you tell me how can I do that. I need this because I am totally agree with chan-dra's comment.
didemacet
on 23 Oct 2014
+1
yn5
on 4 Dec 2014
+1
codemonkeybot
on 1 Feb 2015
+1
andymost
on 2 Feb 2015
:+1:
ghost
on 3 Apr 2015
Here's similar example from other JS framework: http://galenframework.com/docs/reference-galen-javascript-api/#retry
ghost
on 3 Apr 2015
+1
sknopf
on 3 Apr 2015
I have a solution here (https://github.com/beatfactor/nightwatch/pull/436) if anyone wants to give it a try.
If testing in an existing project, just reference this branch in your package.json file:
"nightwatch": "git://github.com/sknopf/nightwatch.git#add_flag_for_n_retries"
To use, add --retries <n> as a command line arg.
sknopf
on 5 May 2015
As of 0.7 there is a retries CL option to rerun failed testcases: http://nightwatchjs.org/guide#command-line-options
sknopf
on 25 Jun 2015
is there going to be retry option that can be specified in nightwatch.json config file?
IndraniBiswas
on 6 May 2016
+1
jenni
on 16 Jun 2017
@IndraniBiswas thats a good idea. Any news?
quantuminformation
on 30 Nov 2017
+1
AlfredoMoretta
on 7 Mar 2018
+1
samtbabu
on 22 Mar 2019
+1 also for me!
This would save me at the moment, actually :-)
mari8i
on 6 Jun 2019
I don't know if people know this or not but you can add "--retries
I am currently struggling with this specifically because we are using the workers config in conjunction with these changes to speed up our run time. Unfortunately due to the amount of workers we (4 currently) it gets itself into a bit of a tiz and fails some of the tests. Once the run has finished though and we re-run them manually they pass. Is there a setting or config for the retries that dictates when to re-run the tests?
HereticlCrown
on 13 Jun 2019
Related issues
chaseconey
·
4Comments
bushev
·
4Comments
maxgalbu
·
3Comments
Pieras2
·
3Comments
gary5
·
4Comments
Most helpful comment
I have a solution here (https://github.com/beatfactor/nightwatch/pull/436) if anyone wants to give it a try.
If testing in an existing project, just reference this branch in your package.json file:
"nightwatch": "git://github.com/sknopf/nightwatch.git#add_flag_for_n_retries"
To use, add
--retries <n>as a command line arg.