Karate: JUnit output does not show steps and report info missing

[ayoolaogunsola]

(Continuation of issue https://github.com/intuit/karate/issues/542)

We upgraded from v0.8.0.1 to v0.9.0.RC4 and noticed the following issues in Eclipse:

1. Feature, scenario and steps are not displayed properly
2. Stack trace information is limited in 'failure trace' section
3. Test run summary is missing in the console output

Please refer to attached screenshots and project zip karatetrial1.zip

[ptrthomas]

yes this is intentional and not related to the "unrooted" tests problem
we no longer will show steps on the JUnit IDE side
all info you need will be in the html report

feel free to disagree / discuss

[ayoolaogunsola]

@ptrthomas This is functionality that is very useful for debugging scripts while in the IDE. We usually don't view the reports as much while we are editing scripts. Also, this makes the JUnit view of no use with Karate.

Is number 3 also on purpose? Again information that is very useful while in the IDE.

[ptrthomas]

disagree that this is of "no use"

• you see the number of scenarios
• you see what failed

there's a bunch of folks who complained that the JUnit count was misleading because each step was counted as a test

IMO if you are debugging you should use the HTML report.
you are free to contribute any functionality you need

[ayoolaogunsola]

@ptrthomas Alright. We will spend some more time with this and see how it goes.

[ptrthomas]

@ayoolaogunsola yes, thanks for understanding. just to make sure - this is the JUnit HTML I am referring to

the developer experience is designed to be as follows, you paste the last line from the console into your browser. now you just keep refreshing the same page each time you run.

we can improve this slowly in future, but I hope you understand this was one of the things we had to re-do when we got away from cucumber. there's a lot of other goodies like parallel scenarios.

cheers

[ptrthomas]

@ayoolaogunsola I've tried to make some improvements in the 0.9.0.RC5 available now, it prints a summary at the end which you were missing, and now the line-number of any failure is clearly present

hope this helps

[xltb]

I also disagree with this change but out of a slightly different reason so ill put it here.

As i have created an entire application that bundles karate against my AuT and launches it with an embedded tomcat, it was really useful to see the server logs & Tomcat logs of the AuT when a Scenario failed.That functionality is now lost, I don't really mind not seeing the specific steps but before when clicking on a scenario the logs were filtered and i could see the full debug info, and also the AuT logs. This information also isn't currently enabled in the html report.

Ill have a fork and a play around but thought i would comment on this one anyway.

[ptrthomas]

@xltb this issue here is related to how the JUnit results show up in the IDE not the HTML reports. you seem to be talking about a whole different set of issues which I'm not aware of. please do create a fork, PR, screen-shots whatever is needed. will definitely look into it if indeed fixable.