Vscode-java-test: Show each execution result if a test method runs several times

Created on 6 Mar 2020  路  4Comments  路  Source: microsoft/vscode-java-test

There are several kinds of tests which will run several times during the execution, for example:

  • Parameterized tests
  • Repeated tests

Current Behavior

The test report will only show one failure case.

Expected Behavior

The test report should show every execution result

bug

Most helpful comment

I am having the same Issue for @TestTemplate tests.

Suppose you have this test:

@ExtendWith(MyExtension.class)
class IntegrityTest {

    @TestTemplate
    void correctFileNaming(final TestCaseFile testCase) {
              //some assertions
    }

}

with an Extension providing a 100+ TestCaseFile instances. Then I get this result view in Eclipse JUnit Runner:
image
Where [1] .. [x] is the DisplayName provided by the TestTemplateInvocationContext.

In VSCode I just get a single failed result:

image

All 4 comments

Also, for success case, it should show each test (i.e. its parameters etc) separately that was run as part of the Parameterized tests. Right now even if there are 1000 tests in a parameterized test, it shows that it ran only one.

Eclipse does this correctly.

If we started showing each iteration of parameterized test as a separate test in the report, then the failure case will also be better handled i.e. we'd show error for each case separately.

Any progress on this bug?

I am having the same Issue for @TestTemplate tests.

Suppose you have this test:

@ExtendWith(MyExtension.class)
class IntegrityTest {

    @TestTemplate
    void correctFileNaming(final TestCaseFile testCase) {
              //some assertions
    }

}

with an Extension providing a 100+ TestCaseFile instances. Then I get this result view in Eclipse JUnit Runner:
image
Where [1] .. [x] is the DisplayName provided by the TestTemplateInvocationContext.

In VSCode I just get a single failed result:

image

Was this page helpful?
0 / 5 - 0 ratings

Related issues

deduper picture deduper  路  9Comments

NikolasKomonen picture NikolasKomonen  路  3Comments

andifalk picture andifalk  路  9Comments

thegabriele97 picture thegabriele97  路  8Comments

fbricon picture fbricon  路  5Comments