Runtime: Fill in test gaps for Event Pipe

Created on 11 Jun 2019  路  9Comments  路  Source: dotnet/runtime

We need to add new tests to cover .net core 3.0 event pipe test scenarios. These new tests will supercede the following:

EventPipe area-Tracing-coreclr

Most helpful comment

What do you guys think about promoting this list of test cases into a markdown doc that we put in the tree? Often when researching tests available in some area I'd run into two questions:
a) Is scenario X tested?
b) If it is, which of the 100 tests in this area covers it?
Typically this is looking back months/years after the tests were originally written so any issues (such as this one) aren't easily discoverable at that point.

All 9 comments

Do we have a list of scenarios we want to prioritize? I have a template for writing the tests that we can use to _hopefully_ iterate quickly through them.

Let's use this issue to track the sceanrios we wish to fill
@cshung @sywhang

I believe we should add tests covering the following "knobs":

  • [ ] Messages sent vs received under:

    • varying buffer sizes

    • varying providers

  • [ ] Provider turned on vs sane traces (e.g., if I trace GC, I should see equal numbers of start and end events)

    • varying buffer sizes

  • [ ] EventPipe Connection _and_ EventListener connection being coherent

@josalem Should we add to the mix:

  • [ ] Verify providers/events enabled are written
  • [ ] Verify CPU stacks are written when enabled
  • [ ] Handle erroneous user input

Agreed. I think we should have a small base set of tests we can add to PR validation, and a larger, more complex set we can add to pri-1 testing. These tests give us a chance to implicitly "soft" document some guarantees about the EventPipe system that shouldn't be broken by incoming changes.

What do you guys think about promoting this list of test cases into a markdown doc that we put in the tree? Often when researching tests available in some area I'd run into two questions:
a) Is scenario X tested?
b) If it is, which of the 100 tests in this area covers it?
Typically this is looking back months/years after the tests were originally written so any issues (such as this one) aren't easily discoverable at that point.

Sounds good to me.

@josalem close?

I think we've got decent coverage for EventPipe in the runtime repo now. There is also some md in the diagnostics repo documenting what is covered. I'm going to close this.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

v0l picture v0l  路  3Comments

btecu picture btecu  路  3Comments

bencz picture bencz  路  3Comments

matty-hall picture matty-hall  路  3Comments

chunseoklee picture chunseoklee  路  3Comments