Coverlet: IDE Integration

[ppumkin]

I watched your video on DOT NET CONF 18 - It was great, thank you for this because this tool is very usefull during CI/CD

I was wondering is there anyway to use the outputs to show in Visual Studio, at the minimum of the lines that are covered, with something in the margin.

That would increase productivity as usually branches are missed and finding which ones is a bit difficult.

Thanks for taking the time to make this tool. I think it will become an invaluable tool for testers.. and hopefully developers (who do not really want to use ReSharper.. yes.. we exist 😄 )

--EDIT

Please check this post https://github.com/tonerdo/coverlet/issues/199#issuecomment-426209032 last as they have downloads to an extension I made for loading and showing coverage.

[tonerdo]

Hey @ppumkin, I'm glad you enjoyed my talk. There's currently no IDE integration between Coverlet and Visual Studio. While I definitely think it'll be a great addition, it's currently not on my priority list. I'm more than happy to accept a PR for it though 😄

[ppumkin]

OK Well I have learnt a bit more about Extension development and that Roslyn Code Analysis packages are our best friends 😄

I have managed to get a a proof of concept working

• loads the coverage.json from hard drive (currently hard-coded)
  -- futures: to have the extension check the default location on the currently loaded project or allow you to specify location later on
• places GreenYellow marks in the marging for the LINES of code reported to be covered
  -- futures: have options to specify colour and location of markers

I think the Extension will have to be a seperate project since it cannot be shipped as a NuGet package with coverlet or as a dotnet global tool

One other idea mentioned in a previous thread was to have Coverlet work inside the Extension, as an IDE only tool. Probably leveraging the dotnet global tool functionality

[ppumkin]

I have published a market place extension under the name PrestoCoverage - Please have a try

https://marketplace.visualstudio.com/items?itemName=PiotrKula.prestocoverage

--

[ppumkin]

@tonerdo Would it be OK if I could request a shameless link to my extension on your readme? I have made the extension to work exclusively with Coverlet, and I don't want to move away from it.

https://marketplace.visualstudio.com/items?itemName=PiotrKula.prestocoverage

I think it is quite usable now.with some manual running of coverlet but I have provided sample PowerShell Scripts and easy place to drop all results during development.

The next feature I want to get working is merging multiple json result files inside my extension. This is a little bit easier for me since I just read all the files and if I find the same class/method/lines I can merge the line counts. This should then enable Unit Testing and Integration testing coexistence.

A real nice feature is I am thinking hard on how to get Live coverage working using the dotnet tool command. But I need to make sure it runs smoothly and also if there is another way to stream data from coverlet

[tonerdo]

@ppumkin this is good work and thank you! Have you considered a possibility of using Visual Studio to run coverage instead of just reading in the coverage result?

[ppumkin]

@tonerdo Yes I am thinking about it.

I am not an extensions developer so I am just trying to learn how to do it.

These are ideas I have.. some help would be appreciated from an experienced extensions developer- I can do the work.

I could just run PowerShell commands.. I think I will do that as a way to push the feature out but I don't know if that is the "way" of doing this stuff.. right? Currently I am exploring the Automation.DLL that exposes PowerShell API (but when I run PS I get a window flash up and down)

Do you know if there is a .NET CLI maybe? Then I could maybe run coverlet from the global tool

But there may also be a request from you then to be able to output selected format to STD OUT (JSON by default) to avoid writing to disk I/O and then we can just work with streams.
Maybe this could include information about coverage, since currently you only display that in the CLI and nowhere in the JSON. Should I create a ticket for this feature on your side?

Or maybe I am missing the obvious thing and include Coverlet as a NuGet and run it in the extension? And then run Tests and Coverage nativly?

Donno.. They are all ideas and since I have no experience with VSIX I would need to explore all these options unless somebody can point out the best way of doing this.

Thanks again!

[ppumkin]

@tonerdo Have you thought of creating a package for Coverlet.Core only?

That way it could be included and used from Visual Studio directly, like I am trying to do here with a VSIX - But maybe other people have other ideas too.

[ppumkin]

I have resolved this issue. Thanks

https://marketplace.visualstudio.com/items?itemName=PiotrKula.prestocoverage