Support for MSBuild properties

[ariellourenco]

When using Microsoft Testing Platform with dotnet test, does it support passing MSBuild properties such as:

/p:MergeWith=${{ env.BUILD_ARTIFACTS }}/coverage/report.json
/p:Threshold=80
/p:ThresholdType=line
/p:ThresholdStat=total

These flags are commonly used with code coverage tools like Coverlet to enforce coverage threshold. Can these properties be passed and honored by MTP n the same way they are with the VSTest workflow?

[Youssef1313]

Passing MSBuild properties to dotnet test is supported. It works when using VSTest with VSTest's dotnet test, when using MTP with VSTest's dotnet test, and when using MTP with MTP's dotnet test.

For coverlet specifically:

1. coverlet.msbuild doesn't work with MTP, and unlikely to work with MTP.
2. coverlet.collector (or generally coverlet as a platform extension), doesn't work with MTP today. This needs to be implemented fully on coverlet side. Nothing on our end to fix.
3. coverlet.console works today already with MTP.

I'd be curious to know, is coverlet.msbuild really essential for you? Any issues with switching to coverlet.console? or even coverlet.collector in future when it supports MTP?

For reference: coverlet-coverage/coverlet#1715

[Youssef1313]

@ariellourenco You can try to switch to Microsoft.Testing.Extensions.CodeCoverage instead of coverlet, or use coverlet.console. These are the two options today for getting coverage with MTP.

[ariellourenco]

Yes, I am already using Microsoft.Testing.Extensions.CodeCoverage extension to collect coverage information, however, I don't see an option to enforce a minimum amount of coverage. @Youssef1313 , do you know if that is possible?

Thank you in advance for the support!

[Youssef1313]

@fhnaseer Can you answer this please?

[fhnaseer]

No, this is not supported. Azure DevOps provides such functionality at PR level. https://learn.microsoft.com/en-us/azure/devops/pipelines/test/codecoverage-for-pullrequests?view=azure-devops

[ariellourenco]

That is good to know guys. Thank you both for the assistance.