How can I get VSTest Runner Task to Respect TestCaseFilter TestCategory?

AW August 23, 2017

VSTest Runner tasks from Bamboo server still seem to want to use an older way of doing things with .runsettings or .testsettings files, but I'm trying to use some of the more recent command line options documented here - https://msdn.microsoft.com/en-us/library/jj155796.aspx

Specificlally, I want the ability to utlize this switch flag: 

/TestCaseFilter:"TestCategory=Bamboo"

I can run the following from the command line which seems to work, but I can't get the same results in Bamboo becuase the VSTest Runner task is running all of the tests.

Can somebody help me get my Visual Studio TestCategory filters working with Bamboo? Should I be using another task test runner instead of VSTest?

 "C:\Program Files (x86)\Microsoft Visual Studio 14.0\Common7\IDE\CommonExtensions\Microsoft\TestWindow\vstest.console.exe" Website\Web.Tests\bin\Debug\Web.Tests.dll /TestCaseFilter:"TestCategory=Bamboo" 

 

3 answers

0 votes
Stuart Clode November 24, 2017

I agree. It's a shame that the VSTest Runner Task does not have an Arguments field. In the end, i used the Command Runner Task to achieve what i wanted to do - basically using the TestCaseFilter flag.

0 votes
Tamas Nagy November 14, 2017

It seems that only basic parameters are supported in the VSTest Runner task. This is clearly not enough for large .NET projects. VSTS supports this since 2012 (https://blogs.msdn.microsoft.com/vikramagrawal/2012/07/23/running-selective-unit-tests-in-vs-2012-rc-using-testcasefilter/).

Jenkins supports test filter criteria as well (https://wiki.jenkins.io/display/JENKINS/VsTestRunner+Plugin).

Why Bamboo is not catching up with these tools?

0 votes
AW August 23, 2017

I would also be interestd in more complex filtering scenarios using conditions like this documented here - https://github.com/Microsoft/vstest-docs/blob/master/docs/filter.md

Suggest an answer

Log in or Sign up to answer
TAGS
AUG Leaders

Atlassian Community Events