How can I get VSTest Runner Task to Respect TestCaseFilter TestCategory? Edited

VSTest Runner tasks from Bamboo server still seem to want to use an older way of doing things with .runsettings or .testsettings files, but I'm trying to use some of the more recent command line options documented here - https://msdn.microsoft.com/en-us/library/jj155796.aspx

Specificlally, I want the ability to utlize this switch flag: 

/TestCaseFilter:"TestCategory=Bamboo"

I can run the following from the command line which seems to work, but I can't get the same results in Bamboo becuase the VSTest Runner task is running all of the tests.

Can somebody help me get my Visual Studio TestCategory filters working with Bamboo? Should I be using another task test runner instead of VSTest?

 "C:\Program Files (x86)\Microsoft Visual Studio 14.0\Common7\IDE\CommonExtensions\Microsoft\TestWindow\vstest.console.exe" Website\Web.Tests\bin\Debug\Web.Tests.dll /TestCaseFilter:"TestCategory=Bamboo" 

 

3 answers

I would also be interestd in more complex filtering scenarios using conditions like this documented here - https://github.com/Microsoft/vstest-docs/blob/master/docs/filter.md

It seems that only basic parameters are supported in the VSTest Runner task. This is clearly not enough for large .NET projects. VSTS supports this since 2012 (https://blogs.msdn.microsoft.com/vikramagrawal/2012/07/23/running-selective-unit-tests-in-vs-2012-rc-using-testcasefilter/).

Jenkins supports test filter criteria as well (https://wiki.jenkins.io/display/JENKINS/VsTestRunner+Plugin).

Why Bamboo is not catching up with these tools?

I agree. It's a shame that the VSTest Runner Task does not have an Arguments field. In the end, i used the Command Runner Task to achieve what i wanted to do - basically using the TestCaseFilter flag.

Suggest an answer

Log in or Sign up to answer
How to earn badges on the Atlassian Community

How to earn badges on the Atlassian Community

Badges are a great way to show off community activity, whether you’re a newbie or a Champion.

Learn more
Community showcase
Published May 18, 2017 in Bamboo

FAQ: How to Upgrade Bamboo Server

Bamboo 5.9 will no longer be supported after June 12, 2017. What does this mean? As part of our End of Life policy, Atlassian supports major versions for two years after the first major iteratio...

1,682 views 0 6
Read article

Atlassian User Groups

Connect with like-minded Atlassian users at free events near you!

Find a group

Connect with like-minded Atlassian users at free events near you!

Find my local user group

Unfortunately there are no AUG chapters near you at the moment.

Start an AUG

You're one step closer to meeting fellow Atlassian users at your local meet up. Learn more about AUGs

Groups near you