In XRAY - When adding a test set to Test Plan, all the tests are added out of order

[Mike Garbe]

I have a set of 56 tests that have been added to a test set. I have created a Test Plan and added the Test set to it. However, the order of the tests in the Test Set is not reflected in either the Plan, and consequently, in the resulting Test Execution created from the Plan. Why is this happening and is there anything I can do about it?

Thanks

[Sergio Freire - Xblend]

Hi @Mike Garbe ,

I'm unable to replicate. Are you using the "Add => Add Tests from Test Set" shortcut on the Test Plan? Or are you using the "Add > Tests" shortcut? The former works, the latter doesn't as it doesn't guarantee order of Tests.

Regards

Sérgio

[Mike Garbe]

Hi Sergio, thanks for responding.

I am using 'Add Tests from Test Sets' within the Plan. 

Each Test was originally created from within the Test Set. They were created in order and, fortunately, they are in key order, so, I do have a work around in the Plan, fortunately. What I don't understand is why the order in the set is lost when adding the Set to the Plan. I took a couple of screenshots. The Test set order is first...showing page 1 of 5 and in the correct order. The created Test Plan is second, also 5 pages but in the order they were automatically loaded into the Plan from the Set.

Whats also strange, I believe, is that its not possible to re-order the tests in the Test Set. I believe that it is supposed to work the same as in the Plan and Execution, but it doesn't. Could this indicate that there is something wrong with the Test Set in our installation?

[Sergio Freire - Xblend]

@Mike Garbe ,

well that should work.

What I could see from the backlog is that there was an issue related to this addressed on v4.2.8; are you perhaps on an older version? 

If so, I would recommend to update it. Otherwise, the best is to reach out Xray support so they can analyse this in more detail with you.

Whats also strange, I believe, is that its not possible to re-order the tests in the Test Set. I believe that it is supposed to work the same as in the Plan and Execution, but it doesn't. Could this indicate that there is something wrong with the Test Set in our installation?

Currently this is a limitation because it's not yet implemented; but I see that as something that makes sense. So please reach out support and ask for that improvement.

Regards

Sergio

[Mike Garbe]

Hi Sergio

I've asked our JIRA support team to follow-up with Atlassian Support. If/when I get an answer, I'll post it here.

Mike