You're on your way to the next level! Join the Kudos program to earn points and save your progress.
Level 1: Seed
25 / 150 points
1 badge earned
Challenges come and go, but your rewards stay with you. Do more to earn more!
What goes around comes around! Share the love by gifting kudos to your peers.
Keep earning points to reach the top of the leaderboard. It resets every quarter so you always have a chance!
Join now to unlock these features and more
How can I use the same generic test set across numerous projects and stories where they do not update the story to reflect the previous runs that are not affiliated with that epic or user story?
Long winded example:
I have a need where I have a test set, let's say it's generic title is "Car_Sedan_Radio_2022" and it covers all regression testing of a sedan radio from previous years. However, this generic set will be used across all various sedan's (ie. Audi, Lexus, Toyota, etc) and reused in new stories throughout months/years of regression testing down the road like software updates. A story can be about sedan radios for a given month and I'd have scripts that need to test across all the various makes/models for that month. I do not pass that story unless radios across all sedan types passed.
What is the best practice on linking test sets from a test plan to the particular scenario so that I can utilize that single test set in a single story?
What I am seeing is that the set carries over the last runs into a newly created user story when tests are attached to them. And the only way I'm thinking this can be addressed is if I have a single instance for each test set for a particular sedan manufacturer, no matter if the tests were the exact same or not, and have them named at the month level matching that story. I could have 20+ sets that are the exact same and the only way to differentiate them from one another is the name. This would build over time, 20 different sets x 12mths which seems overkill to me but I'm hoping I've missed something.
Thanks for your help and clarification!
I would suggest using Test Environments, where the environments can be the different brands of cars (i.e., Audi, Lexus, Toyota, etc.).
When using the Test Environments, as Story is only PASS if it has passed in all environments, in your use case, the car brands.
You may also use Test Plan if you want to analyze results based on a specific scope since, for the Test Plan Overall Status, only the liked Test Execution status are taken into account.
Please contact Xray Support (http://Xraysupport.getXray.app) if you need further help.
Rogerio Paiva [Xray Support Team]