Showing results for 
Search instead for 
Did you mean: 
Sign up Log in

Earn badges and make progress

You're on your way to the next level! Join the Kudos program to earn points and save your progress.

Deleted user Avatar
Deleted user

Level 1: Seed

25 / 150 points

Next: Root


1 badge earned


Participate in fun challenges

Challenges come and go, but your rewards stay with you. Do more to earn more!


Gift kudos to your peers

What goes around comes around! Share the love by gifting kudos to your peers.


Rise up in the ranks

Keep earning points to reach the top of the leaderboard. It resets every quarter so you always have a chance!


Come for the products,
stay for the community

The Atlassian Community can help you and your team get more value out of Atlassian products and practices.

Atlassian Community about banner
Community Members
Community Events
Community Groups

CI/CD capability and Searching tests capability comparision between Zephyr and Xray

Comparison between Zephyr and Xray with regards to DevOps capabilities.

I need to know if Zephyr has this capability of having better CI/CD capability and Searching. Need your suggestions to decide if we go for Xray Or Zephyr.

  • Both do almost similar kind of work with some advantages and disadvantages of them with respect to cost, automation, reporting, etc. 
  • With regards to Automation Testing: As enterprises become bigger with tons of features, automated testing becomes essential. If you need to execute a hundred even thousands test for your weekly releases, an automation script integration could help a lot, and Xray has a native cucumber automation build in. Which means testing can take hours instead of days (nor weeks) with no need for another add-on. Xray also has Pre-conditions worth noting since it allows for specific criteria to be added into testing(e.g: a user has to be the member that has X tier).


Zephyr does not do automated testing as an add-in like Xray and you might need a way around such as “ZBot” for Zephyr (this is an additional add-on which you must purchase.) and this might be challenging for a new member who is not used to the tools. 

  • Looking at feature level comparison, it looks Xray has upper hand considering automation and CI/CD capability and Searching tests capability.


What are your opinion?




1 answer

Hi @Dipak Patadia ,

just to clarify that Xray supports many more automation frameworks besides Cucumber, including Robot frameworks, JUnit, xUnit, TestNG, NUnit, etc.

You can find dozens of automation tutorials covering these frameworks and additional automation tools (e.g. Postman, NeoLoad, JMeter, etc) in the documentation.

So, no matter the automation framework/tool you chose, you can easily integrate with Xray from the pipeline. Talking about CI/CD, you can use Jenkins, TeamCity, Bamboo using native and free plugins for it. You can also use Gitlab, AzureDevOps and other! Your team decides :)




Suggest an answer

Log in or Sign up to answer

Atlassian Community Events