Come for the products,
stay for the community

The Atlassian Community can help you and your team get more value out of Atlassian products and practices.

Atlassian Community about banner
Community Members
Community Events
Community Groups

CI/CD capability and Searching tests capability comparision between Zephyr and Xray

Comparison between Zephyr and Xray with regards to DevOps capabilities.

I need to know if Zephyr has this capability of having better CI/CD capability and Searching. Need your suggestions to decide if we go for Xray Or Zephyr.

  • Both do almost similar kind of work with some advantages and disadvantages of them with respect to cost, automation, reporting, etc. 
  • With regards to Automation Testing: As enterprises become bigger with tons of features, automated testing becomes essential. If you need to execute a hundred even thousands test for your weekly releases, an automation script integration could help a lot, and Xray has a native cucumber automation build in. Which means testing can take hours instead of days (nor weeks) with no need for another add-on. Xray also has Pre-conditions worth noting since it allows for specific criteria to be added into testing(e.g: a user has to be the member that has X tier).


Zephyr does not do automated testing as an add-in like Xray and you might need a way around such as “ZBot” for Zephyr (this is an additional add-on which you must purchase.) and this might be challenging for a new member who is not used to the tools. 

  • Looking at feature level comparison, it looks Xray has upper hand considering automation and CI/CD capability and Searching tests capability.


What are your opinion?




1 answer

Hi @Dipak Patadia ,

just to clarify that Xray supports many more automation frameworks besides Cucumber, including Robot frameworks, JUnit, xUnit, TestNG, NUnit, etc.

You can find dozens of automation tutorials covering these frameworks and additional automation tools (e.g. Postman, NeoLoad, JMeter, etc) in the documentation.

So, no matter the automation framework/tool you chose, you can easily integrate with Xray from the pipeline. Talking about CI/CD, you can use Jenkins, TeamCity, Bamboo using native and free plugins for it. You can also use Gitlab, AzureDevOps and other! Your team decides :)




Suggest an answer

Log in or Sign up to answer
Community showcase
Published in Bamboo

Bamboo Data Center on Kubernetes

Hi, If you are running self-managed environments and looking to adopt modern infrastructure, Bamboo Data Center can now be deployed in a Kubernetes cluster. By leveraging Kubernetes, you can easily...

942 views 3 8
Read article

Community Events

Connect with like-minded Atlassian users at free events near you!

Find an event

Connect with like-minded Atlassian users at free events near you!

Unfortunately there are no Community Events near you at the moment.

Host an event

You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events

Events near you