CI/CD capability and Searching tests capability comparision between Zephyr and Xray

[Dipak Patadia]

Comparison between Zephyr and Xray with regards to DevOps capabilities.

I need to know if Zephyr has this capability of having better CI/CD capability and Searching. Need your suggestions to decide if we go for Xray Or Zephyr.

• Both do almost similar kind of work with some advantages and disadvantages of them with respect to cost, automation, reporting, etc. 

• With regards to Automation Testing: As enterprises become bigger with tons of features, automated testing becomes essential. If you need to execute a hundred even thousands test for your weekly releases, an automation script integration could help a lot, and Xray has a native cucumber automation build in. Which means testing can take hours instead of days (nor weeks) with no need for another add-on. Xray also has Pre-conditions worth noting since it allows for specific criteria to be added into testing(e.g: a user has to be the member that has X tier).

Zephyr does not do automated testing as an add-in like Xray and you might need a way around such as “ZBot” for Zephyr (this is an additional add-on which you must purchase.) and this might be challenging for a new member who is not used to the tools. 

• Looking at feature level comparison, it looks Xray has upper hand considering automation and CI/CD capability and Searching tests capability.

What are your opinion?

Regards,

Dipak

[Sergio Freire - Xblend]

Hi @Dipak Patadia ,

just to clarify that Xray supports many more automation frameworks besides Cucumber, including Robot frameworks, JUnit, xUnit, TestNG, NUnit, etc.

You can find dozens of automation tutorials covering these frameworks and additional automation tools (e.g. Postman, NeoLoad, JMeter, etc) in the documentation.

So, no matter the automation framework/tool you chose, you can easily integrate with Xray from the pipeline. Talking about CI/CD, you can use Jenkins, TeamCity, Bamboo using native and free plugins for it. You can also use Gitlab, AzureDevOps and other! Your team decides :)

Regards

Sérgio