Create
cancel
Showing results for 
Search instead for 
Did you mean: 
Sign up Log in

🔌 Plug into Jira: Execute tests and improve quality right within Jira Software

CSD-4995 Plug Into Jira Banner.png

Previously on the Plug into Jira series, we’ve covered how the Release Hub in Jira Software can be the single source of truth for software teams when deploying releases. This week, we're moving onto another part of the SDLC and sharing how software teams can deliver quality code by integrating testing solutions such as Xray and Zephyr to execute tests right within Jira Software.


Why testing and QA are essential to agile software development

Testing in an agile software development environment is an essential part of delivering a good experience for the end user while maintaining velocity. By integrating QA tracking, testing, and analysis into each phase of the agile software development process, teams can move faster, identify blockers with more accuracy, and release updates more effectively.

Test management tools enable all team members to participate in quality-related tasks, removing the friction that exists whenever different team roles use siloed tools. Bringing testing capabilities within Jira Software helps tightly integrate product management, development, and testing to streamline efficiency and productivity. By providing the means to track your test coverage and the ability to see test results right within Jira Software, teams can better understand and improve the quality of their deliverable.

 

meme bug feature.jpeg

Use a test management tool with Jira Software so everyone on the team can be on the same page

We asked Xray and Zephyr, two of the top test management vendors in the Atlassian Marketplace, to share with us the top benefits of using their apps with Jira Software.

  


Test Management right from Jira with Xray

Use the Xray Test Management for Jira app to create tests and track test coverage right from Jira Software. Xray provides native test management and enables teams to manage tests as Jira issues, making it easier for teams to collaborate on quality testing in one centralized location.

Creating a ‘Test’ and managing it as a Jira issue can be easily done with a click. Teams can select the type of test to run, specify the steps and expected results, and easily verify the validity of the test scenario. Manage testing from end-to-end by tracking requirements and test cycles, and link requirements and test cases directly to Jira issues so everyone on the team has visibility of the context.

Xray provides a quick overview of the status of the Epic, making it easier to make release decisions based on the test status.

upbbTqVAs2qQKlW6xLGSShWLdfhVywHMEYXKcdr5agfkKsvfht3xsBd4NKBbwlJf8dOZ-0BnZiQGwveHX6sMx1Queb4lw1Ui1yexydLm12zXxn1v1PvKcOBsUGSsjW9v_B_5njVhoi76KV974PMWfmI.png
Use Xray to create and track test coverage in Jira Software

Use a ‘Test Plan’ to
define a testing scope and manage it as an issue in Jira Software to seamlessly integrate testing into project management workflows. Teams can include Test Plans in their sprint board to manage the test scope, track testing progress, and assign tests to team members. The Test Plan board consolidates progress for all the tests and teams can track each test execution history right within the Test Plan.
xray 2.png
See consolidated test progress in the Xray Test Plan board view

Software teams often need to know if their product can be released or how their product is performing in a specific environment.
Xray’s Test Coverage Report helps answer these questions by providing a high-level overview of the testing deliverables.

Xray supports a variety of testing approaches and test automation frameworks. With the Test Coverage Report, teams can have a birds-eye view of the quality status of their deliverables, regardless of the type of testing that’s being conducted. Easily filter test results based on priority status or other criteria, and click on the chart to see the detailed test requirements for more context.

The Test Coverage information is updated in real-time and is multi-dimensional. Teams can easily analyze stories and requirements taking into account the latest test results, or just the test results obtained on a specific release or specific test environment.

xray 3.png

Xray's Test Coverage Report provides an overview of the test status


Teams often need to diagnose where an error is coming from when a test fails. Xray’s Traceability Report provides an analysis of all the issues covered by the tests and helps trace the connections between issues and the resulting impact. This is especially useful for highly regulated industries that require traceability to comply with regulations. Xray helps software teams gain better visibility, traceability, and control during their testing process. 

xray 4.png

Use Xray's Traceability Report to uncover any errors found in the tests

 



Test Management right from Jira with Zephyr

Zephyr has two top test management tools in the Atlassian marketplace: Zephyr Scale and Zephyr Squad. Both help teams get end-to-end visibility of their test management, foster tighter collaboration, and enable faster releases. Zephyr Scale is a powerful solution with test planning, reporting, and reusability for teams across multiple projects. Zephyr Squad is perfect for small agile teams getting started with test management. In this blog post, we will use Zephyr Scale and the example to showcase how software teams can use Zephyr to improve visibility and collaboration during testing.

Zephyr Scale is scalable, performant test management inside Jira. It offers cross-project hierarchical test libraries, parameters, and test data—reducing redundancy and promoting reusability. Create and manage your test cases in the Zephyr Scale test case library, with over 70 cross-project reports, 60 gadgets, and 60 Confluence macros. Organize the test cases in folders, cloning, and exporting test cases in different formats (CSV, XML). Group the test cases by component, domain, or product, so teams can easily see all the tests in one place and customize the view they want to see to increase efficiencies.

 

zephyr 1.png

Create and manage your test cases in the Zephyr Scale test case library


Zephyr Scale enables end-to-end traceability within Jira, linking test cases to user stories and allowing single test execution from the issue screen. Use the Zephyr test player to record the execution of your test. You can assign statuses and set additional properties to this execution to record as much data as needed. Add attachments or raise issues such as defects found during testing in the format of Jira issues, so your dev team can easily plan and fix the defect in Jira.

zephyr 2.png

Use the Zephyr test player to record the execution of your test


The following screenshot is one example of the multiple reports we have available in Zephyr Scale. Teams can quickly get an overview of their testing by creating reports and filtering based on various criteria such as test cases and test cycles to assess the release readiness of your product.

zephyr 3.png

Easily create test reports and filter based on various criteria in Zephyr Scale


Zephyr Scale also has a reusability feature named "call to test". This feature allows teams to reuse the current test case from another test case created in the past and easily customize new parameters. This is useful to keep your test case library consistent when you want to repeat some steps. Zephyr Scale simplifies testing at scale, driving alignment and empowering teams to deliver high-quality software.   

zephyr 4.png

Easily reuse repeatable test suites and customize parameters in Zephyr Scale


Jira Software as the consolidated single source-of-truth

Integrating test management tools like Xray and Zephyr with Jira Software can greatly improve software team's efficiency, collaboration, and overall testing process. By centralizing your test management activities, enhancing traceability, and providing powerful reporting and analytics, these integrations can help you maintain high-quality software development standards and ensure the success of your projects.

Explore the possibilities and benefits of integrating Xray and Zephyr with your Jira Software instance to streamline your test management processes and elevate your team's performance.

What are some of your experiences or pain points with test management? Let us know in the comments and happy testing!

 

 

22 comments

Sanjen Bariki
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
June 20, 2023

Thanks for Sharing this Information

Like # people like this
Arthur Coelho Pinto June 20, 2023

Thanks for sharing!

Like Annie Lu likes this
Emily _ DevSamurai
Marketplace Partner
Marketplace Partners provide apps and integrations available on the Atlassian Marketplace that extend the power of Atlassian products.
June 20, 2023

This is very helpful. Thank you!

Jarosław Solecki _Deviniti_
Marketplace Partner
Marketplace Partners provide apps and integrations available on the Atlassian Marketplace that extend the power of Atlassian products.
June 21, 2023

It is helpful. The pain of those is usually the problem with requirements traceability. In my opinion the matrix works best here. 

raj shaswat June 21, 2023

Really helpful , thanks for sharing.

Alexander Pappert
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
June 26, 2023

does XRay only "translate" the status into some other words and create a page to show them?
Then I could also built my own dashoards and filter for the status.

Noushin Kananian June 26, 2023

Thanks for sharing your invaluable knowledge and experience, it's really appreciated. 

Shraddha Misri June 26, 2023

Thanks for sharing, very informative. Thanks

Deepak_QMetry
Marketplace Partner
Marketplace Partners provide apps and integrations available on the Atlassian Marketplace that extend the power of Atlassian products.
June 26, 2023

Hi Guys, 

you have a better option than Xray and Zephyr in features, UX, and price wise.  It is QMetry Test Management for Jira - https://marketplace.atlassian.com/apps/1215144/qmetry-test-management-for-jira-qtm4j?hosting=cloud&tab=overview.  

 

Annie! This is unfair to other Marketplace App vendors like us that you are promoting these two specific apps.  We are also a platinum partner and do significant work with Atlassian.  I think you should add us as well to this article.

Like # people like this
Łukasz Modzelewski _TTPSC_
Marketplace Partner
Marketplace Partners provide apps and integrations available on the Atlassian Marketplace that extend the power of Atlassian products.
June 27, 2023

Thanks for sharing.

I prefer Xray for Jira Cloud, they have great academy available, making it easy to understand basic concepts

Mohamed Benziane
Community Leader
Community Leader
Community Leaders are connectors, ambassadors, and mentors. On the online community, they serve as thought leaders, product experts, and moderators.
July 3, 2023

Thank for this article !

Markus Fredén
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
July 4, 2023

Impressive post! 👍

Sakina
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
July 10, 2023

we have been using zephyr for more than 4 years now , it help us a lot

Rama krishna July 12, 2023

Nice Article!

Mary Agueros July 12, 2023

The information in the article and the various posts from Community members has been helpful on the topic of test tool integration with Jira. Regards Mary

@maurie.tarlac 

Karen Bottai August 1, 2023

Wow this was great!

Charlie Misonne
Community Leader
Community Leader
Community Leaders are connectors, ambassadors, and mentors. On the online community, they serve as thought leaders, product experts, and moderators.
August 4, 2023

As a previous test engineer I'm sad I never had the chance to work with any of these tools. Instead we had spreadsheets or complex tools.

But process wise: I'm curious how teams plan their tests in a sprint. If a sprint takes 2 weeks and the testing teams needs multiple days to test. How do you do this assuming you want to release at the end of the sprint?
I've seen postponing testing to the next sprint but this is a bad practice if you ask me.

Benjamin Horst
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
August 10, 2023

Since we use a testing App in our On-Prem instance that is not available in the Cloud, this short overview was a great start. Thanks! 

patricia August 13, 2023

Thanks for sharing this information.

patricia August 13, 2023

Thank you to share with us how to improve our deliveries.

Mark Rekveld - Marvelution
Marketplace Partner
Marketplace Partners provide apps and integrations available on the Atlassian Marketplace that extend the power of Atlassian products.
August 15, 2023

thanks for sharing

Roger Hughes December 9, 2023

This is a really helpful summary, as it is something that our teams are currently attempting to work towards and have requested that JIRA assist in this QA task.  

TAGS
AUG Leaders

Atlassian Community Events