JIRA for Test Management

[Danielle Johnston]

My team is looking to leverage JIRA for test case management (http://confluence.atlassian.com/display/CONFEVAL/Using+JIRA+for+Test+Case+Management). We've customized JIRA as documented now the question comes down to - how do we integrate our automated testing with JIRA?

We currently use TestLink to manage testing, but want to create a single platform through which to create and monitor test runs, execution, and defects created from said actions.

Also, we use Selenium to automate a significant number of our browser-based tests. Without installing/using another tool, can we form interactions with Selenium in JIRA itself? We know that Selenium can be integrated into Bamboo, but our larger organization is slow in effecting Bamboo adoption with our architects.

In the meantime, our team needs to continue on its aggressive combination of manual/automated testing. Any thoughts/directions other than adoption of Zephyr or other standalone tools?

[Renjith Pillai · Accepted solution]

Or use a commercial product like http://www.go2group.com/products/go2group-synapsert/

[Andrzej Pasterczyk]

About Selenium it depends mostly on how you execute those tests. If you use selenium libraries in any programming language (C#, Java, Python) you can do lots of stuff - decorate your tests with test id attribute, have XML config or whatever and then report back to Jira using REST api.

[Nirav Shah]

We use Zephyr for JIRA, so far working out good for us.

[Ahmed Tarek]

Can you give me more details about Zephyr 

[Yaniv Iny]

Hi,

We just added a new plugin for JIRA two way synchronization. For more details look here:

ww.practitest.com/jira-test-management/

Here's the video - http://www.youtube.com/watch?feature=player_embedded&v=HARCoMQ-0yY

[Arta Doci]

Thank you Sanjay!

Arta

[TyrionL]

Also, here is the original link you were looking for:

https://confluence.atlassian.com/display/JIRAKB/Using+JIRA+for+Test+Case+Management

~ Sanjay

[ritvick_udasi]

Integrating automated testing with JIRA can streamline your test case management process and improve overall efficiency. Here are the steps you can follow to integrate your automated testing with JIRA:

1. Choose an Automation Framework: Before integrating with JIRA, ensure you have an automated testing framework. Popular choices include Selenium, QMetry Automation Studio, Appium, JUnit, TestNG, and others, depending on your application type (web, mobile, desktop, etc.).

2. Set Up Test Automation Scripts: Create and maintain your automated test scripts using the chosen framework. These scripts should cover the test cases you want to manage in JIRA.

3. Version Control System (Optional): It's a good practice to use a version control system like Git to manage your automation code. This will help keep your test scripts organized and enable collaboration among team members.

4. Test Execution: Execute your automated tests as part of your continuous integration (CI) pipeline or on-demand as needed.

5. Test Reporting: Configure your test automation framework to generate test execution reports. These reports should include information about the test run, such as pass/fail status, test case IDs, and any relevant logs/screenshots.

6. JIRA Integration:
- Install JIRA Plugins: JIRA offers various plugins and integrations to connect with test management tools and test automation frameworks. Some popular ones include Xray, QTM4J, Zephyr, and TestRail. Depending on your choice, install and configure the relevant plugin.

- Map Test Cases: Map your automated test scripts to corresponding test cases in JIRA. You can do this using the plugin's interface, where you associate a test script with a specific test case in JIRA.

- Automated Test Execution Status: Configure the integration to update the status of test cases in JIRA automatically based on the results of your automated tests. For example, if a test script passes, the associated test case in JIRA should be marked as "Passed," if it fails, it should be marked as "Failed."

- Link Issues: You can also link JIRA issues (such as user stories or bugs) to the corresponding test cases. This helps in traceability, as you can see which tests cover specific requirements or issues.

- Generate Test Execution Reports: Some integrations allow you to generate test execution reports directly within JIRA. This can be useful for tracking overall test progress and identifying areas that need attention.

7. Test Maintenance: Keep your test scripts and JIRA test cases up-to-date as your application evolves. Whenever there are changes in requirements or features, update the relevant test cases and scripts accordingly.

8. Automation Best Practices: Follow automation best practices, such as using parameterization, maintaining a clear folder structure for test scripts, and regularly reviewing and refactoring your automation code.

9. Continuous Improvement: Periodically review your automated testing process and JIRA integration to identify areas for improvement. Make adjustments as needed to optimize your test case management workflow.

By following these steps, you can effectively integrate your automated testing with JIRA and ensure that your test cases are well-managed and traceable within your project management system.

[Quentin X]

Hi Danielle,

I was wondering if you could give us some feedback about your test management installation with JIRA?

* Could you manage to use a custom solution?
if so do you have a way to call Selenium scripts and get the results back into JIRA?
And as Allmas asked, how do you handle the test runs? Do you clone/copy the test cases?

* Or did you end up getting Zephyr for JIRA5 as you planned?
But as far I can tell, this require more customization as only Zephyr Community and Enterprise Editions have easier to use tools for automation.
http://developer.yourzephyr.com/zapi/index.php

Thanks!

Quentin

[Arta Doci]

Chris:

Can we please have a quick chat: 3038885812

Arta

[Arta Doci]

I would like to configure JIRA for test case management; however the following links are broken:

· http://confluence.atlassian.com/display/CONFEVAL/Customise+JIRA+For+Test+Case+Management

· http://confluence.atlassian.com/display/CONFEVAL/JIRA+Sample+File+-+Test+Case+Management

I would appreciate if someone can send me the scenario / workflow + files to install for JIRA Test Case Management via email artadoci@gmail.com.

Thank you!

Arta

[Chris Miller]

Hi Arta,

Zephyr for JIRA is a testcase management option inside JIRA 5.2 for On-Premise Installations. This is one option for you. Check it out here: https://marketplace.atlassian.com/plugins/com.thed.zephyr.je

Kind Regards,
Chris

[Arta Doci]

I would like to configure JIRA for test case management, however the follwoing link is broken:

http://confluence.atlassian.com/display/CONFEVAL/Using+JIRA+for+Test+Case+Management

I would appreciate if someone can sent me the scanario / workflow for JIRA Test Case Management.

Thank you!

Arta

[Ravi Motwani]

Hello everyone,

We are using JIRA OnDemand (JIRA Studio) for Project & Issue management. I want to know following things:

1. Whether Test Management is possible within JIRA or not (with entities like Test Plan, Build, Test Cases etc)?
2. If yes, then how can we implement it? Is there requirement of any external plug-ins?
3. If No, then can we integrate Testlink with JIRA and how can we implement that?
4. Please do suggest if any other open source test management tool available which can be integrated with JIRA studio.

Our purpose is to achieve test management with JIRA Studio.

[Andrzej Pasterczyk]

I think it would be better if you start a new question - you'll get more answers this way :)

[Deleted user]

Hi Danielle,

Are you using Jira for complete test case management, are your manual tests written in Jira? How are you handling Selenium scripts within Jira?

[Danielle Johnston]

Allmas,

We have successfully transitioned all of our manual browser- and emulator-based testing to JIRA (out of TestLink). We don't yet have a solution for our Selenium scripts. We are looking to evaluate Zephyr when it becomes available for OnDemand. In the meantime, we are manually executing and reporting our Selenium scripts' success/failure (not ideal).

I'd like to spend more time building up a custom solution (as proposed by Swiniak above) through leveraging JIRA's REST services, but have not been able to do so while rolling out JIRA to replace our product, project, and dev workflow suites.

[Andrzej Pasterczyk]

Danielle,

Out of curiosity - how do you manage your test cases execution now in Jira?

I'm wondering if you could make a simple test reporting by using jira command line interface ( https://studio.plugins.atlassian.com/wiki/display/JCLI/JIRA+Command+Line+Interface ). If your test cases are jira issues you could probably update them with some comments/labels/custom field using CLI directly from your automated test - should not require that much effort as writing your own REST client :)

[Danielle Johnston]

Swiniak, is CL available for OnDemand? I guess I had assumed it was only available for local installations. I'll look into it. Thank you!

[Deleted user]

Danielle,

Its good to know that you have adopted Jira completely. I have a couple of questions and insight from you would really help me use Jira better.

1. Do you use Greenhopper?

2. Did you customize Jira manually http://confluence.atlassian.com/display/CONFEVAL/Customise+JIRA+For+Test+Case+Management or or did you import the sample test files http://confluence.atlassian.com/display/CONFEVAL/JIRA+Sample+File+-+Test+Case+Management?

3. How do you handle the test runs? Do you clone/copy the test cases or any other way?

[Andrzej Pasterczyk]

C:\jira-cli-2.5.0>jira --action getProject --project "KEY" --server "https://ACCOUNT.atlassian.net" --user "user" --password "pass"

I've checked only the basic thing but I assume it works perfectly fine :)

[Lynne Johnson]

I just customised JIRA OnDemand manually but the instructions are for an earlier version of JIRA. JIRA has changed a lot since then but I have managed to complete the configuration. Using the configuration is not as easy to understand and I still don't have my head around how to implement test cycles. Anyone have any more to add for help?

[TyrionL]

To clarify Zephyr's product offerings, there is Zephyr Enterprise which is the stand alone platform and has a tight, real-time integration with JIRA for defect management but there is also the new "Zephyr for JIRA" which is a test management add-on to JIRA5 and allows you to manage your testing inside JIRA. Here are the plugin links for both ...

Zephyr Enterprise JIRA plugin: https://plugins.atlassian.com/plugins/com.thed.jira.ext.rpc

Zephyr for JIRA5 add-on: https://plugins.atlassian.com/plugins/com.thed.zephyr.je

[Jakub Pierzchała]

Just a note, Zephyr for Jira is not available in Ondemand

[TyrionL]

... well, not yet ;-)

[Mark Row]

Is there a timeline for when Atlassian will make the Zephyr for Jira plugin available in Ondemand?