How to generate a query that filters tests based on Zephyr Test Case Execution status

We have the Zephyr test case plugin but are finding that it's very hard to track test cases as the widgets on the dashboard don't enable you to click on the test execution status graphs that show testing progress by cycle to see the list of issues that have that specifix test executions status.

We tried creating a query to list for instance all test cases with a test execution status of "blocked" but we can't find the field to use to search for this.

How do you create a query that list all test cases in a cycle which have a specific status applied?

11 answers

1 accepted

Hi Shane,

We are working on increasing the abililty to get detailed reporting from Zephyr. At this point, it isn't possible to use queiries to find various test statuses.

We are anticipating the next major release of Zephyr will come out in 2012 and include the ability to export test results. Further reporting improvements will come in time.

Kind Regards
Chris

Hi,

Has this been resolved? I also would like to query based on the latest Execution Status of a issue. This is key to gathering metrics and will be both internal and client facing.

Hi,

Zephyr for JIRA 1.6 is out! We've added numerous new features and bug fixes. For anyone following this post, you'll be happy to hear that we now offer the ability to export tests cycles and their results.

Kind Regards,
Chris

We are evaluating Zephyr for JIRA 1.6. I was hoping that we could setup filters based on these statuses within Jira proper. However, the last post seems to indicated that the answer is still a "no", there is still no way to query test cases by Zephyr Execution Status within Jira. Is my understanding correct?

We are evaluating Zephyr for JIRA 1.6. I was hoping that we could setup filters based on these statuses within Jira proper. However, the last post seems to indicated that the answer is still a "no", there is still no way to query test cases by Zephyr Execution Status within Jira. Is my understanding correct?

Hi,

Your reading is correct. We very much understand the role of the functionality and do desire to have it in a coming build.

The architectural challenge here originates in the fact tha Atlassian made a platform which allows companies to add functionality on to JIRA. However, JIRA itself doesn't automatically know about the testing-centric data that we added in our add-on, and thus doesn't automatically return test result values back into JQL queries.

Kind Regards,
Chris

Given that the data is stored in the Jira Database are you able to tell me what the Database Tables are that the Zephyr Plugin uses to store this execution data as we maybe able to workaround the issues by qurying the database directly.

We were also looking at what information is returned by the Jira Rest API which we currently use to retrun Jira Issue data. We haven't been able to work out what the request URL would be to return the test cycle execution history for a zephyr test jira.

Are you able to share what the rest URL would be that could be used to return this information?

I am also interested in Shane's workaround suggestion of known tables to query for execution data.

Gents,

Currenlty, Zephyr doesn't offer support to customers accessing the data directly or use of APIs. Queries and API access are on our roadmap for a coming release. As well, our company doesn't share too many details about this roadmap until the functionality is about to be released.

Kind Regards,

Chris

Could you please let me know if there is any update on this. I understand that support is not offered to customers accessing the data directy but was wondering if we still have a way to retrieve this data from the database.

Thanks,

VC

Greetings,

I do want to share that imporving this area of the Zephyr is our top priority for the next major release. This information is straight from the top.

Now I can't offer any more specifics yet on exactly what we're going to do and when the next major release is, so I'll put that out there now to head off those questions.

Kind Regards,
Chris

I agree with others on this thread regarding the ability to query the database. We need that ability. We recently licensed Zypher with that assumption. It is critical to our continued use of the product.

I agree with others on this thread regarding the ability to query teh database. We need that ability. We recently licensed Zypher with that assumption. It is critical to our continued use of the product.

I ran into the same problem after recently purchasing Zephyr and I'm now querying the database directly, via a read-only account :). I realize that it's not best practices to go directly into the database for reporting, but this was a critical business need to be able to provide details reports. The new feature allowing you to export a single test cycle is helpful, but I'm held to regulations that require trend analysis over multiple test cycles. You can find the database tables that Zephyr writes to here:

  • Administration --> Advanced --> Plugin Data Storage

All the table names are listed there, with a little playing around you can pretty quickly figure out the relationships between the Zephyr tables and the existing JIRA tables so you can produce full detailed reports. This approach still requires some manipulation in Excel, SSRS or some other tool but at least you can get at all the data.

Hi David, Did you manage to extract the Test Execution report from Zephyr onto JIRA dashboard? I need to report the test execution detaisl based on Test sessions\cycle.

This is still an issue,

- you cannot query test case status from a cycle or a set of seleceted cycles, or know their status, or otherwise filter.

- overview of test cases in a cycle is bounded to 10 cases in a navigation (next/prev) which is very buggy.

- You cannot sort out specific fields and order by fields to get clarity for a number of people testing.

David -- can you shed a little more light on the existing Jira tables? Zephyr doesn't offer much flexibility here.

Suggest an answer

Log in or Sign up to answer
How to earn badges on the Atlassian Community

How to earn badges on the Atlassian Community

Badges are a great way to show off community activity, whether you’re a newbie or a Champion.

Learn more
Community showcase
Published May 30, 2018 in Marketplace Apps

Three tips for boosting your board's efficiency with Story Maps

Trello is one of the most effective tools for driving your sprints. It's customizable for every Agile team and product owners and Scrum masters (SM) love it. However, Agile teams often struggle with:...

828 views 2 9
Read article

Atlassian User Groups

Connect with like-minded Atlassian users at free events near you!

Find a group

Connect with like-minded Atlassian users at free events near you!

Find my local user group

Unfortunately there are no AUG chapters near you at the moment.

Start an AUG

You're one step closer to meeting fellow Atlassian users at your local meet up. Learn more about AUGs

Groups near you