i'm a new Zephyr user...

Gregor Czempik October 10, 2019

i my company we want to introduce zephyr for the test management tasks. 

currently i'm evaluating, if all requirements can be covered by this tool, or if we need any plug-ins or similar stuff.

 

3 comments

Comment

Log in or Sign up to comment
Ravi Sagar _Sparxsys_
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
October 10, 2019

Hi @Gregor Czempik 

Whether you would need additional plug-in depends what you are trying to achieve.

There are different apps that introduces test management capabilities in Jira - mainly TM4J, Zephyr and XRay. Do you have a list of requirements that you trying to do? how you do test management currently? 

You can take a look at this document that list the features of these different apps (as of March 2019).

I hope it helps.

Ravi

Disclaimer - I work for Adaptavist so I am bit inclined towards TM4J.

Gregor Czempik October 10, 2019

Hello Ravi, thanks for the quick response.

currently i'm working with zephyr. it sounds better, than it is, if you read the documentation: you can execute testcases and so on. 

in true you cannot excecute any testcase, as there is no test code or binary to execute it. you can manage the status of the execution at all, not more.

the same is for the reporting: currently i cannot get any overview of all executed test cycles, only those for one release.

it is not possible to get any execution summary based on the test steps, as already required by other user since 2013! there is even no response in the thread when this will be implemented - very poor.

i'm playing with the REST API to add any results (PASS / FAILED) of the test excecution to JIRA. so in general it is possible, yes. but not very user-friendly, as the management of the IDs (issue ID, cycle ID, project ID, execuction ID, teststep ID, ...) - very confusing. 

further more i have not found any documentations about those items, no diagram or similar.

i'm missing an automatism if entering teststep results to a testcase. if you set all teststeps to PASS, the testcase result becomes PASS to. but this is only the one think working. by setting any teststep result to FAIL, the overall result remains PASS - very strange. 

looks like the zephyr developer never use their tool for the test management in real live.

my requirements are simply as all the requirements for the test management: 

- define tests (zephyr: very poor, very unflexible, ...)

- trigger test execution (not possible): all tests, one test, failed tests, all / smoke / regression / release tests.

- collect results (only manually, or using REST API)

- create ticket for the developer

- retest FAILED tests (not possible)

- get summary: filter report (i.e. only FAILED tests, ...), get execution time, get avg. duration of the test execution, and so on. 

- get report

 

but no matter, i have to investigate what this tool can do and what cannot.

Like Ravi Sagar _Sparxsys_ likes this
Erica Moss
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
October 10, 2019

@Gregor Czempik Welcome to the Atlassian Community! 😄

Jimmy Seddon
Community Leader
Community Leader
Community Leaders are connectors, ambassadors, and mentors. On the online community, they serve as thought leaders, product experts, and moderators.
October 11, 2019

Hi @Gregor Czempik,

Welcome to the party!

I know you will find tons of friendly helpful people to answer your questions!

-Jimmy

TAGS
AUG Leaders

Atlassian Community Events