How are scorecard averages calculated?

[Louise Boulton]

Hi,

We have configured a scorecard with 10 questions. Each question has a max number of points (0, 5, 10 or 20) and four possible user choices each of which carries a number of percentage points (0, 25, 50, 100).

As expected in the epic value tab the analyse view shows epics ordered by score.

Questions (actual ask is in bold):

1. When I select an epic from the list on the left headed Portfolio Epic Ranked by ROI Score, sometimes the score in the list is different from the Value Score displayed in the ROI Score Analysis section on the right. JA Help Information on the Portfolio Epics page under the heading Scorecards states "On the right, you can view the same individual scores and total value score as you see on the actual epic." Any guidance on what might cause differences here?

2. I calculated the average for a couple of portfolio epics in a spreadsheet and I get slightly different results than the average in Jira Align (e.g. in one instance Excel's avg function returns 80 and JA returns 84.8) What is the actual calculation done to get averages? 

Thanks in advance!

[Jennelle Stearns · Accepted solution]

@Louise Boulton 

1. For the 1st one, I would recommend opening a support ticket.  One possibility is that they may be updating a different form at the program level than at the portfolio level.  Go to Admin-Programs and check which forms are being utilized for each of the programs.  Make sure the specific score card is selected and it doesn't say "Use Portfolio Score card".  I have seen instances where "Use Portfolio Score card" is selected but the wrong form is showing for that program.

2. For the score, you take the sum of the possible points for all the questions (which can be more than 100), and this is your denominator. Then, you take the number of points you allotted for each answer the user provided for that epic and sum those, and that is your numerator.

So if I had something like this where I have form with only 2 questions:

Question 1:  Max score 20 pts

Answer a: Gets 20 pts

Answer b: Gets 10 pts

Answer c: Gets 0 pts

Question 2: Max Score is 30 pts

Answer a: Gets 0 pts

Answer b: Gets 10 pts

Answer c: Gets 30 pts

Let's say, I say I answered c for question 1 and b for question 2.  Then the calc would be:

(0 + 10)/(20 + 30) = 10/50 = 20%

[Louise Boulton]

Hi @Jennelle Stearns this is super helpful, thanks. I'd actually already noticed that some of our programs were indeed configured to use the Portfolio Scorecard not our bespoke one and I'd changed it, so now I have this question: after this change, how do I force epics scored against the wrong scorecard to score against the correct one? Will changing the answer to one question then saving do it? Or removing all scores and re-entering?

Thanks too for the calculation explanation. Could that be added to the information available in JA help for the value tab?

Best wishes,

Louise

[Jennelle Stearns]

@Louise Boulton So do you have have the same scorecard listed on the portfolio (Admin-Portfolio) as you do for the Programs under it or are they different?  I typically recommend that they all be the same.  I am trying to understand how they were different.  The reason I am asking was did you have the correct scorecard listed at the portfolio level but when you filtered at the program level and went to the value tab did you notice it was showing a different scorecard OR are you saying it was different just because at the program level when you looked at the admin level for Program it said use Portfolio level?  If you definitely know the scorecards showing to your end users were different, then to bring them into alignment, you probably need to go back in and filter on the area that was different and answer the questions to see if it is in alignment.  If they were different, my guess is that it was averaging the scores across all the programs and at portfolio level (just a guess on my part).  Support could probably tell you for sure.  As far as the calculation, I will pass along the info to our documentation team to see if they can add it!

[Louise Boulton]

Hi Jennelle,

The same scorecard is now listed for the portfolio and all programs. I'll make sure that any scoring done on a program that had the setting Use Portfolio Scorecard is re-done now that we are 100% certain that our bespoke scorecard is applied throughout.

Thanks for your help! I will post again about this if I need to.

Best wishes,

Louise