How can I use Automation for JIRA to create experiment variants?

Joe Clark Atlassian Team May 09, 2017

 Hey Gang!

We are using the Automation for JIRA add-on to send satisfaction survey emails directly from JIRA when an issue is resolved.

I'd like to set up an experiment to A/B test some variants of the email's contents - is it possible to express a configuration with this add-on which would achieve this? Ideally I would like to perform one action for 50% of issues, and another action for the other 50%. My initial idea was that I could just create a condition which does a modulu of the issue key and performs different behavior for even/odd numbers - but I couldn't find a way to do this.

Thanks! 

 

 

1 answer

1 accepted

2 votes
Andreas Knecht Community Champion May 09, 2017

Hey Joe!

Interesting use case - I think the short answer is, we don't have something that can do a random 50/50 selection of issues yet.

I've raised https://codebarrel.atlassian.net/browse/AUT-306 for now, but we've got quite a few higher priority items in our backlog at the moment so it will be a while before we can get to this.

The only thing I can think of is to use a regex perhaps to match on odd vs even numbers (e.g. http://stackoverflow.com/questions/691519/regular-expression-to-match-only-odd-or-even-number), however you'd have to ensure that they are mutually exclusive since we don't have else-if yet (https://codebarrel.atlassian.net/browse/AUT-42).

Your rule would look like this:

  • Trigger: JQL Search
  • Action: Related issues with Current issue
    • Compare Condition: with your regex
    • Send e-mail A
  • Action: Related issues with Current issue
    • Compare Condition: with your other mutually exclusive regex
    • Send e-mail B

 

To be honest I think right now you might be better off using a third party system to send the e-mails that's designed for A/B testing and using an Outgoing webhook action to trigger these e-mails being sent somehow (I don't really know of any that do this though :( ).

Sorry I don't have a better solution yet!

Cheers,
  Andreas

 

Hey Andreas,

Thanks for the answer! I'll be sure to vote/watch those issues and then complain noisily until they are resolved ;)

I agree we might want to refactor these emails out to an external service to enable deeper experimentation, but for now I'm looking for the quick-and-dirty approach.  Thanks for the suggestion - I'll give the regex approach a try.

 

Suggest an answer

Log in or Sign up to answer
How to earn badges on the Atlassian Community

How to earn badges on the Atlassian Community

Badges are a great way to show off community activity, whether you’re a newbie or a Champion.

Learn more
Community showcase
Published Jul 10, 2018 in Marketplace Apps

If you’re an Atlassian app developer, you’ll want to know about Atlas Camp!

This September 6-7, hundreds of Atlassian App developers will flock to Barcelona Spain to build skills, discover product roadmaps, meet face-to-face with the Atlassian team, and learn how to extend t...

158 views 0 4
Read article

Atlassian User Groups

Connect with like-minded Atlassian users at free events near you!

Find a group

Connect with like-minded Atlassian users at free events near you!

Find my local user group

Unfortunately there are no AUG chapters near you at the moment.

Start an AUG

You're one step closer to meeting fellow Atlassian users at your local meet up. Learn more about AUGs

Groups near you