This is not possible at the moment. We will be focusing more on Slack-to-JIRA integration later this year so then such feature might find it's way.
At this point however, we have an improvement already in our backlog which does exactly what you are looking for but it will work only when you use our "Slack" tab on JIRA issue page to sent the message.
This should be released much sooner.
Connect with like-minded Atlassian users at free events near you!Find a group
Connect with like-minded Atlassian users at free events near you!
Unfortunately there are no AUG chapters near you at the moment.Start an AUG