As I was going through the documentation of splunk to jira application,
I found that upon installation,we can go to manage apps and then configure it.
But I am not seeing any option for configuring it there. Just disable and uninstall even after switching to Jira user.