I am afraid updating the "Display URL" in the Application Link is not enough, because the one which is indeed used is the one from "Application URL", which you cannot edit.
So, I think your best option is to delete the current application link and create a new one using the new JIRA URL as Application URL.
Hello Community! Quick disclaimer: We are running a contest on Community (The Atlympics!) from July 23rd - August 8th of 2021. If you are interested in participating in this contest (prizes! ...
Connect with like-minded Atlassian users at free events near you!Find an event
Connect with like-minded Atlassian users at free events near you!
Unfortunately there are no Community Events near you at the moment.Host an event
You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events