I came across this while troubleshooting a nagging issue I was having with Jira: https://confluence.atlassian.com/jirakb/jira-admins-seeing-page-load-pauses-in-ie11-952614454.html
I couldn't find any equivalent issue documented anywhere for Confluence, but I had a similar page load pause. Just as a shot in the dark (pun intended), I tried disabling the whisper plugin in the same way, and it immediately fixed the issue.
I believe there must be a way to fix the whisper plugin so it doesn't cause this issue, but it seems it's rare enough that it's not getting much attention. How many others have come across this? Is there any other workaround besides just disabling whisper?
Also, in my searching, I did come across this issue with whisper in Confluence - https://jira.atlassian.com/browse/CONFSERVER-57580 - but it is unrelated. My instance is very small, if there are half a dozen concurrent users it's a big day.