In general Label would be removed when it would be not used in any issues (it need to be removed from all issues). If you still seeing this maybe there are some issue that you are not able to view (not having permission) or there is a index/cache/browser cache that need to be flushed and reloaded.
There is also an improvement request created related to that topic
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.