It's because you have the administration rights on the project/s displayed in the board. So in order to remove the button you need to remove your project administration rights. Supposing you have system admin rights then you can remove your project level rights and grant these to you only when you need to change something.
Hope it helps.
Connect with like-minded Atlassian users at free events near you!Find a group
Connect with like-minded Atlassian users at free events near you!
Unfortunately there are no AUG chapters near you at the moment.Start an AUG
We're bringing product updates and pro tips on teamwork to ten cities around the world.Save your spot