As mentioned above, you can update the board query or subquery to hide closed issues.
Another option is to use the "Release" button on the top-right of the board, this will create a release and mark all the closed items as released, so they should no longer show. You would need to to this periodically, say once a month, to stop the column from filling up again.
Connect with like-minded Atlassian users at free events near you!Find an event
Connect with like-minded Atlassian users at free events near you!
Unfortunately there are no Community Events near you at the moment.Host an event
You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events