I am set as the site admin but I'm not able to delete any tasks.
Hello,
To delete a task you would need the Delete Issues permission in this project (It does not matter if you are a Jira administrator). But still deleting tasks in Jira is not a good thing to do. Deleted tasks can not be restored, that is why you it is better to move the issue status to the Closed status than to delete it.
It looks like you're new here. Sign in or register to get started.