Well in JIRA, archiving simply means that you're making that item (project, versions, etc) no longer accessible. The data will still exist, but is no longer used until it's unarchived.
Deleting means that you're completely removing that data. It will no longer exist in JIRA's database. There is no way to recover that data without a backup file.
This also explains project archiving a bit:
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.