You'll want to create an issue filter with the following JQL. My apologies ahead of time if you are using Atlassian Cloud, your instance will look different than mine. So let me know if you need different images to help you through! :)
Below is the JQL, update anything in ** with your project.
project = *Project Name* and sprint is EMPTY project = *Project Name* and resolution is not EMPTY
Once you have these filter you'll want to click on Export in the top right of the page, and select CSV (Current fields). See below images.