If you don't insist on CSV and a normal Excel file would suffice, too, then one possible way to do it is with the Better Excel Exporter app. It comes with a built-in template that will export the change history of your Jira tickets. See an example here and more among the Export Samples Gallery:
(Please note that Better Excel Exporter is a paid and supported app and I'm part of the team developing it.)
Hello Community! I hope you've been enjoying the 🍂Apptoberfestivities🍂 (I know I have!) The event is heating up next week with a series of virtual events that we're calling the 🍻🍂Partner App ...
Connect with like-minded Atlassian users at free events near you!Find an event
Connect with like-minded Atlassian users at free events near you!
Unfortunately there are no Community Events near you at the moment.Host an event
You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events