It took me about an hour to realize that the import/export stuff is a plugin in the latter versions of Jira.
It took me another hour to realize that I can't install plugins because we have Jira OnDemand and don't host it ourself.
So the question remains; is there a way to import issues using a csv file with Jira OnDemand?