Hi,
I have a 3 GB file that is required to be present for the tests to work properly.
Right now is being downloaded from s3 with every pipeline run (1 GB, tar.gz, then uncompressed). This seems suboptimal.
How should I cache this file?
Or more generally what should my approach be when dealing with big files that are necessary for software operation but cannot be included in the repo?
Thanks!