I'm trying to find a solution to allow users to download thousands of media files (10K +, 0.1-10MB each) from AWS S3 / Azure Storage.
First, I tried to archive the files and use a pre-signed URL to download the zip. It works, but its just takes too much time (hours) - dynamically create / append to zip from multiple instances
Is there another solution, like just downloading / streaming them via browser, without archiving them? Archiving doesn't help too much anyway (15-30%).