Business
Jobs
  • About Us
  • Solutions
    • Job Postings
      Post your job and receive qualified candidates in 48h.
    • Candidate Assessments
      500+ technical and psychological tests, plus anti-fraud.
    • Headhunting
      Tailor-made executive search from start to finish.
    • Payroll + EOR
      Payroll dispersal and EOR across 15+ LATAM countries.
  • Pricing
  • Jobs

0

234
Views
Django: File upload to s3 using boto

I am trying to upload images (average size 12 MB) to my server (django using PIL)then I'm processing them to scale down images and creating thumbnails.

During this process I'm not saving images to server local disk instead, I'm using In Memory file and processing it. I'm uploading images to s3, using boto and I have original image, scaled image and the thumbnail which should be uploaded one by one (all these three are still present in my in Memory).

This process is very time consuming and sometimes the server which I am using (Digital Ocean 512 MB RAM) throws out of memory error.

Can I know is there any better way of uploading images

Any help is much appreciated. Thanks in advance.

about 4 years ago · Santiago Trujillo
1 answers
Answer question

0

I haven't worked a lot with django & boto but u can try few suggestions:

  • Upgrade your server. if you are going to process that much big files, image processing requires a lot of memory.
  • You can try implementing queues (i.e. whenever you will get any upload request and file is bigger then enqueue it and process after current process is complete). You can use celery for this work.
  • If you don't need that much big files, then you can reduce image size at client side first and then pass it to the server.
about 4 years ago · Santiago Trujillo Report
Answer question
Find remote jobs

Discover the new way to find a job!

Top jobs
Top job categories
Business
Post vacancy Pricing Sales
Legal
Terms and conditions Privacy policy
© 2026 PeakU Inc. All Rights Reserved.
Andres GPT
Show me some job opportunities
There's an error!