Business
Jobs
  • About Us
  • Solutions
    • Job Postings
      Post your job and receive qualified candidates in 48h.
    • Candidate Assessments
      500+ technical and psychological tests, plus anti-fraud.
    • Headhunting
      Tailor-made executive search from start to finish.
    • Payroll + EOR
      Payroll dispersal and EOR across 15+ LATAM countries.
  • Pricing
  • Jobs

0

548
Views
How to move file from one in another S3 Bucket after time?

How to move file from one in another S3 Bucket after time?

i checked this thread: Is it possible to automatically move objects from an S3 bucket to another one after some time?

but i don't want to use the Glacier option, because our files a really small. Is there another option?

EDIT:

Requirement is to mark files as invalid (there is a metadata table where we change an attribute for this) and later on to delete them. (invalid means = e.g. older as some date...maybe 30 days). After that, this invalid files should be deleted after, we say 120 days.

Why to move files?

  1. Separate by business requirement (invalid vs. valid files) - don't have to check this attribute again (whether it's invalid or valid)
  2. less files to iterate over, if we may want to iterate over valid files
  3. important: 'S3 PUT event' of new bucket can invoke a lambda function: this lambda function can do other stuff. Like change attribute (valid/invalid/deleted) in our dynamoDB table.

Yes, we can also renounce the use of moving files. But i don't see a way how to execute lambda functions after a delay of 30 days.

Best regards

about 4 years ago · Santiago Trujillo
1 answers
Answer question

0

It is possible to schedule lambda function execution using CloudWatch scheduled events

The design should include:

  • Implementation of Lambda function which identifies and moves required objects in S3
  • Scheduled expression rule with desired schedule. Cloudwatch supports crontab expression like aws events put-rule --schedule-expression "cron(0 0 1 * ? *)" --name ObjectExpirationRule
  • Assign the rule to the lambda aws events put-targets --rule ObjectExpirationRule --targets '[{"1", "arn:aws:lambda:us-east-1:123456789012:function:MyLambdaFunction"}]'
about 4 years ago · Santiago Trujillo Report
Answer question
Find remote jobs

Discover the new way to find a job!

Top jobs
Top job categories
Business
Post vacancy Pricing Sales
Legal
Terms and conditions Privacy policy
© 2026 PeakU Inc. All Rights Reserved.
Andres GPT
Show me some job opportunities
There's an error!