Business
Jobs
  • About Us
  • Solutions
    • Job Postings
      Post your job and receive qualified candidates in 48h.
    • Candidate Assessments
      500+ technical and psychological tests, plus anti-fraud.
    • Headhunting
      Tailor-made executive search from start to finish.
    • Payroll + EOR
      Payroll dispersal and EOR across 15+ LATAM countries.
  • Pricing
  • Jobs

0

130
Views
s3 serverside encryption using oozie workflow

I have a sqoop job which will write the data into s3 bucket. If I run this job from command line it is encrypting the s3 files. But if I use the same jar file to run sqoop job using oozie workflow then it is pushing the data to s3 but encryption is not happened.

Below is the my oozie workflow.

    <java>
        <job-tracker>${jobTracker}</job-tracker>
        <name-node>${nameNode}</name-node>
        <main-class>com.aa.datalake.ingest.util.SqoopIngestUtil</main-class>
        <arg>root</arg>
        <arg>root</arg>
        <arg>test</arg>
    <arg>avro</arg>
    <arg>sqoop-demo</arg>   
    </java>
    <ok to="end"/>
    <error to="email-action" />
</action>

Inside jar we are copying the data from hdfs to s3 using distcp command.

So how I can do the server side encryption for s3 files using oozie workflow?

about 4 years ago · Santiago Trujillo
1 answers
Answer question

0

I have resolved the above issue by enabling the s3 encryption in EMR cluster before launching the cluster.

about 4 years ago · Santiago Trujillo Report
Answer question
Find remote jobs

Discover the new way to find a job!

Top jobs
Top job categories
Business
Post vacancy Pricing Sales
Legal
Terms and conditions Privacy policy
© 2026 PeakU Inc. All Rights Reserved.
Andres GPT
Show me some job opportunities
There's an error!