Data engineer using AWS cloud tools (Glue, Athena, Kinesis, MSK, Lambda, SNS, SQS, EventBridge, ECS, Cloudformation, etc.) I developed comprehensive solutions from architecture design and implementation to code development. Developing microservices to process Kafka data
Implementation, maintenance and development of Big Data applications on the Cloudera platform. Using Spark, Hive, Impala, HDFS, Oozie, Flume, etc. Development of batch applications to detect credit card transactions that will probably be rejected in the future given the history for each user. Development of ETLs in general