As Data Engineer with five years of experience , I have honed my skills in creating robust ETL processes using Python , Scala , Spark and SQL . My expertise extends to cloud technologies , with certifications in Azure , and hands-on experience in both Azure and AWS environments
Implemented data transformations with PySpark in Databricks to optimize processing and improve performance.
Logro principalDesigned and developed pipelines to integrate data from APIs and various databases using Azure Cloud services.
Implemented transformations using Spark with Scala and integrated to databases such as MongoDB and SQL Server.
Logro principalDesigned and maintained ETL process in Azure cloud, using Azure Data Factory and Databricks.
Gathered requirements directly with the client and created bots in UiPath to automate business processes.
Logro principalLed the RPA team to ensure best practices and quality in our bots.