I am a Data Engineer with 4 years of experience, with skills in Python, SQL, Spark, GCP, Databricks, version control (Git), management of large data sets, excellent interpersonal relationships and teamwork
Generation of quality and efficient data models. Construction of pipelines that consume data from data lakes to serve ML models, analysis and reports. Creation and optimization of complex SQL queries.
Major achievementDevelopment of efficient ETL/ELT pipelines in GCP. Automation of data loading processes through programming and deployment strategies.
Support large-scale integration, coordination and integration of substantial data sets. Design and creation of modern data lake with delta lake and Databricks. Creation of data pipelines integrating different sources.
Major achievementSupport in large-scale integrations, design and creation of modern data lakes with delta lake and Databricks. Creation of data pipelines integrating different sources.
Construction and maintenance of data integration processes (ETL). Maintenance of centralized data models defined from the information architecture. Definition and execution of processes for the creation, classification and maintenance of data model metadata. Improved performance of data integration processes.
Major achievementConstruction and maintenance of data integration processes (ETL). Improved performance of data integration processes.