I am a Data Engineer with 4 years of experience, with skills in Python, SQL, Spark, GCP, Databricks, version control (Git), management of large data sets, excellent interpersonal relationships and teamwork
Generation of quality and efficient data models. Construction of pipelines that consume data from data lakes to serve ML models, analysis and reports. Creation and optimization of complex SQL queries.
realização principalDevelopment of efficient ETL/ELT pipelines in GCP. Automation of data loading processes through programming and deployment strategies.
Support large-scale integration, coordination and integration of substantial data sets. Design and creation of modern data lake with delta lake and Databricks. Creation of data pipelines integrating different sources.
realização principalSupport in large-scale integrations, design and creation of modern data lakes with delta lake and Databricks. Creation of data pipelines integrating different sources.
Construction and maintenance of data integration processes (ETL). Maintenance of centralized data models defined from the information architecture. Definition and execution of processes for the creation, classification and maintenance of data model metadata. Improved performance of data integration processes.
realização principalConstruction and maintenance of data integration processes (ETL). Improved performance of data integration processes.