Data Engineer focused on the design and optimization of ETL pipelines, advanced analytics, and data-driven solutions to support decision-making. Experience in automation, data processing, and cloud analytics, integrating multiple sources and modern technologies. Proactive profile, oriented toward continuous improvement, collaborative work, and the adoption of new technologies in production environments.
• Optimization of data pipelines for critical processes such as payroll processing using Databricks, improving processing reliability and efficiency. • Implementation and management of pipelines on Amazon S3, integrating AWS Glue for data transformation and cataloging. • Enablement of dynamic reports in Power BI with near real-time latency, ensuring consistent and up-to-date information.
Logro principal• Implementation of ETL processes orchestrated with Apache Airflow for financial accounting, reducing execution times from 2 days to 2 hours.
• Development of ETL pipelines for data collection and dynamic reporting in Power BI for retail stores, supporting KPI-driven decision-making. • Orchestration of data workflows with Apache Airflow, integrating multiple formats and communication channels within the retail environment.
Logro principal• Standardization of databases using advanced regular expressions, increasing data consistency and quality by approximately 90%.
• Designed and executed ETL processes integrating data from Excel files, CSVs, and databases, generating analytical reports to support research projects. • Developed ETL pipelines orchestrated with Apache Airflow for Natural Language Processing (NLP) solutions, incorporating regular expressions and Google Drive APIs as a central repository under a medallion architecture.
Logro principal• Implemented a cloud-based web application for the standardization and automated evaluation of sustainability-related texts, providing structured feedback and significantly reducing manual operational workload.