Daniel Vega Carvajalino
Professor Big Data Architecture
Perfil profesional
Senior Data Engineer with 8+ years of experience designing and optimizing cloud-based data platforms on Azure and AWS . Specialized in scalable data lake architectures , PySpark pipelines , and modern analytics solutions . Strong in requirements gathering , data architecture , and leading technical teams
Experiencia laboral
Design and delivery of training programs on Big Data and Cloud Data Architectures (Azure & AWS). Teaching fundamentals and advanced concepts of Data Engineering.
Logro principalDesigned and delivered training on Big Data and Cloud Data Architectures (Azure & AWS). Mentored students on real-world data projects.
Requirements gathering, design, and implementation of Azure Data Lake and Delta Lake architectures. Developed and optimized ETL pipelines using PySpark in Databricks and Azure Data Factory. Migrated analytics workloads to Microsoft Fabric. Managed Azure security and AWS Glue jobs.
Logro principalLed migration and optimization of ETL pipelines using PySpark, Databricks, Azure Data Factory, and Microsoft Fabric. Designed scalable Data Lake and Delta Lake architectures. Managed AWS Step Functions and Glue jobs.
Power BI, SQL, Azure, AWS, database development and ETL solutions.
Logro principalDeveloped Power BI, SQL, Azure, AWS, and database solutions for clients.
Formación académica
Unknown | Profesional
