Extracted data from different sources using Python, Airbyte, Spark. Transformed data and applied business rules using dbt, SQL, Python. Developed data applications using AWS cloud services. Created containerized applications using AWS(EKS, ECR).

Data warehousing and dimensional models (OLAP), Pipeline orchestration with Apache Airflow

sqlserver

Dictation & class preparation, Lead the commission team

Analyzed complex business requirements about Data. Developed projects leveraging Hadoop, Hive, Spark, Python, Rancher, GCP. Designed and maintained ETL and ELT involving SQL & Python. Developed data applications using GCP services.

Implemented Elasticsearch for processing large volumes of trading data, Developed custom python script for ingesting API JSON data