Me mudé a esta empresa después de que la empresa anterior dejara Rusia. Trabajar con Yandex Cloud, escribir dags en AirFlow, construir una arquitectura de almacenamiento y optimizar los flujos existentes son las tareas principales de este trabajo. Trabajo con una gran cantidad de datos, varias fuentes de datos: Mongo DB, MS SQL, PostgreSQL, ClickHouse.

It was the most interesting work experience. I didn't want to quit, but SoftwareONE left Russia. I work in an international team of IT specialists on the Big Data stack: Databticks and Azure Cloud. Communication with foreign customers and colleagues was in English. I wrote notebooks like Jupyter in Python (PySpark) and SQL for extracting, loading, processing data from various sources: SQL / NoSQL databases, REST API, XML. Our storage consisted of raw/bronze/silver data layers.

I built dashboards in Redash. My main project is getting data from ServiceNow: diving into the subject area, learning the REST API, developing and writing a loader. Orchestrator - Azure Data Factory (ADF). Git is built into the Azure cloud.