DasaLead Data Engineer
Sep. 2021 - Dec. 2022São Paulo, Brasil- Support the team with business and technical stories - Conflict resolution - Internal and external communication - Evolutions in classic ETL solutions such as: SSIS, Powercenter and Talend - Design of new Data Pipelines with SQL, Python, Airflow, Databricks and Azure - Support the team with performative queries and data modeling - Integration with API's, Excel, Oracle Exadata, Azure SQL, Open Edge (Progress), MySQL, Redshift (AWS), Big Query and Messaging (Kafka, Azure Event Hubs) - Implementation solution with Kafka Connect (SQL Server Source Connector, Jdbc Sink Connector, Http Sink Connector) and KSQL db for small transformations. - Implementation of Databricks cluster on Azure and Apache Airflow Celery mode on K8 with CI CD on Jenkins - Use of Liquibase for Devops of SQL sources. Gains: Delivery of strategic projects for the entire company, as our journey is enabling other business areas, increasing the NPS of patients, professionals and allowing a rollout of brands acquired by the group, in addition to integrating Diagnosis + Hospitals + Personal Care.